How Trump could lose his loyal base