I care deeply about anyone who listens to my music. That's a sacred connection between the artist and the person who appreciates what you do - it's beyond words how meaningful that is. But I'm not going to stifle myself from trying new things because I feel like people that are already into my stuff might not like it.
