I tend to listen to all sorts of music as well.
Of course, I have one specific type I listen to, and will never stray from.
But then again, I will always "float around", and listen to all other types. If I don't like most of the new stuff I've decided to flavor, I keep the little bit I liked in my memory, and end up adding it my collection.
Just don't be afraid to sample everything.