That's a good point and the next evolution recommenders try to do is to become contextual. There may be songs you like at dinner or on weekends but not vice versa. These types of things like time of day, device and other types of data points can make a recommender more precise.
