My method is a little different:
I use four sources of non-lyrical music (classical, techno/electronica/etc, folk, etc) and pipe two into each ear. I started with two sources, one per ear.
This way I am only distracted by listening to music when I need to be distracted - when my mind is processing a task and needs something else to pay attention to.
I'll occasionally include lyrical music in the mix, but only for short periods of time.
I do this for multiple reasons. The first is that it's good background noise - when I'm doing something important, it's easy to tune out the music, easier than when there's only one song to listen to.
Secondly, it's a good meditation exercise, as it makes you be patient and listen without listening (I know it sounds silly, but it works!)
Lastly, I have some auditory processing difficulty (filtering out extra noise is hard for me) so this has helped my brain learn how to do this better.