Agree, with the numerous debates over the internet, comparing ABX tests and so forth, this is always the thing that get's overlooked in discussions. Even if one can't always hear it, It's knowing you have a bit perfect copy of the track from the CD, mastertape, or record, or whatever the source was. I just refuse mp3 or anything lossy point blank.
Podcasts and talking books is another thing, totally different kettle of fish.