Well, I wasn't referring so much to listening experience as the low level technical parts of it. The compression MP3 uses causes artifacts (granted, only on qualities below 192) while I've never heard Vorbis cause those artifacts, even at abysmal quality.
Though if one is truly an audiophile, FLAC is likely the way to go.