Entities generating invalid RSS?

It seems that using any kind of HTML entities, like accents, for example, causes WordPress to generate invalid RSS, causing my aggregator thingy to break. Of course, I’ve noticed for a lont time that using things like quotes or apostrophes causes bizarre things to happen in the RSS. Is this a problem with WordPress, or with my aggregator thingy? Dunno, but it’s irritating.