This is true. Legacy-media's actually been disproportionately kind towards furries vs. pony people, or even weebs, a group that's arguably more kindly looked upon in public places. The worst associated with furries is that dogfucker ring that bored youtube folk exposed. Even assuming that though, "cum-covered people with mental problems" is the ready association people'll make with adult male pony people.
Overall: furry's the much better image. If we hit absolute rock bottom, we could convert into a furry and weeb site.