tl'dr I think you might be right. the below are some thoughts but isn't directly addressing what you were saying, it just sits in the same universe.
I've been thinking about this exchange, and what I am seeing on Fedi is there's a tendency on the part of the promoters (especially on Mastodon, but to some extent all of them) to conflate shared interests with server preferences. way back in the day, Usenet was popular, and your connection to it did help as part of your (with a university, or other provider) (username@the.org.im.in.edu) but the discussions were separated by topics (sci.space, talk.bizarre, etc) and at least from what I saw did not become an echo chamber. some topics were moderated.
Reddit is centralized but still tries to do that. however since there's moderation and such still an echo chamber and everyone has throwaway handles.
Fedi is more like usenet, but people instead tell newcomers to find community by picking the right server and using hashtags. that's offputting and also leaves people who don't have time to go digging kind of lost and at the mercy of the boosting preferences of whoever does have time. and the hashtags are a guess, and rely on accurate autocomplete (which in my experience doesn't exist), and are often not used by people posting.
if there was a better way to register and define topics other than using freeform hashtags that might help, and also would shut down a lot of "hoa" behaviour like "put politics behind a trigger warning" etc. it would make it easier to avoid undesired topics, by simply not following them. but I suspect that means a change to the AP protocol which is already a mess.