Can’t speak to Fedora specifically, but most package managers let you configure the number of concurrent download threads it will use. Most are 3-4 it seems. Finding yours and setting it to 1 will probably do exactly what you’re asking.
Another option is to set it to only download the files, then install manually once they’re local to you. The options for this differ (eg. when installation order matters), so an RTFM is worth the time spent.
If you’re after text, there are a number of options. If you’re after group voice, there are a number of options. You could mix and match both, but “where everyone else is” will also likely be a factor in that kind of decision.
If you want both together, then there’s probably just Element (Matrix + voice)? Not sure of other options that aren’t centralised, where you’re the product, or otherwise at obvious risk of enshittifying. (And Element has the smell of the latter to me, but that’s another topic).
I’ve prepared for Discord’s inevitable “final straw” moment by setting up a Matrix room and maintaining a self-hosted Mumble server in Docker for my gaming buddies. It’s worked when Discord has been down, so I know it works. Yet to convince them to test Element…