Let me start by telling you there’s likely nothing wrong with your equipment.
What you did here is create not one, but three ground loops in your setup.
USB has the ground connection defined in its standard, it’s required for it to work correctly.
But as you have experienced here, this causes problems with ground loops.
A powered USB HUB like the Overhub can reduce this a bit, but if you connect everything to the same HUB the problem still exists. A powered HUB works if you want to (semi)isolate a single device.
If you insist on using USB connections for everything, you’ll have to use special USB cables, a USB isolator, or a DI box/audio isolator to get rid of the noise. One for every ground loop.
Another way is to connect everything to a mixer and route audio with that, if it’s well grounded most of the noise will be gone.
About Overhub, and I know people don’t like to hear this, it’s a basic $10 OEM HUB with an Elektron logo printed on it, and not even a good one. You can get the same HUB on Amazon for $10.
There is absolutely nothing special about it.
I would take a Belkin, D-Link or Orico over that any day.
There is also no such thing as USB chips optimized for audio or MIDI, that’s the thing about Universal Serial Bus, it’s universal so it has to work well with everything.
Now, there are better quality USB chips, and some manufacturers provide add-on cards with a driver that’s better optimized for multimedia. But it does nothing whatsoever for ground loops.
Apart from that, the USB controller that’s in your motherboard is most certainly just the Intel controller that’s in the chipset. It should be perfectly capable of doing everything USB has to do.
Just don’t install the drivers, let Windows sort it out via Windows Update. The basic Windows drivers are much more stable than most custom drivers.
Low quality USB controllers don’t “leak” more noise, that’s not a thing.
The power line could be more noisy, but that’s irrelevant with devices that have their own power supply. And even a high quality controller could deliver more noisy power if your computer has a bad power supply.
If you really insist about quality, this is about as good as it gets:
https://www.sonnettech.com/product/allegrousb3pcie4port.html