I try to keep my case assembled and even being a semi open design I never hear my chipset fan at all. I do have a TV connected to a 7.1 Atoms surround system that is normally on when I am at the computer so maybe I just am not sitting in dead silence either when I boot. I also leave the system on 24/7 so maybe I miss it so take all that with a grain of salt. But I have yet to actually see or hear that fan.
MSI MEG X570 Ace
AMD Ryzen 9 3900x
Corsair H115i Platinum, Corsair Crystal 570x RGB Case
32GB Corsair Vengence RGB Pro 3600 @3800
MSI Geforce RTX 2080 Super Ventus SX OC w/ Acer Predator X34P