When the pump is running properly, it just hums. Yes, you can hear it, but it is not loud at all.
I only know this because the fresh water pump on my 2016 R25SC started making a loud noise this spring when we de-winterized and re-filled the tank. Still troubleshooting my problem -- with helpful suggestions from this group -- so no solution yet, but you might consider checking the input filter to see if it's clogged and the output of the pump to see if it is putting out plenty of water when it runs. (I have done those things and no joy yet, but I have more to try...) Next step -- according to Andrew Custis -- would be to blow air into the input hose to remove any possible blockage. All these connections come off easily, without any tools. I'll be trying the air blowing step next myself, when I get my air compressor to the boat.
Anyway, your water pump shouldn't be waking up your neighbors. The pump just might be working too hard to get water through, because of a blockage somewhere or a leak that makes it suck air. Just my thoughts. I ain't no expert.