How big of a nuisance is that house really for the rest of that neighborhood though? The houses look relatively spread out and all of the show is contained inside the actual house. Probably the worst part is cars coming and going at all hours in the middle of the night but its no different than if a neighbor worked nights and drove off and came home during the night. Maybe there would be a lot of yelling and banging on walls during challenges but I think production generally makes them keep the noise down so it doesn't ruin the audio on the stream. I can't imagine the neighbors are actually suffering at all because of the show.