I tried switching channels too, because I thought it was just congestion on the three channels that are used the most (1, 6, 11). But that didn't help.
There are some useful Dashboard Widgets for finding out which channels are used, btw, like
AirTrafficControl.