Guys, I've updated sourcemod on the server. Let me know if the buffer overflows are still happening and I'll go in and see what I can do.
So I don't know how it looks on the server end, but it's definitely related to voice chat. Whenever the drunk whistle is blown and we all react at once. Or Clutch's kid calling bullshit and we all go "awww" at the same time. That's when a bunch of people drop out.