The list begins and ends with Tim McCarver. He's the absolute worst.
Others not mentioned so far: Dick Enberg (senile), Dan Dierdorf (talks too much), Billy Packer (as bad as Vitale at times), Bill Raftery (if I hear, "MANNAMAN!" many more times, I'm going to snap).