Jeter, Cano and Swisher are all way below average defensively. I'm not sure what numbers you're looking at to make that determination.
Lowe's had one below average season in his major league career. That 2004 season is an outlier. Lowe has also improved tremendously as a pitcher the past couple of seasons; the improvement just happens to coincide with his NL West move. It's more correlation than causation. He's a smart, durable pitcher with insane GB/FB ratios. He's good.
Cano and Swisher aren't way below average defensively. Two years ago Cano was really good, and last year he was about average. Swisher is good at the corners, and a decent first baseman. Derek Jeter actually improved last year.
Lowe is 36 now. No thanks. Have you seen his home/road splits the last 3 years? He has an ERA over 4 on the road. That's like an 8 in the AL East!