This is what the magazine says:
"An expert panel of musicians, industry figures, and critics, selected by the editors of Rolling Stone, was asked to pick, in order of preference, the twenty most significant artists of rock's first fifty years. The votes were tabulated according to a weighted point system overseen by the accounting firm Ernst & Young."