The last few years of Malcom X's life he had become more moderate in his believes. That, and many leaders of Nation of Islam had numerous mistresses and illegitmate children they didn't support. MX thought this went against Islam. So he left the group.