This study shows how the miserable political conditions of Muslim ummah were across Muslim world ,after the end of first world war with the collapse of Ottoman Caliphate. This also proves the indispensability of the institution of caliphicate for the unity of the Muslim and their prosperity. In the context of political downfall of Ottomans, the western powers destroyed the unity of Muslims by inventing new terminology of Muslim nations. Not only in the Muslim world but even in the Arab world racial, linguistic and parochial prejudice has been inculcated in the minds and hearts of Muslim towards each other. This turmoil situation is evident from the terrible clashes of Arabs with Turks and between East and West Pakistan Bengalis v/s west Pakistanis. However, in this political turmoil Muslim thinkers came forward and tried to regenerate the Muslim ummah and to re establish an Islamic state which could protect muslim from being destroying, most important among them are, Allama Muhammad Iqbal, maulana Abul’ kalam Azad, Syed Abu al ala Maulana Modoodi,and Dr.Israr Ahmed.A brief description of their work has been discussed in this article.