Some jurists say the action is permitted and the proof is the Hadith of Amr Ibn Shoaib from his father from his grandfather said "I saw the Messenger of Allah praying barefooted and in his shoes.", narrated by Abu Dawood and Ibn Majah.

On the other hand, the majority say it is desirable for the Hadith narrated by Abu Dawud "Contradict the Jews, they don't pray in their shoes nor their slippers." And Allah says, "O Children of Adam! Look to your adornment at every place of worship" and the adornment of the feet are the shoes. Ibn Taimiah said in his book "al Fatawa al Mahdia" it is desirable and it is a sunnah.

However, as long as the mosques today are furnished with expensive carpets that may be spoiled by such act which will consequently harm people performing prayers, modern fuqahaa say that it is desirable not to cause such harm to mosques or people. So the opinion is to take off your shoes in mosques and the proof is the Hadith narrated by Abu Dawud "if one of you took off his shoes to pray, he shouldn't harm anybody with them; either he puts them between his feet or prays in them". This is the fatwa of the permanent committee, Sheikh Ibn Bazz and Sheikh Ibn Othaimeen. And Allah knows best.