Palmer was born in Green Street, Cambridge the son of a private schoolmaster. He was orphaned at an early age and brought up by an aunt. He was educated at The Perse School, and as a schoolboy showed the characteristic bent of his mind by picking up the Romani language and a great familiarity with the life of the Romani people. From school he was sent to London as a clerk in the city. Palmer disliked this life, and varied it by learning French and Italian, mainly by frequenting the society of foreigners wherever he could find it.
In 1859 he returned to Cambridge, almost dying of tuberculosis. He made a miraculous recovery, and in 1860, while he was thinking of a new start in life, fell in with Sayyid Abdallah, teacher of Hindustani at Cambridge, under whose influence he began his Oriental studies. He matriculated at St John's College in November 1863, and in 1867 was elected a fellow on account of his attainments as an orientalist, especially in Persian and Hindustani.
During his residence at St John's he catalogued the Persian, Arabic and Turkish manuscripts in the university library, and in the libraries of Kings and Trinity. In 1867 he published a treatise on Oriental mysticism, based on the Maqsad-i-aqsa of Aziz ad-Din ibn Muhammad Nasafi. He was engaged in 1869 to join the survey of Sinai, undertaken by the Palestine Exploration Fund, and followed up this work in the next year by exploring the desert of El-Tih in company with Charles Drake. They completed this journey on foot and without escort, making friends among the Bedouin, to whom Palmer was known as Abdallah Effendi.
After a visit to the Lebanon and to Damascus, where he made the acquaintance of Sir Richard Burton, then consul there, he returned to England in 1870 by way of Constantinople and Vienna. At Vienna he met Arminius Vambéry. The results of this expedition appeared in the Desert of the Exodus (1871); in a report published in the journal of the Palestine Exploration Fund (1871); and in an article on the "Secret Sects of Syria" in the Quarterly Review (1873).
In the close of the year 1871 he became Lord Almoner's Professor of Arabic at Cambridge University, married, and settled down to teaching. His salary was small, and his affairs were further complicated by the long illness of his wife, who died in 1878. In 1881, two years after his second marriage, he left Cambridge, and joined the staff of the Standard to write on non-political subjects. He was called to the English bar in 1874.
Early in 1882 Palmer was asked by the government to go to the East and assist the Egyptian expedition by his influence over the Arabs of the El-Tih desert. He was instructed, apparently, to prevent the Arab sheikhs from joining the Egyptian rebels and to secure their non-interference with the Suez Canal. He went to Gaza without an escort; made his way safely through the desert to Suez, an exploit of singular boldness; and was highly successful in his negotiations with the Bedouin. He was appointed interpreter-in-chief to the force in Egypt, and from Suez he was again sent into the desert with Captain William Gill and Flag-Lieutenant Harold Charrington to procure camels and gain the allegiance of the sheikhs by considerable presents of money. On this journey he and his companions were led into an ambush and murdered (August 1882). Their remains, recovered after the war by the efforts of Sir Charles (then Colonel) Warren, now lie in St Paul's Cathedral.
According to the Encyclopædia Britannica Eleventh Edition, "Palmer's highest qualities appeared in his travels, especially in the heroic adventures of his last journeys. His brilliant scholarship is displayed rather in the works he wrote in Persian and other Eastern languages than in his English books, which were generally written under pressure. His scholarship was wholly Eastern in character, and lacked the critical qualities of the modern school of Oriental learning in Europe. All his works show a great linguistic range and very versatile talent; but he left no permanent literary monument worthy of his powers."
His chief writings are
He was also an editor of Name Lists of the Palestine Exploration.