Drummond was the second of three sons. Despite his father dying when he was young, he credited his mother with getting him through his education at Edinburgh High School and then on to be a Royal Engineer cadet at Woolwich Academy in 1813. He showed an early gift for mathematics. After Woolwich he was stationed in Edinburgh and was involved with public works. He was bored with this and had enrolled at Lincolns Inn when he was recruited to use his trigonometry to help conduct a survey in the Highlands. This new work was done in the summer with the more difficult months being passed in London. Drummond took this opportunity to improve his knowledge of mathematics and science. He attended lectures by Sir Michael Faraday. At these he learned of the discovery of limelight.
In 1824 Drummond was transferred to the new Ordnance Survey of Ireland and here he used the new Drummond light. He reported that the light could be observed 68 miles away and would cast a strong shadow at a distance of thirteen miles. Drummond left Ireland for a period prior to the Reform Bill of 1832. For his services to the Whigs, acting as secretary to Lord Spencer, Lord Brougham had him awarded a pension 300 pounds per annum. In 1835 Drummond, now back with the Irish Survey, married the wealthy heiress Maria Kinnaird, who was the adopted daughter of the critic Conversation Sharp. They had three children, Emily, Mary and Fanny.
He was then appointed to the significant post of Irish under-secretary, heading up the administration in Dublin Castle, a position he held from 1835 until his death in 1840. A supporter of the Whigs, Drummond was held in high regard by Irish, whom he treated with impartiality. Drummond died in 1840 and was buried in Mount Jerome Cemetery, Dublin. It was concluded by his family physician, Dr. Johnson, who spent his last days with Drummond, that he was afflicted with peritonitis, which was symptomatic of an undetermined medical cause. It is believed by some that overwork and stress precipitated his premature death in 1840 after working unceasingly for five years as Irish under-secretary. His dying words were reported as: Drummond was critical of the system of large estates in Ireland and famously stated, "Property has its duties as well as its rights."