Joel Doolittle was born in Russell, Massachusetts in April, 1773, the son of Titus and Mary Doolittle. He attended Williams College from 1795 to 1797, and graduated from Yale University in 1799. After graduation, Doolittle settled in Middlebury, Vermont to work as one of the first two faculty members at Middlebury College while also continuing his own studies, both at the college and in a local law office. He was admitted to the bar in 1801, and received a master of arts degree from Middlebury College in 1802. Doolittle maintained an extensive practice in Middlebury, and was also a sought after legal instructor; among the attorneys who received their training in his office were Asa Aikens and William Slade. Active politically as a member of the Democratic-Republican Party, in 1815 Doolittle was elected to the Vermont Governor's Council, and he served until 1817. In 1817, Doolittle was elected a Justice of the Vermont Supreme Court, and he held this position until 1822. In 1824, he served in the Vermont House of Representatives. Later that year he returned to the court, and he served until 1825. In 1834, Doolittle was named president of the Vermont Council of Censors, the body which met every seven years to review actions of the state government and ensure their constitutionality. Doolittle was elected a member of the Middlebury College Corporation in 1819, and he served until his death. He was also active in the Episcopal denomination, and was one of the founders of St. Steven's church in Middlebury.
Death and burial
Doolittle died in Middlebury on March 9, 1841. He was buried at Middlebury Cemetery.
John Titus, an attorney and judge, and the husband of Ann M. Marshall of Painesville, Ohio.
Charles Hubbard, an attorney and judge, and the husband of Elizabeth Kemp. Charles H. Doolittle resided in Elyria, Ohio.
Mary Lewis, who died in Middlebury before reaching adulthood.
Sarah Porter, the wife of Joel S. Alvord of Painesville, Ohio.
Elizabeth B., the wife of Henry C. Gray of Painesville, Ohio.
Joel Jr., a resident of Painesville, Ohio who operated a real estate and insurance business and held local offices including village assessor. He never married or had children.
Mark R., the husband of Alta B. Briggs, and a newspaper publisher and editor in Painesville, Ohio.