Sargent studied law in the Boston office of Samuel Hubbard and then but never practiced law. He next became a partner in the banking house of Gracie & Sargent in New York City, agents of his uncle, Samuel Welles, a Paris banker. In 1841, Sargent retired and moved to "Wodenethe", an estate of about on a plateau overlooking the Hudson River just above Fishkill Landing, New York, which soon became famous for its distant views and its vistas cut through the native forest to the Hudson and the mountains, and for its extensive plantation of coniferous trees. He was an early friend of the great landscape gardener, Andrew Jackson Downing, from whom he derived his earliest lessons, and he edited one of the editions of Mr. Downing's work. The poet William Cullen Bryant was a visitor to "Wodenethe", named for the Saxon for "sylvan promontory". While "Wodenethe" was their primary residence, the Sargents also kept a house at 5 Marlborough Street in Boston.
Literary works
In 1847-49, Sargent travelled with his family in Europe and the Levant, primarily to gather plants and to study the design of parks and country places. As a result, he later published a comprehensive garden guide entitled Skeleton Tours, which included the British Isles, the Scandinavian Peninsula, Russia, Poland, and Spain. He was a frequent contributor to horticultural papers, especially to the Horticulturist, and in 1873 with Charles Downing he wrote a supplement to Andrew Downing's Cottage Residences. Sargent's most important literary contribution is his supplement to the sixth and subsequent editions of Downing's A Treatise on the Theory and Practice of Landscape Gardening. In this he gave an account of the newer deciduous and evergreen plants and told in considerable detail of the development of his own "Wodenethe" and of the estate of his relative, Horatio Hollis Hunnewell, in Wellesley, Massachusetts. A second supplement, added in the edition of 1875, gives a brief account of trees and shrubs introduced since 1859. In a period which marks the beginning of the professional practice of landscape architecture in the United States, this book and its supplement exerted a great influence on popular taste. Sargent's influence may also be seen more directly in the horticultural interests of his kinsmen, Hunnewell and Charles Sprague Sargent.
Personal life
On January 10, 1839, Sargent married Caroline Olmsted, daughter of Maria and Francis Olmsted of New York. There were three children of this marriage, two of whom predeceased their father, including:
