The armory was built on a site beginning in 1855. Low-lying, often flooded meadows were set off from the river by a dike and drained. The dike and earliest armory buildings were completed in 1855, and Colt's mansion Armsmear was constructed the following year on a hill overlooking the armory. Shortly afterwards Colt added 20 six/eight-family houses on Huyshope and Van Block Avenues for skilled workers. Colt's 1855 East Armory was almost totally destroyed by a disastrous fire in 1864; only two small outbuildings remain of this original construction. The West Armory was demolished before World War II. After the 1864 fire, the East Armory was rebuilt on its predecessor's foundation, to designs by General William B. Franklin, the company's general manager and a former U.S. Army engineer, and completed in 1867. It is a 5-story brick structure with brownstone accents, in dimensions, with its main entrance in the center of a five-bay pavilion projecting from the main facade. The building is capped with a distinctive onion-shaped, sheet metal dome, painted deep blue with gold stars, and resembling that of the 1855 armory. A gilded ball sits atop the dome, above which is a gilded fiberglass replica of the original "Rampant Colt". Four Porter-Allen steam engines drove the armory's machine tools through a maze of shafts and belts. Mark Twain, who lived in the nearby Mark Twain House, visited Colt's armory in 1868 and described it thus: "It comprises a great range of tall brick buildings, and on every floor is a dense wilderness of strange iron machines… a tangled forest of rods, bars, pulleys, wheels, and all the imaginable and unimaginable forms of mechanism… It must have required more brains to invent all those things than would serve to stock 50 Senates like ours." Today the factory complex includes: the Forge Shop and the Foundry ; the East Armory with its distinctive blue onion dome, rebuilt in 1867; the South and North Armories, the Machine Shop, Warehouse, Power Plant, and Garage, built in 1916 to accommodate World War I production; and the World War II Office Building. The state of Connecticut has been trying to place the complex under the administration of the National Park Service as a National Historical Park, similar to designation granted the Lowell National Historical Park, another important site in the history of American industrialism. In 1994, Colt's Manufacturing Company vacated the Hartford complex amid financial difficulties, consolidating operations at a West Hartford, CT location opened in the 1960s. A former tenant in the East Armory, U.S. Fire ArmsManufacturing Company, originally manufactured replicas of historic Colt pistols, before diversifying and discontinuing the replicas.
In addition to Colt firearms, the factory produced a number of items under contract for other companies. The most famous of these was a letterpress printing press designed by Merrit Gally, known as the Universal. From 1873 to 1902, the Armory manufactured a series of these presses that developed a reputation as the finest hand-fed platen press ever made. These presses eventually became known generically as "Colt's Armory" presses, although they were distributed under names including Colt's Armory, Universal, Victoria, Hartford, National and Laureate. The fascinating history of the design, production, sales and business battles behind these storied presses was summarized in a 1983 article in the typographic journal Type & Press.