At the outbreak of hostilities, his father served as the Governor of Ohio, and undoubtedly influenced Dennison's direct commission into the regular U.S. Army, on August 5, 1861. He was assigned to the 2nd U.S. Artillery, an organization whose officers corps produced both Chiefs of Artillery for the Army of the Potomac, and the who formed the backbone of the famed U.S. Horse Artillery Brigade. Promoted to first lieutenant on November 12, 1861, Dennison served with the 2nd Artillery throughout the Civil War, almost entirely with the Horse Artillery Brigade. He gained most of his experience while serving as a section chief in Battery A, 2nd U.S. Artillery, under the command of Captain John C. Tidball. During the Peninsula Campaign, Dennison commanded the rear section of Tidball's "flying battery." In 1864, Dennison commanded Battery G, and eventually returned to command Battery A until the end of the war. He was awarded two brevet promotions for gallantry in combat, including the ranks of captain and major. At war's end, he received his final brevet promotion, to lieutenant colonel, for his overall service and conduct during the war.
Postwar career
Promoted to the permanent rank of captain in 1867, Dennison requested and received a discharge from the army in 1870. He appears to have dabbled in politics, perhaps hoping to follow in his father's successful career as Governor of Ohio and Postmaster General of the United States. His public reputation suffered due to unsavory business dealings with questionable acquaintances, and he lost the 1879 mayoral race in Columbus, Ohio. He moved to Denver, Colorado, where he served as a district attorney and also dabbled in speculative mining and saloons. He was plagued with negative press and maintained somewhat of a rogue's reputation. His business partners, Sam and Lou Blonger, also owned gambling houses. Ultimately, he lost his position with the District Attorney's office. Colonel Dennison was married to Mary Cole Haldeman, the daughter of Edwin Haldeman and Harriet Cole. They had four children. Dennison died December 31, 1904, and was buried in Green Lawn Cemetery, Columbus, Ohio.