Fisher came from a family of farmers from Hethersett, near Norwich, who had been farming there for about 100 years. His father, David Fisher, a craftsman, and his mother Mary, née West lived in Norwich. Fisher was born on 26 December 1760. He was the eldest son and the third of the eleven children. After he had finished school he trained as a carpenter. He performed in some amateur dramatics. As he was handsome, and had a fine tenor voice, he attracted the attention of Giles Barrett, the manager of the Norwich Theatre Royal. After a trial appearance he was engaged by Barrett as a singer. During the 1780s Fisher's fame in and around Norwich grew and by 1788, he felt secure enough to marry. With a growing family he took the bold step in 1792 to branch out on his own and purchased a large share in a touring company owned and managed by William Scraggs, taking on the management of it. Initially the company was in competition with several other troupes, but Fisher took a more business like approach and taking care of his staff of twenty or more, and had better equipment such as scenery, and a much larger collection of good quality costumes, so gradually the competition withered away, which left north East Anglia his. Fisher catered to all classes but his decisions as to where to visit and how long to stay were made on the number of gentry and noble seats in a region, as they were the ones who would pay a premium price to be entertained. When he was to open at a location he found it advantageous to deliver advertisements to every large house within a 6-mile radius of his location. By the early 1800 Fisher had established a profitable two year circuit. Over the next decade the Scraggs gradually left the company: William and his wife died and their son left to set up on his own. In the 1810s Fisher decided that his company was profitable enough that instead of setting up his plays in inadequate play houses, he could start to build his own theatres. In 1812 he completed his first two, one in Lowestoft, in north Suffolk, and the other in Wells next the Sea on the north Norfolk coast. Over the next sixteen years, usually raising capital with share offerings to local patrons, he opened theatres in Halesworth, Woodbridge, Eye, East Dereham, Sudbury, Thetford, Beccles, Swaffham, Newmarket, Bungay, and North Walsham. The theatres were rebuilds or new theatres, with two exceptions Halesworth and Sudbury. His theatres were of his own design to fit his companies needs. Critics considered them comfortable, neat, elegant and practical. Fisher retired from managing the company and theatres in 1827. He passed managerial control to his three sons and the theatres were left in trust to his three nephews. He carried on acting until 3 August 1832 just three days before he died. He left a legacy of a family acting tradition which lasted for over 150 years.
Family
On 16 March 1788 Fisher married Elizabeth Burrell. After their marriage she joined him on stage, becoming a member of the same company. They had five children, of whom their daughter and youngest son died young. The three other boys were David, Charles, and George. They were initially placed in local school, but then because of the family's itinerant lifestyle were later sent to a boarding school in Whittlesey, Cambridgeshire. In addition the children received extra tuition in French, dancing and music. They all followed their parents into the theatre.