The property containing Victoria Park was established in 1789 by Governor Edmund Fanning as a parcel for the use of the colonial administrator for St. John's Island. This property located immediately west of Charlottetown's original "500 lots" was roughly eight times larger than the thirty-six "estates" established in the northern part of the Queens Royalty. It was envisioned that the property would be used to provide farmland for the governor and a site for an official residence. Prior to the War of 1812, the Prince Edward Battery established a fortification along the shore of the property facing the main shipping channel into Charlottetown Harbour. This battery was manned by British Army regulars, as well as colonial militia until the mid-19th century. In 1809 an Act of the Legislative Assembly was passed to establish a meridional line for surveyors in the colony. In 1820, three commissioners reported to Governor Charles Douglass Smith their calculations of magnetic declination and placed stone markers to this effect in a field cleared immediately north of the Prince Edward Battery. In 1846 additional markers were placed at right angles to the meridional lines. These survey stones remain in the park to this day. The property known as the Governor's Bank was nicknamed "Fanning's Bank" and eventually shortened to simply Fanning Bank. In 1826, a farm house and barns were built and in 1832, a tender was called for constructing Government House to house the colonial administrator which opened in December 1834. Public pressure began to build for access to the property and in 1869, the colonial government of the day stated that of land was "quite sufficient for Government House" and that the remainder should be procured for the public "as a place of retreat from the heat, filth and dust of the city". On June 14, 1873, only 16 days before the colony became a province of Canada, Governor William Cleaver Francis Robinson vested responsibility of of the Government House Farm, also known as the Fanning Bank Farm, to the City of Charlottetown "to and for the use of all her Majesty's subjects as a park, promenade and pleasure ground. On no condition may it be used for circuses, shows or exhibitions of any kind..." Shortly after this proclamation, the name Victoria Park was assigned in honour of Her Majesty Queen Victoria. British military forces left Canada in 1905 and in that year the property containing the Prince Edward Battery and a field adjacent to Government House were given to the City of Charlottetown to add to Victoria Park. Following its transfer of ownership in 1873, the City of Charlottetown began making improvements to Victoria Park, including planting trees, removing stumps, constructing bath houses, and dredging Dead Man's Pond. In 1896 a roadway was built along the shore in front of Government House from Government Pond to the Prince Edward Battery; this occurred only after a legal struggle between the Lieutenant-Governor of the day and the city. The road, now the eastern part of the Park Roadway, was opened in 1897 for Queen Victoria's Diamond Jubilee. In 1903 the western part of the Park Roadway was constructed from the Prince Edward Battery along the shoreline to Brighton Road. The entire Park Roadway was paved with gravel in 1925.
Development pressures
The park has experienced tremendous development pressures during the 20th century:
In 1934, the northern portion of the adjoining Government House property was secured for the Prince Edward Island Hospital.
A "caretaker's cottage" was built in the early part of the 20th century to house a park warden, typically a military veteran.
A service road, named the Park Driveway, was constructed at this time to access the baseball field from Brighton Road, continuing south to the Prince Edward Battery, bisecting the park.
In 1955 an ice cream parlour was constructed and operated as a fundraising enterprise for the non-profit Kiwanis Club.
Tennis courts and a clubhouse were constructed off the Park Driveway west of the Prince Edward Battery.
A public swimming pool was built in the 1950s at the northwest corner of the park.
Two softball fields were built on the east side of the Park Driveway opposite Memorial Field during the 1970s-1980s.
A playground was established in the 1970s near the swimming pool.
A skate park was constructed between Memorial Field and the swimming pool/playground in the early 2000s.
Additional tennis courts were constructed in 2008 in preparation for Prince Edward Island to host the 2009 Canada Games. Memorial Field was upgraded at this time.
The Canada Day fireworks displays and associated public celebrations were held at the park near Fort Edward until being moved to Confederation Landing Park in the mid-1990s. The Canada Day fireworks returned to Victoria Park in 2011.
A for-profit children's winter carnival was held in the park during the early 2000s before moving elsewhere. This was moved after being found to be in violation of the park's founding charter.