According to the United States Census Bureau, the town has a total area of, of which is land and is water, comprising 0.77% of the town. It is drained by the Swift River in the north and the Chocorua River in the south. Mount Chocorua, the highest point in Albany, has an elevation of, and Mount Paugus has an elevation of. Albany lies fully within the Saco Riverwatershed. 85% of the area of the town is part of the White Mountain National Forest. Most residential development occurs in the southeastern portion of the town, along New Hampshire Route 16. Route 112, the Kancamagus Highway, runs east-west along the Swift River and is nearly entirely within the national forest. The former village of Passaconaway occupies a broad valley along the Kancamagus Highway in the northwestern part of the town. The area is now a national forest visitor attraction. Other place names within the town limits include Ferncroft, in the extreme southwest corner of town, and the former site of Paugus Mill, along the town's southern boundary.
Demographics
As of the census of 2000, there were 654 people, 262 households, and 182 families residing in the town. The population density was 8.7 people per square mile. There were 506 housing units at an average density of 6.8 per square mile. The racial makeup of the town was 98.47% White, 0.15% African American, 0.31% Native American, 0.15% Asian, 0.31% Pacific Islander, and 0.61% from two or more races. Hispanic or Latino of any race were 0.76% of the population. There were 262 households, out of which 34.7% had children under the age of 18 living with them, 51.5% were married couplesliving together, 10.7% had a female householder with no husband present, and 30.2% were non-families. 23.3% of all households were made up of individuals, and 7.3% had someone living alone who was 65 years of age or older. The average household size was 2.48 and the average family size was 2.85. In the town, the population was spread out, with 26.5% under the age of 18, 6.1% from 18 to 24, 36.7% from 25 to 44, 22.8% from 45 to 64, and 8.0% who were 65 years of age or older. The median age was 37 years. For every 100 females, there were 100.6 males. For every 100 females age 18 and over, there were 102.1 males. The median income for a household in the town was $36,635, and the median income for a family was $39,250. Males had a median income of $29,821 versus $20,250 for females. The per capita income for the town was $20,690. About 10.8% of families and 15.7% of the population were below the poverty line, including 23.9% of those under age 18 and 4.3% of those age 65 or over.