The second daimyō of Kaga Domain, Maeda Toshinaga after retiring to Takaoka, had a temple, Hōen-ji built, which was completed in 1613. After Toshinaga's death in 1614, the temple was renamed to Zuiryū-ji after his posthumous name, Zuiryū-in. His younger brother, Maeda Toshitsune, and third daimyō of Kaga, in commemoration of Toshinaga, had the temple expanded starting in 1645. The extensions were supervised by Yamagami Zen’emon Yoshihiro who completed the works for the 50th anniversary in 1663. The temple complex at the time covered an area of and — similar to a castle — was surrounded by two moats.
The main entrance gate outside of the actual complex has a kirizuma style, gabled roof with thin shingles. It is a 3 ken wide yakuimon. Decorated with the emblem of the Maeda clan, plum blossom and lions on either end, it is a good example of Momoyama and early Edo period ornamentation.
Built in 1645, the High gate was lost in fire in 1746. It was rebuilt from 1814 to 1818 by Yamagami Zen’emon Yoshihiro. The gate is a two-storied 3 ken wide main gate to the temple and has an irimoya style roof with thin shingles. On either side it is connected to a 3 ken wide, 1 ken deep single-storied corridor with 'kirizuma-style roof, which connects most of the structures in the complex.
The main hall or Buddha-Hall is located in the centre of the temple compound. Made of elm wood, it measures 3×3 ken or. The roof is in irimoya-style with a pent roof enclosure, lead plate roofing. Inside it is a mixture of Japanese and Indian style with good carvings; a masterpiece of Yamagami.
The Dharma Hall is the main assembly and lecture hall of the complex and dates to the year 1655. It is single-storied and measures 11×9 ken. The roof is in irimoya-style with a 2×1 step canopy and karahafu gable. It is roofed with copper plates. The ceiling of the central room has been decorated in floral motif by Kanō Yasunobu. At the end of the room in the central alcove there is a stele commemorating Maeda Toshinaga. The alcove to the right has been used for receptions by the Maeda, the one to the left was reserved for the priests and higher ranking cohorts of the Maeda.
Other buildings in the complex that are connected by the corridor are the large kitchen-residence, the meditation hall, the large tea house.
Close to the entrance on the eastern side of the complex, the following buildings have been renovated recently: the bathhouse and the toilet. In 1997 the High gate, the Buddha-Hall, and the Dharma-Hall were designated as National Treasure. The sōmon, the meditation hall, the large tea house and the corridors have been designated as Important Cultural Property. The temple owns a painting of Daruma by Sesshū, a Kannon by Kanō Tan'yū and other paintings.