The Yanagisawa were originally from Kai Province and descend from Ichijo Tokinobu, grandson of Takeda Nobunaga, a grandson of Takeda Nobuyoshi. Yanagisawa Nobutoshi was the son of Aoki Nobutaka, and member of the Mukawashu, a cadet branch of the Takeda clandescending from Ichijo Tokinobu, and a group of warriors who defended the border. At that time, the Aoki clan was in the position of the head of the Mukawashu. After the fall of the Takeda clan, the Yanagisawa together with other Mukawashu were recruited by Tokugawa Ieyasu, who protected several surviving retainers of the Takeda clan, such as the Yonekura clan and the Tsuchiya clan. On August 16, 1582, Ieyasu granted him 72 kan 800 mon of land in Kai province. In 1590, when Ieyasu was transferred to Kanto, Nobutoshi received 230 koku in the Hachigata territory of Musashi Province. Yanagisawa Yasuyoshi, his son, was a Hatamoto, a direct retainer of Tokugawa Hidetada and later Tokugawa Ietsuna, increasing his income to 430 koku, whereas his younger brother Yanagisawa Yasutada went into the service of Tokugawa Tsunayoshi of Tatebayashi Domain. Yanagisawa Yoshiyasu, son of Yasutada inherited the family stipend of 530 koku in 1675 when his father retired. In 1680, when Tokugawa Tsunayoshi, became the 5th Shogun, Yoshiyasu, became also the direct vassal of the Shogun. In 1688 he was appointed Sobayonin and was promoted to Daimyo of Sanuki Domain in Kazusa province. In 1690, he was given an additional 20,000 koku. In 1694 he was appointed as Rōjū, and transferred to Kawagoe Domain. In 1704, when Tokugawa Tsunatoyo from Kōfu Domain was chosen as Tsunayoshi's heir, Yoshiyasu was transferred to Kōfu Domain. From April 10 to April 12 of the same year, at the memorial service for the 133rd anniversary of the death of Takeda Shingen at Kai Erin-ji Temple, Yoshiyasu emphasized that he was a member of the Takeda family. In 1706, he was promoted to the rank of Tairō. His son, Yanagisawa Yoshisato was transferred in 1724 to Yamato-Kōriyama Domain in 1724, where his descendants resided to the abolition of the han system in 1871. The final daimyō of Yamato-Kōriyama Yanagisawa Yasunobu received the kazoku peerage title of hakushaku.
Cadet branches
A branch of the clan descended from Yanagisawa Tsunetaka, the 4th son of Yanagisawa Yoshiyasu was granted the 10,000 koku holding of Kurokawa Domain, from 1723 to 1868, and subsequently received the title of viscount.
A branch of the clan descended from Yanagisawa Tokichika, the 5th son of Yanagisawa Yoshiyasu was granted the 10,000 koku holding of Mikkaichi Domain, from 1723 to 1868, and subsequently received the title of viscount.