In 1678, Tadatomo Okubo, the Councilor of the Edo shogunate, gave land provided by the fourth generation general, that landfilled the sea surface and became the "Kaiyusiki sensui garden (Garden that can be appreciated while walking around in the park)".

During the end of the Tokugawa period, it later became a mansion of the Tokugawa family of the Kishu. In 1872, the Arisugawa family became the owner, and later the garden came under the ownership of the "Kunai Province" and was renamed Shiba Rikyu.

This garden’s buildings and trees were heavily damaged by the Great Kanto Earthquake.