Sogakudo of the Former Tokyo Music School was designed by Hanroku Yamaguchi, who had designed many buildings in the Meiji Period, and Masamichi Kuru, who designed The Imperial Library (the present International Library of Children's Literature, National Diet Library), and built as a school building of Tokyo Music School in 1890. The acoustic design of the concert hall "Sogakudo" on the second floor was worked out by Rokushiro Uehara. It has a high vaulted ceiling, which was made considering a visual impact, ventilation and acoustics.
 The building became old after more than 80 years had passed since its construction in around 1965, and its relocation to areas outside the boundaries of the Metropolis was suggested. However, the Architectural Institute of Japan and a group of musicians launched a campaign to conserve the building at the site, so Taito City took over it in 1983, and reconstructed the new building at the present site in Ueno Park in 1987. It was designated as an important cultural property in the following year of 1988.
 Sogakudo was opened to the public after the relocation and reconstruction, and used as a concert hall. In 2013, it was closed in order to conserve its facilities, and underwent restoration work. It reopened in November 2018, and was opened to the public again as well as started to be used as a concert hall.

 Yorisada Tokugawa, a music researcher, bought the Sogakudo's pipe organ from England in 1920, installed it in the concert hall "Nankigakudo," which was designed by William Merrell Vories, in Shirokane Sanko-cho, Shiba-ku (the present Shirokane, Minato City). The pipe organ was used for concerts and other events. Later, it was donated to the Tokyo Music School in 1928. It has 1379 pipes, and employs a pneumatic action mechanism. It is the oldest pipe organ for concerts in Japan. Along with the restoration work, the pipe organ was also restored, producing unchanging tones.