The Augartenpalais was built om 1692 for Zacharias Leeb, a merchant and city councillor. Plans for the palace were probably by Johann Bernhard Fischer von Erlach, one of the most famous architects of the day.
In 1780, Emperor Joseph II bought it as a hunting lodge. Joseph, who had frugal tastes and thought the palace frivolous, had the "Josephstöckel" built at the back of the building, smaller and perhaps for him more practical. Today, the Josephstöckel houses the Choir's kindergarten and primary school.
In the 19th century, a salon opened in the palace; among its guests were Johannes Brahms, Franz Liszt, Richard Wagner and Hans Makart.
In 1873, a feast was held at the palace as part of the Vienna World Exhibition, with Emperor Franz Joseph I and Tsar Alexander II present.
In 1897, the family of archduke Otto moved into the palace; from 1934 to 1936 it was the residence of the Austrian chancellor Kurt Schuschnigg. The Palace sustained substantial damage in World War II. In 1948, the government gave it to the Vienna Boys' Choir who renovated it with the monies made during their 1948 tour of the USA.