The palace of Kaliadeh is set amidst a beautiful landscape, near the Kal Bhairav Temple, with River Kshipra flowing on both its sides. From afar, it looks like an isle. There are water channels and man-made tanks within the complex, which is surrounded by lush landscape that lends the palace a spectacular look. Visits of Mughal emperor Akbar and his son Jehangir are recorded in two inscriptions in one of the corridors here. Traces of Persian style of architecture can be witnessed in the palace's central dome along with inscriptions on the walls and the structure of the central hall. The palace was restored in the 1920s by Maharaja Madho Rao Scindia after it was demolished completely by the Pindaris. One of the most remarkable landmarks of Ujjain, the palace was built by Sultan of Mandu in 1458 AD. According to local hearsay, there was also an ancient Sun Temple in the premises with two water bodies - Surya Kunda and Brahma Kunda.