Situated about 2 miles from the city of Ujjain, the deity in this temple is believed to have been worshipped by Kalidasa. The legend goes that the great poet Kalidasa was originally uneducated, but with his great devotion to the goddess Kalika, he acquired unparalleled literary skills. Emperor Harshavardhan had this temple renovated in the 7th century AD. There is further evidence of renovation during the Paramara period. The temple has been rebuilt in the modern times by the erstwhile Gwalior State.