The temple is one of the most popular shaktipeethas (devotional shrine where the severed body parts of Goddess Sati fell). Situated near River Kshipra, the temple carries the idol of Mata Harsiddhi, who is the presiding deity. Tourists can also pay obeisance to the idols of Goddess Annapurna, Goddess Mahalakshmi and Goddess Mahasaraswati. A highlight of the temple is the SriYantra, the symbol of power or Shakti, which is enshrined here. The temple architecture has some Maratha influences. It has four entrances, one in each direction; the main entrance is on the eastern side. In the compound of the premises are two pin-shaped towering pillars. Especially lit during Navratri (a holy nine-day festival), the 726 light holders on these two pillars make for a stunning sight. Apart from these two prominent pillars, there is also an ancient well within the premises that has an artistically-carved pillar adorning its top. The Skanda Purana, an ancient text, has an exciting legend wherein Goddess Chandi got the epithet of Harsiddhi and thus, had this temple dedicated to her. The story goes: Once, when Lord Shiva and Goddess Parvati were alone on Mount Kailash, demons Chand and Prachand tried to intrude on their privacy, and to destroy the two, Lord Shiva called upon Goddess Chandi who later killed them.

According to popular hearsay, King Vikramaditya was a great devotee of Mata Harsiddhi and regularly came here to pray.