Also known as the Church of Immaculate Conception, St Paul Church holds both spiritual and historical significance. It takes its architectural style from the Gothic example and was built by the Portuguese. The structure of the church is quite majestic and the elaborate front facade immediately arrests one's attention.

The interiors are equally lavish with the walls covered in shell-like motifs, a vaulted stone dome, three altars including the pulpit that are made of black wood worked with great precision and craftsmanship. The wood is believed to have been brought from Mozambique, the erstwhile African colony of the Portuguese. A statue of Mary is enthroned on the main altar and right underneath is the sanctum sanctorum. The foundation stone of the church was laid on April 7, 1601, and the construction was completed in 1610.