The Church of the Holy Cross was built in 1650. The church is wooden and was constructed using only axes as tools, using neither saws nor iron nails. The interior of Stelmužė church was upholstered after 1713. There are quite a lot of valuable ornaments of Baroque style: bas-reliefs, high reliefs, sculptures, spiral columns, original wooden ornamentation, old religious paintings. From 1808 the church belongs to Catholics. The museum in the church was founded in 1997.