A monastery has existed in the town since 715CE but the abbey's origins are from the 10th century. The current abbey church was begun in 1102 with construction lasting several centuries (and surviving a serious fire in 1178). After the Dissolution, the abbey church was saved by the townsfolk who wanted to continue using it as their parish church. One part of the church that has not survived is a free standing bell tower which was demolished in the 18th century.
The church is large, the same size as many cathedrals in the country. The church has a cruciform plan with one of the largest Romanesque crossing towers in Europe. The tower was once topped with a wooden spire but this collapsed in 1559 and was not replaced. The church has an eight bay nave with aisles and a north porch. The church is mostly built from limestone ashlar.
