Evidence of the remains of a Roman temple to the god Mercury which was destroyed in 406 AD has been found underneath the building. Today’s late Gothic church still contains the crypt of the original building dating from the first half of the 11th century. This is one of the earliest examples of ecclesiastical architecture on the Middle Rhine. The rich furnishings include the shrine of St. Hildegard and the reliquary shrine of St. Rupert of Bingen as well as several superb Middle Rhine statues from the 14th and 15th centuries.