In this place, there are remains of materials that belonged to the Bronze Age (1500-1000 B.C.), in addition to remains belonging to the Roman civilization.

During the reconquest of the kingdom of Valencia by Jaime I of Aragon (1229-1245), one of his knights, Carròs (Carros, son of Count Alemany), gained the strong and rocky Castell de Rebollet. The King, grateful for his services, made Lord of the Castle and the Village of Rebollet a favour to Mr. Carròs in 1240, where he erected a church where he deposited the image of la Mare de Déu de Rebollet.

The 26 of December of 1568, in the region of the Safor, one of the worst earthquakes known until the moment took place, demolishing many buildings and among these el Castell de Rebollet. One of the few things that were saved were the image of la Mare de Déu del Remei and the image of the XIII century of la Mare de Déu de Rebollet wich after many clashes between Oliva.

Currently, el Castell de Rebollet is very deteriorated by the passage of time and natural conditions. However, this is situated in a landscape of beauty overlooking the sea.