The ruins of the small castle are located above the temple of Metamorphosi in Karlovasi. During the Byzantine period the island fell into decline and was initially occupied by the Saracens. In the 13^th century it consecutively passed to the Franks, the Byzantines and finally the Genovese Giustiniani. So this castle is a small fortress built by the Genovese after the conquest of the island, aiming to protect it from raids.
The Genovese Castle is located in Potami, 3 kilometers outside Karlovasi.