There is a very romantic private resort in Oman called Zighy Bay. It has a tower, on the roof of which it is possible to dine by candlelight. To get to the roof, you need to go inside, and up this spiral staircase. It’s worth it.