Have you seen my mini-movie about the sunset at Hvitserkur, Vatnsnes? I posted that a few days ago.
Here is a photo of the rock while the misty sunset began.
We did climb down towards the water. I can only recommend this. But you need some hiking experience to do so. And good shoes.