The island is very small so nothing is more than a 30mins drive away.
The main places to stay (more touristy areas with public transport) are on the east-side of the island - this is where we would recommend and have highlighted in yellow on the map below.
However, feel free to stay elsewhere (but you may need to hire a car).
Bolt is also the main taxi app and is very cheap.