Was Fantasy Island in the Caribbean or South of Mexico? Closer to Hawaii?

I always assumed it was somewhere in the Pacific, maybe near Hawaii.

I always figured it was somewhere in the Caribbean.

I think my fantasy would be to live in the world of one of my favorite shows, like Little House on the Prairie, The Andy Griffith Show, Mama's Family, etc.

Choosing one would be hard, though.