Well, yes, unfortunately the trip is not very easy. From Kuala Lumpur you have to take a domestic flight to Kota Bharu and then a taxi from the airport. From there to the Kuala Besut pier it's a drive of approximately 1 hour (price is reasonable for a taxi though). Finally you take a speed boat to the islands.
If Malaysia, have you ever thought about Langkawi? The island has an airport and getting there is way easier.
It doesn't have to be Malaysia, but Langkawi does look nice. Thanks for the recommendation.