You can use your OV-chipkaart on the trams in the Hague and other cities, as well as trains. Just remember you need a minimum of 20 Euros on your OV-chipkaart to use the train.
And do I have to check-out when I leave the tram?
Yes, you always need to check-in and check-out.