You shouldn't waste your love and time in someone that doesn't love himself, if your partner cared about you, he would realize you are looking out for his best interest but if he doesn't, maybe it isn't worth your time.
You are still in time to find a new partner that actually compliments your desired life style and someone in which you can trust and grow together.