Well that depend on which taste you develop.
I personally like it with sugar.
But I have seen many people who are sugar conscientious enjoy it without sugar.
If you start taking sugar free coffee, initially you might not like it, but with the passage of time we will develop your taste and will start enjoying coffee without sugar.
Once you are used to sugar free coffee then you may not like coffee with sugar.