It is definitely based on perspective. Cults are to religion what terrorists are to politics.
A cult is a religious movement that mainstream religions don't agree with. Terrorists are a political movement that mainstream politics don't agree with.
In both cases, there are extremists.
In both cases, if you walk a mile in the other sides shoes, you might get a completely different perspective.