You need to have discernment. You should be able to spot it if the pastor is really a wolf in sheep's clothing. Such men typically want too much money and they spend it on themselves. They gather vulnerable women around them and they use them sexually. They might be able to preach the word but they don't live the word. They can talk it but there's nothing good about such men. The problem is that you usually need to be spiritually mature to spot those that aren't.
I agree with you @barncat. You are right