It depends on the conspiracy "believed" by the individual. Is it a derogatory term? Perhaps.
Should it be? I don't know.
Many conspiracy theories are silly (there are a lot of paranoid people in the world), however as you have said, certainly not all.
Jet beams can't steel melt fuel, after all.
Meh.