A new article was released in which a former FBI counter intelligence agent detailed the current situation with regard to foreign propaganda being spread not by human agents but by bots. In other words, AI now can be used to produce fake stories, fake social media activity, do astroturfing, or to create and generate all sorts of confusion. This is something the FBI has a mandate to counter. The quote below details it:
The vast majority of counterintelligence cases I worked in the FBI involved a foreign intelligence service (FIS) conducting what we called “perception management campaigns.” Perception management, broadly defined, includes any activity that is designed to shape American opinion and policy in ways favorable to the FIS home country. Some perception management operations can involve aggressive tactics like infiltrating and spying on dissident groups (and even intimidating them), or trying to directly influence U.S. policy by targeting politicians under the guise of a legitimate lobbying group. But perception management operations also include more passive tactics like using media to spread government propaganda—and these are the most difficult for the FBI to investigate.
As I've said in other posts, public opinion is extremely important. Public opinion is how people know what behaviors to adopt to be perceived as "good" or as "bad" or to be perceived as ethical. Social media can give us a distorted idea of where public opinion really is and this could cause us to adopt behaviors which we think conform to public opinion but which do not. The FBI is looking at the fact that foreign nations have every incentive to want US citizens (potential voters) to think favorably of their nation. There are also some foreign nations who may have the incentive to want to make US citizens hate their own country, or think negatively about their own government. The power of artificial intelligence is being under-estimated here and I think these examples highlight the danger of leaving AI centralized into silos because then only a handful of companies might have the power to shape public opinion.
Still, the FBI has a legal duty to stop, or “neutralize,” foreign intelligence operations occurring on U.S. soil. In the case of propaganda operations, one effective way to do this while avoiding First Amendment land mines is to approach the FIS agent directly. There isn’t exactly a law that prevents an agent from being a “source” for a journalist. But there is a law called the Foreign Agent Registration Act (FARA) that requires any individual acting on behalf of foreign interests to register as a foreign agent with the State Department.Still, the FBI has a legal duty to stop, or “neutralize,” foreign intelligence operations occurring on U.S. soil. In the case of propaganda operations, one effective way to do this while avoiding First Amendment land mines is to approach the FIS agent directly. There isn’t exactly a law that prevents an agent from being a “source” for a journalist. But there is a law called the Foreign Agent Registration Act (FARA) that requires any individual acting on behalf of foreign interests to register as a foreign agent with the State Department.
But Congress could pass legislation that requires social media companies to cooperate with counterintelligence in the same ways they do with law enforcement. For example, the Communications Assistance for Law Enforcement Act (CALEA) requires telecommunications companies to design their digital networks in such a way that would permit wiretaps for criminal cases.
Of course we would have to question what would this cooperation mean? Counterintelligence at times focuses on foreign agents and foreign operations but what about situations where counterintelligence focuses it's attention on American citizens, some of whom might actually be innocent or merely guilty by association? I would think this is an area where there are dangers and creating a new law is risky.
Another option is to borrow from the counterterrorism toolbox and designate entities known to be acting on behalf of foreign intelligence—like Russia’s “troll farm,” the Internet Research Agency—as nonstate intelligence services, the same way we now designate some nonstate actors as foreign terrorist organizations.
What exactly is a non-state intelligence service and how could this become a problem for innocent people? Again while the FBI has a mandate to conduct their mission, at the same time how would it be distinguished which people are legitimately and willingly part of the troll army vs people being trolled and manipulated by disinformation to believe in the propaganda? I don't see how it would be so clear cut. AI also is likely going to automate a lot of the propaganda generation so the troll army might just be software.
Interesting post, but I have a few questions.
Maybe the FBI should be investigating the US intelligence agencies, as they are the real masters of using the domestic media to spread gov. propaganda.
How exactly does one determine what the "public opinion" is on any issue? Polls run by corrupt media organizations with extremely small sample sizes?
Isn't that what the US gov. has been doing via endless Hollywood propaganda for the last 50 years? The other governments are just now learning how to use the American playbook on perception "massaging," and it seems the U.S. politicos are not liking this turn of events.
How about the American propaganda machine?? I live in a small country and it's easy to watch the American propaganda spring into action whenever it is deemed necessary... mostly human agents, but no doubt they use bots as well.
Because they prefer to control others and feel themselves as masters of other counties
I think on one side you have american propaganda that has led many countries in disfavor of us due to nationalistic interests. But i mean duhhh, of course a country is going to do what's in their best interest, even if it means altering/filtering the perception of its citizens to keep us on the same page. (see russia/china) There are compromises in life that lead countries to do evil things for "their idea of a greater good." Whether that's right or wrong is another discussion this is just the reality. Nobody believes they're inherently evil.
On the other hand you have foreign propaganda meant to divide america and make us fight amongst each other. They cannot suppress the US economically/physically so much so this is the only fighting tactic they have.
What worries me isn't the propaganda so much but the growing perception in the US that we cannot have different viewpoints on things and that if you support Donald Trump or Obama then remove me from your FB friendslist and don't ever talk to me. A realist would see we need a spectrum of differing opinions so when we come together and compromise we get the best of both worlds.
Now we're at a point where the filtering, censoring, propaganda, and manipulation is getting to be too much for the average person to filter out. AI will make this exponentially harder for the average person to filter the bullshit.
Great post, followed, upvoted, and resteemed.
I tell you what! Half of my facebook friends are political bots.
Thanks for sharing this informative and educative post.i really learnt a lot about perception management campaigns.
Does that mean that the MainStreamNewsMedia is going to be shut down?
They've been nothing but Artificial Stupids for the last twenty years...
I am more worried about shareblue bots and correct the record bots than any "foreign bots".
It is is a changing world, but there is nothing new. Radio and newspaper brought in vast new powers to all sorts of people in the 1920. Germany was really effective at using media in WWII. Newspapers and the Evening network news had power in the 1980s. Now there is a point to monitoring and knowing what is going on, but propaganda is nothing new.
Until they use their own bots for a propaganda inside and outside US, their news it's literally "thrief steals from thrief "