<\/p>\n\n\n\n
Exorcizing the ghost in the machine<\/strong><\/h2>\n\n\n\nIn this latest podcast in our \u2018Beyond Data\u2019 series, Tessa Jones<\/a> (Calligo\u2019s Chief Data Scientist) and Peter Matson<\/a> (Data Science Practice Lead) talk with Oxford University\u2019s Professor Philip Howard<\/a> about the threats posed to democracy by technology, specifically in the shape of Lie Machines.<\/p>\n\n\n\nFact or fiction? Microtargeting with lie machines<\/strong><\/h2>\n\n\n\nIn this age of social media, chatbots and AI it\u2019s never been easier for individuals to share their opinions. Instant communication to, and engagement with, a global audience is now commonplace, and it seems there\u2019s no need to let facts get in the way of a good angle. As Mark Twain, or maybe Winston Churchill, or most probably Jonathan Swift<\/a> famously said, \u201ca lie can travel halfway around the world whilst the truth is still putting on its shoes.\u201d <\/em>A great example in itself of the ease in which misunderstandings and misappropriations can become canon.<\/p>\n\n\n\nIn this vein, Professor Howard has spent years studying the mechanisms in which opinion, behavior and values can be manipulated and misdirected by lie machines:<\/p>\n\n\n\n
\u201cLie machines are large, complex mechanisms made up of people, organizations, and social media algorithms that generate theories to fit a few facts, while leaving you with a crazy<\/em><\/p>\n\n\n\nconclusion easily undermined by accurate information. By manipulating data and algorithms in the service of a political agenda, the best lie machines generate false explanations that<\/em><\/p>\n\n\n\nseem to fit the facts.\u201d<\/em><\/p>\n\n\n\nLie Machines:<\/em> How to Save Democracy from Troll Armies, Deceitful Robots, Junk News Operations, and Political Operatives<\/a><\/em><\/p>\n\n\n\nWe find lie machines in all types of countries and governing structures. They share common elements – political actors produce the lies, social media firms distribute them, and paid consultants market them. High profile examples of the effectiveness of the lie machine include the UK\u2019s Brexit campaign, and Trump\u2019s electioneering \u2013 in both cases patently untrue \u2018facts\u2019 and arguments were targeted at key voters by disinformation networks, troll farms<\/a> and lie machines. Algorithms direct individuals towards ever-more insular sources and extreme content:<\/p>\n\n\n\n \u201cA healthy, public-facing algorithm might occasionally introduce another credible source\u2026 we know the platforms play around with this stuff, especially during elections in the US\u201d<\/em><\/p>\n\n\n\nControlled by bad actors and forming a global ecosystem of lie development and propagation, these lie machines spread their tendrils across every social media platform, moving out from Facebook as new outlets develop.<\/p>\n\n\n\n
Computational propaganda<\/strong><\/h2>\n\n\n\nLie machines have evolved and finessed themselves as technology advances. Instead of stealing the photos, social media handles and biographies of real people, AI now generates new pictures and personas and thus evades technology platforms\u2019 troll-spotting software.<\/p>\n\n\n\n
Spreading propaganda far and wide, with a convincing voice, the lie machine<\/p>\n\n\n\n
\n- Has a profound effect on society, with a scale that is difficult to quantify<\/li>\n\n\n\n
- Is perfectly engineered to target human vulnerabilities, reducing critical thinking<\/li>\n\n\n\n
- Deliberately misrepresents and appeals to emotions and prejudices, using our cognitive biases to bypass rational thought and create echo chambers<\/li>\n\n\n\n
- Is vague and unknowable – what training data was used for large language models? (Professor Howard postulates that every Gmail sent over the last 25 years may have been scraped, along with content from junk news sites)<\/li>\n<\/ul>\n\n\n\n
Doing better – where does the onus sit? User or developer?<\/strong><\/h2>\n\n\n\nWhen it comes to developing processes to combat the lie machine, there\u2019s no one legislation or guiding principle that works. We must always consider the regional and cultural context of both data and users. Research can\u2019t necessarily be amalgamated or directly compared from different regions and countries – for example, we know that the placebo effect<\/a> is always greater in US medical studies<\/a>. To date, technology has not always built in cultural nuances in how people use words, with intent and meaning lost in translation \u2013 the majority of network takedown orders are for sites that are not in English.<\/p>\n\n\n\nWherever there is human input, there are behavioral differences that make it much more difficult to apply common rules:<\/p>\n\n\n\n
\u201cPeople who manage cookies are above average in terms of their knowledge of technology, so these people are generally more purposeful in terms of how they set up their news feeds and where they go for information\u201d<\/em><\/p>\n\n\n\nThe huge amount of disinformation spread around Covid and the resulting vaccination campaign demonstrates how potent the lie machine is. It doesn\u2019t need to convince people its argument is right, all that is required is to introduce enough doubt, to highlight there is a chance of harm. After all:<\/p>\n\n\n\n
\u201cIf everybody really understood probability, nobody would ever buy a lottery ticket\u201d<\/em><\/p>\n\n\n\nBalance the field \u2013 breaking the lie machines<\/strong><\/h2>\n\n\n\nProfessor Howard believes that whilst we are justified in our concern about the threats to democracy, the principles behind the lie machine can be harnessed for good – promoting topics that are in the public interest and generating democratic discourse:<\/p>\n\n\n\n
\u201cI am cynical, but not fatalistic\u201d<\/em><\/p>\n\n\n\nHe describes the steps we can take to break the lie machines:<\/p>\n\n\n\n
\n- Public policy oversight, founded in ongoing public data capture and analysis<\/li>\n\n\n\n
- Designing social media to highlight emerging consensus, rather than heated conflict \u2013 machine learning<\/a> can amplify common ground<\/li>\n\n\n\n
- Setting election guidelines to create more opportunities for civic expression<\/li>\n\n\n\n
- Giving journalists, civic groups and researchers access to all the public opinion data that is currently in the hands of the technology firms<\/li>\n\n\n\n
- Ensuring that the big data collected by technology platforms is added to public archives<\/li>\n<\/ul>\n\n\n\n
The answer is more social media, not less. But it needs to serve society much better.<\/p>\n\n\n\n
IPIE – bringing down the lie machine<\/strong><\/h2>\n\n\n\nProfessor Howard has recently launched<\/a> a new program, creating an independent scientific body to foster global cooperation in safeguarding the online information environment. The International Panel for the Information Environment<\/a> (IPIE) will assess the scope of the misinformation crisis, analyze its effects on our societies and the planet itself, and propose solutions. Featuring data scientists and engineers alongside neuroscientists and sociologists, IPIE hopes to be the beginning of a global effort to save our common information environment.<\/p>\n\n\n\nWatch the podcast for yourself below to hear more from Professor Philip Howard about the power of the lie machine, and crucially, to learn how we can use it for the collective good.<\/p>\n\n\n\n\n\t\n\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\t ![\"\"]()
<\/picture>\t\t\t\t
Fact or fiction? Microtargeting with lie machines<\/strong><\/h2>\n\n\n\nIn this age of social media, chatbots and AI it\u2019s never been easier for individuals to share their opinions. Instant communication to, and engagement with, a global audience is now commonplace, and it seems there\u2019s no need to let facts get in the way of a good angle. As Mark Twain, or maybe Winston Churchill, or most probably Jonathan Swift<\/a> famously said, \u201ca lie can travel halfway around the world whilst the truth is still putting on its shoes.\u201d <\/em>A great example in itself of the ease in which misunderstandings and misappropriations can become canon.<\/p>\n\n\n\nIn this vein, Professor Howard has spent years studying the mechanisms in which opinion, behavior and values can be manipulated and misdirected by lie machines:<\/p>\n\n\n\n
\u201cLie machines are large, complex mechanisms made up of people, organizations, and social media algorithms that generate theories to fit a few facts, while leaving you with a crazy<\/em><\/p>\n\n\n\nconclusion easily undermined by accurate information. By manipulating data and algorithms in the service of a political agenda, the best lie machines generate false explanations that<\/em><\/p>\n\n\n\nseem to fit the facts.\u201d<\/em><\/p>\n\n\n\nLie Machines:<\/em> How to Save Democracy from Troll Armies, Deceitful Robots, Junk News Operations, and Political Operatives<\/a><\/em><\/p>\n\n\n\nWe find lie machines in all types of countries and governing structures. They share common elements – political actors produce the lies, social media firms distribute them, and paid consultants market them. High profile examples of the effectiveness of the lie machine include the UK\u2019s Brexit campaign, and Trump\u2019s electioneering \u2013 in both cases patently untrue \u2018facts\u2019 and arguments were targeted at key voters by disinformation networks, troll farms<\/a> and lie machines. Algorithms direct individuals towards ever-more insular sources and extreme content:<\/p>\n\n\n\n \u201cA healthy, public-facing algorithm might occasionally introduce another credible source\u2026 we know the platforms play around with this stuff, especially during elections in the US\u201d<\/em><\/p>\n\n\n\nControlled by bad actors and forming a global ecosystem of lie development and propagation, these lie machines spread their tendrils across every social media platform, moving out from Facebook as new outlets develop.<\/p>\n\n\n\n
Computational propaganda<\/strong><\/h2>\n\n\n\nLie machines have evolved and finessed themselves as technology advances. Instead of stealing the photos, social media handles and biographies of real people, AI now generates new pictures and personas and thus evades technology platforms\u2019 troll-spotting software.<\/p>\n\n\n\n
Spreading propaganda far and wide, with a convincing voice, the lie machine<\/p>\n\n\n\n
\n- Has a profound effect on society, with a scale that is difficult to quantify<\/li>\n\n\n\n
- Is perfectly engineered to target human vulnerabilities, reducing critical thinking<\/li>\n\n\n\n
- Deliberately misrepresents and appeals to emotions and prejudices, using our cognitive biases to bypass rational thought and create echo chambers<\/li>\n\n\n\n
- Is vague and unknowable – what training data was used for large language models? (Professor Howard postulates that every Gmail sent over the last 25 years may have been scraped, along with content from junk news sites)<\/li>\n<\/ul>\n\n\n\n
Doing better – where does the onus sit? User or developer?<\/strong><\/h2>\n\n\n\nWhen it comes to developing processes to combat the lie machine, there\u2019s no one legislation or guiding principle that works. We must always consider the regional and cultural context of both data and users. Research can\u2019t necessarily be amalgamated or directly compared from different regions and countries – for example, we know that the placebo effect<\/a> is always greater in US medical studies<\/a>. To date, technology has not always built in cultural nuances in how people use words, with intent and meaning lost in translation \u2013 the majority of network takedown orders are for sites that are not in English.<\/p>\n\n\n\nWherever there is human input, there are behavioral differences that make it much more difficult to apply common rules:<\/p>\n\n\n\n
\u201cPeople who manage cookies are above average in terms of their knowledge of technology, so these people are generally more purposeful in terms of how they set up their news feeds and where they go for information\u201d<\/em><\/p>\n\n\n\nThe huge amount of disinformation spread around Covid and the resulting vaccination campaign demonstrates how potent the lie machine is. It doesn\u2019t need to convince people its argument is right, all that is required is to introduce enough doubt, to highlight there is a chance of harm. After all:<\/p>\n\n\n\n
\u201cIf everybody really understood probability, nobody would ever buy a lottery ticket\u201d<\/em><\/p>\n\n\n\nBalance the field \u2013 breaking the lie machines<\/strong><\/h2>\n\n\n\nProfessor Howard believes that whilst we are justified in our concern about the threats to democracy, the principles behind the lie machine can be harnessed for good – promoting topics that are in the public interest and generating democratic discourse:<\/p>\n\n\n\n
\u201cI am cynical, but not fatalistic\u201d<\/em><\/p>\n\n\n\nHe describes the steps we can take to break the lie machines:<\/p>\n\n\n\n
\n- Public policy oversight, founded in ongoing public data capture and analysis<\/li>\n\n\n\n
- Designing social media to highlight emerging consensus, rather than heated conflict \u2013 machine learning<\/a> can amplify common ground<\/li>\n\n\n\n
- Setting election guidelines to create more opportunities for civic expression<\/li>\n\n\n\n
- Giving journalists, civic groups and researchers access to all the public opinion data that is currently in the hands of the technology firms<\/li>\n\n\n\n
- Ensuring that the big data collected by technology platforms is added to public archives<\/li>\n<\/ul>\n\n\n\n
The answer is more social media, not less. But it needs to serve society much better.<\/p>\n\n\n\n
IPIE – bringing down the lie machine<\/strong><\/h2>\n\n\n\nProfessor Howard has recently launched<\/a> a new program, creating an independent scientific body to foster global cooperation in safeguarding the online information environment. The International Panel for the Information Environment<\/a> (IPIE) will assess the scope of the misinformation crisis, analyze its effects on our societies and the planet itself, and propose solutions. Featuring data scientists and engineers alongside neuroscientists and sociologists, IPIE hopes to be the beginning of a global effort to save our common information environment.<\/p>\n\n\n\nWatch the podcast for yourself below to hear more from Professor Philip Howard about the power of the lie machine, and crucially, to learn how we can use it for the collective good.<\/p>\n\n\n\n\n\t\n\t\t\n\t\t\t\t\t\t\n\t\t\t\t\t\t\n\t\t\t\n\t\t\t\n\t\t\t\t ![\"\"]()
<\/picture>\t\t\t\t
In this vein, Professor Howard has spent years studying the mechanisms in which opinion, behavior and values can be manipulated and misdirected by lie machines:<\/p>\n\n\n\n
\u201cLie machines are large, complex mechanisms made up of people, organizations, and social media algorithms that generate theories to fit a few facts, while leaving you with a crazy<\/em><\/p>\n\n\n\n conclusion easily undermined by accurate information. By manipulating data and algorithms in the service of a political agenda, the best lie machines generate false explanations that<\/em><\/p>\n\n\n\n seem to fit the facts.\u201d<\/em><\/p>\n\n\n\n Lie Machines:<\/em> How to Save Democracy from Troll Armies, Deceitful Robots, Junk News Operations, and Political Operatives<\/a><\/em><\/p>\n\n\n\n We find lie machines in all types of countries and governing structures. They share common elements – political actors produce the lies, social media firms distribute them, and paid consultants market them. High profile examples of the effectiveness of the lie machine include the UK\u2019s Brexit campaign, and Trump\u2019s electioneering \u2013 in both cases patently untrue \u2018facts\u2019 and arguments were targeted at key voters by disinformation networks, troll farms<\/a> and lie machines. Algorithms direct individuals towards ever-more insular sources and extreme content:<\/p>\n\n\n\n \u201cA healthy, public-facing algorithm might occasionally introduce another credible source\u2026 we know the platforms play around with this stuff, especially during elections in the US\u201d<\/em><\/p>\n\n\n\n Controlled by bad actors and forming a global ecosystem of lie development and propagation, these lie machines spread their tendrils across every social media platform, moving out from Facebook as new outlets develop.<\/p>\n\n\n\n Lie machines have evolved and finessed themselves as technology advances. Instead of stealing the photos, social media handles and biographies of real people, AI now generates new pictures and personas and thus evades technology platforms\u2019 troll-spotting software.<\/p>\n\n\n\n Spreading propaganda far and wide, with a convincing voice, the lie machine<\/p>\n\n\n\n When it comes to developing processes to combat the lie machine, there\u2019s no one legislation or guiding principle that works. We must always consider the regional and cultural context of both data and users. Research can\u2019t necessarily be amalgamated or directly compared from different regions and countries – for example, we know that the placebo effect<\/a> is always greater in US medical studies<\/a>. To date, technology has not always built in cultural nuances in how people use words, with intent and meaning lost in translation \u2013 the majority of network takedown orders are for sites that are not in English.<\/p>\n\n\n\n Wherever there is human input, there are behavioral differences that make it much more difficult to apply common rules:<\/p>\n\n\n\n \u201cPeople who manage cookies are above average in terms of their knowledge of technology, so these people are generally more purposeful in terms of how they set up their news feeds and where they go for information\u201d<\/em><\/p>\n\n\n\n The huge amount of disinformation spread around Covid and the resulting vaccination campaign demonstrates how potent the lie machine is. It doesn\u2019t need to convince people its argument is right, all that is required is to introduce enough doubt, to highlight there is a chance of harm. After all:<\/p>\n\n\n\n \u201cIf everybody really understood probability, nobody would ever buy a lottery ticket\u201d<\/em><\/p>\n\n\n\n Professor Howard believes that whilst we are justified in our concern about the threats to democracy, the principles behind the lie machine can be harnessed for good – promoting topics that are in the public interest and generating democratic discourse:<\/p>\n\n\n\n \u201cI am cynical, but not fatalistic\u201d<\/em><\/p>\n\n\n\n He describes the steps we can take to break the lie machines:<\/p>\n\n\n\n The answer is more social media, not less. But it needs to serve society much better.<\/p>\n\n\n\n Professor Howard has recently launched<\/a> a new program, creating an independent scientific body to foster global cooperation in safeguarding the online information environment. The International Panel for the Information Environment<\/a> (IPIE) will assess the scope of the misinformation crisis, analyze its effects on our societies and the planet itself, and propose solutions. Featuring data scientists and engineers alongside neuroscientists and sociologists, IPIE hopes to be the beginning of a global effort to save our common information environment.<\/p>\n\n\n\n Watch the podcast for yourself below to hear more from Professor Philip Howard about the power of the lie machine, and crucially, to learn how we can use it for the collective good.<\/p>\n\n\n\nComputational propaganda<\/strong><\/h2>\n\n\n\n
\n
Doing better – where does the onus sit? User or developer?<\/strong><\/h2>\n\n\n\n
Balance the field \u2013 breaking the lie machines<\/strong><\/h2>\n\n\n\n
\n
IPIE – bringing down the lie machine<\/strong><\/h2>\n\n\n\n
![\"\"](\"https:\/\/www.calligo.io\/wp-content\/uploads\/fly-images\/4157\/Beyond-Data-Podcast-Lie-Machines-intro-slide-1920x1080px-400x300-c.png\")
<\/picture>\t\t\t\t