Artificial Intelligence

I’m in Berlin this week for the annual conference of the excellent Weizenbaum-Institut, which opens with a keynote by the great Claes de Vreese, whose keynote asks whether citizens are ready for an AI democracy (it won’t surprise anyone that the short answer is No). Democracy and politics are rapidly transforming at the present moment; democracy is under threat from populist and far-right movements and various other actors, and there are widespread concerns about democratic backsliding around the world. In a reversal of trends in the 1990s and 200os, the number of true democracies in the world is shrinking …

The final speaker in this ACSPRI 2024 conference session is Aaron Willcox, presenting work with the Scanlon Research Institute to explore local government-level civic opportunities. For organisations, such opportunities include hosting events, offering memberships, involving individuals through volunteering, and taking action through advocacy and campaigns.

The project used the Australian Charities and Not-for-Profits Commission database, which contains valid information on the activities of some 30,000 charities around the country; it used Web scraping and human coding to identify civic activities, and utilised Large Language Models to directly code the data as well as to emulate the coding process of human …

The next speaker in this ACSPRI 2024 conference is Gia Bao Hoang, whose interest is in the use of LLMs for detecting efficient persuasion in online discourse. Such an understanding of effective persuasion could then be used for productive and prosocial purposes, or alternatively to identify problematic uses of persuasion by bad actors.

For this analysis, Bao is using data from the Change My View subreddit, where users clearly indicate whether the arguments made have actually changed their minds; and the Truth Wins dataset, which stems from human experiments and contains human-labelled data from persuasion and attention games. He used …

The next speaker in this ACSPRI 2024 conference session is Sair Buckle, whose interest is in the use of Large Language Models to detect bullying language in organisational contexts. Bullying is of course a major societal problem, including in companies, and presents a psychosocial hazard: there are several proposed approaches to address it, including surveys and interviews and manual linguistic classification (e.g. in federal parliament), which are subjective and manually intensive; pulse surveys and self-labelling questionnaires (e.g. in companies), which are subjective and limited in their data access; and there are technology-first approaches using LLMs and machine learning to detect …

The first session at the ACSPRI 2024 conference is on generative AI, and starts with Lachlan Watson. He is interested in the use of AI assistance to analyse public policy submissions, here in the context of Animal Welfare Victoria’s draft cat management strategy. Feedback could be in the form of written submissions, surveys, or both, and needed to be analysed using quantitative approaches given the substantial volume of submission.

The organisation chose Relevance AI as a tool for this – this is a low code AI solution not unlike ChatGPT, but data is hosted in a private environment and none …

And the final speaker in this final AoIR 2024 conference session is the excellent Fabio Giglietto, whose focus is on coding Italian news data using Large Language Models. This worked with some 85,000 news articles shared on Facebook during the 2018 and 2022 Italian elections, and first classified such URLs as political or non-political; it then produced and clustered text embeddings for these articles, and used GPT-4-turbo to classify the dominant topics in these clusters.

This required considerable prompt crafting, especially also to ensure that prompts remained within the LLM’s token limits. Key challenges here included the choice of LLM …

The next speaker in this final AoIR 2024 conference session is the great Hendrik Meyer, whose interest is in detecting stances in climate change coverage. This focusses especially on climate change debates in German news media, focussing on climate protests, discussions about speed limits, and discussions about heating and heat pump regulations.

Here stances might be better understood as evaluations related to a given issue or policy, and Large Language Models can be useful tools in assessing this, but this also requires considerable prompt crafting in order to generate consistent results. Computational costs for doing so (especially with complex prompts) …

The next speaker in this session at the AoIR 2024 conference is my QUT colleague Tariq Choucair, whose focus is especially on the use of LLMs in stance detection in news content. A stance is a public act by a social actors, achieved dialogically through communication, which evaluates objects, positions the self and other subjects, and aligns with other subjects within a sociocultural field.

Here, the focus is broadly on stances towards issues, persons, groups, and organisations. There are some tools for doing so, but they mainly focus on English-language content, are designed for specific types of data, and tend …