Citation

Palmer A, Spirling A. Polit. Sci. 2024; ePub(ePub): ePub.

Copyright

(Copyright © 2024, Victoria University College, School of Political Science and Public Administration)

DOI

10.1080/00323187.2024.2335471

PMID

unavailable

Abstract

All politics relies on rhetorical appeals, and the ability to make arguments is considered perhaps uniquely human. But as recent times have seen successful large language model (LLM) applications to similar endeavours, we explore whether these approaches can out-compete humans in making appeals for/against various positions in US politics. We curate responses from crowdsourced workers and an LLM and place them in competition with one another. Human (crowd) judges make decisions about the relative strength of their (human v machine) efforts. We have several empirical 'possibility' results. First, LLMs can produce novel arguments that convince independent judges at least on a par with human efforts. Yet when informed about an orator's true identity, judges show a preference for human over LLM arguments. This may suggest voters view such models as potentially dangerous; we think politicians should be aware of related 'liar's dividend' concerns.

Language: en

Keywords

artificial intelligence; large language models; political debate; political methodology; rhetoric