Sherol Chen, Carter Morgan, David Olsen, Ethan Manilow, Kenric Allado-McDowell, Mark J. Nelson, Qiuyi (Richard) Zhang, Senjuti Dutta, Kory Mathewson, Piotr W. Mirowski (2023). Towards an authorial leverage evaluation framework for expressive benefits of deep generative models in story writing. In Proceedings of the Workshop on Intelligent and Interactive Writing Assistants.
What are dimensions of human intent, and how do writing tools shape and augment these expressions? From papyrus to auto-complete, a major turning point was when Alan Turing famously asked, 'Can Machines Think?' If so, should we offload aspects of our thinking to machines, and what impact do they have in enabling the intentions we have? This paper adapts the Authorial Leverage framework, from the Intelligent Narrative Technologies literature, for evaluating recent generative model advancements. With increased widespread access to Large Language Models (LLMs), the evolution of our evaluative frameworks follow suit. To do this, we discuss previous expert studies of deep generative models for fiction writers and playwrights, and propose both author- and audience-focused directions for furthering our understanding of Authorial Leverage of LLMs, particularly in the domain of comedy writing.
Back to publications.