Reporting guidelines for large language models in human-robot interaction

Abstract

The comparatively recent advent of Large Language Models (LLMs) has resulted in a wide array of new capabilities and components relevant to Human-Robot Interaction (HRI) researchers. LLMs are being applied to vision, manipulation, planning, reasoning, learning, and HRI problems, frequently as "Scarecrows," in which LLMs serve as black-box modules integrated into robot architectures for the purpose of quickly enabling full-pipeline solutions. However, despite this explosion of applications, general questions remain about the best ways to incorporate LLMs into robot architectures, appropriate safety and guardrail considerations, and, critically, how HRI research that depends on LLMs should be conducted and reported. In this article, we explore the question of reporting guidelines for HRI researchers who utilize Scarecrows in robot architectures. We identify five key stakeholder groups in the HRI research process, discuss what information each group needs from HRI researchers, and identify appropriate mechanisms for conveying that information from HRI researchers to stakeholders either directly or indirectly. We end with a set of suggested guidelines as to what information should be included when researchers disseminate information about HRI research that uses LLMs.

More information

Identifiers

ORCID for Eike Schneiders: orcid.org/0000-0002-8372-1684

Catalogue record

Export record