Mind your Language (Model): Fact-Checking LLMs and their Role in NLP Research and Practice

AS Luccioni, A Rogers - arXiv preprint arXiv:2308.07120, 2023 - arxiv.org
arXiv preprint arXiv:2308.07120, 2023arxiv.org
Much of the recent discourse within the NLP research community has been centered around
Large Language Models (LLMs), their functionality and potential--yet not only do we not
have a working definition of LLMs, but much of this discourse relies on claims and
assumptions that are worth re-examining. This position paper contributes a definition of
LLMs, explicates some of the assumptions made regarding their functionality, and outlines
the existing evidence for and against them. We conclude with suggestions for research …
Much of the recent discourse within the NLP research community has been centered around Large Language Models (LLMs), their functionality and potential -- yet not only do we not have a working definition of LLMs, but much of this discourse relies on claims and assumptions that are worth re-examining. This position paper contributes a definition of LLMs, explicates some of the assumptions made regarding their functionality, and outlines the existing evidence for and against them. We conclude with suggestions for research directions and their framing in future work.
arxiv.org