jeanyoon.ch@oi ~ % cd /oi

Welcome to jeanyoon.ch/oi

Jeanyoon Choi (b.1999) is a Computational Artist researching in interconnectivity and complexity through Multi-Device Web Artworks.

You can learn more about my:

↑ ↓ select · enter open · or click / tap
artworks projects experiments research about texts contact

jeanyoon.ch@oi /oi % cat llm-gui-lui

LLM: GUI --> LUI

2024-09-24

Language models suggest a major change in human–computer interaction: a movement from the graphical user interface, GUI, towards the language user interface, LUI.

Early computing already relied on language, but communicating through its specialised commands was difficult. Graphical interfaces provided another channel between person and machine. Meanwhile, communication between people continued to rely heavily on language, including chats embedded within visual platforms.

With more capable language models, natural language can again become an effective means of operating a computer. In many situations, describing what I want may be more direct than navigating a prescribed arrangement of controls. I see a possible gradual transition towards LUI, rather than treating graphical layout as the permanent endpoint of interface design.

The move from mouse-driven interaction towards touch offers an analogy: a different input can make certain actions feel more immediate. Voice assistants such as Alexa and Siri already expressed an investment in language-based interaction, before the capabilities of recent models.

This could also change creative software. Node-based environments became popular partly because they reduced the need to write code. If generating and revising code through a language model becomes easier than arranging a node graph, that preference could reverse.

There is a productive irony in the sequence: written code, then graphical or node-based interfaces, then a return to producing code through language. The return would not be to the same conditions that made graphical tools attractive in the first place.

↑ ↓ select · enter open · or click / tap
Read original notes back to ../texts ../ back to oi