NLP for Requirements Engineering and Data-Driven GUI Prototyping

Research Problem

High-fidelity Graphical User Interface (GUI) prototyping is a well-established and suitable method for enabling fruitful discussions, clarification and refinement of requirements formulated by customers. GUI prototypes can help to reduce misunderstandings between customers and developers, which may occur due to the ambiguity comprised in informal Natural Language (NL). However, a disadvantage of employing high-fidelity GUI prototypes is their time-consuming and expensive development. Common GUI prototyping tools are based on combining individual GUI components or manually crafted templates. In this work, we present GUI2WiRe, a tool that enables users to retrieve GUI prototypes from a semiautomatically created large-scale GUI repository for mobile applications matching user requirements specified in Natural Language (NLR). We extract multiple text segments from the GUI hierarchy data and employ various Information Retrieval (IR) models and Automatic Query Expansion (AQE) techniques to achieve ad-hoc GUI retrieval from NLR. Retrieved GUI prototypes mined from applications can be inserted in the graphical editor of GUI2WiRe to rapidly create wireframes. GUI components are extracted automatically from the GUI screenshots and basic editing functionality is provided to the user. Finally, a preview of the application is created from the wireframe to allow interactive exploration of the current design. We evaluated the applied IR and AQE approaches for their effectiveness in terms of GUI retrieval relevance on a manually annotated collection of NLR and discuss our planned user studies.

Our GUI prototyping approach is available as a web-based tool.

Contact

Kristian Kolthoff

Kristian Kolthoff

Research Assistant
University of Mannheim
Institute for Enterprise Systems
L15, 1–6 – Room 415
68161 Mannheim
Prof. Dr. Simone Paolo Ponzetto

Prof. Dr. Simone Paolo Ponzetto

Chair of Information Systems III: Enterprise Data Analysis
University of Mannheim
School of Business Informatics and Mathematics
B 6, 26 – Room B 1.14
68159 Mannheim
Consultation hour(s):
Tue 1:30–2:30 p.m.
Prior Registration via email required
Dr. Christian Bartelt

Dr. Christian Bartelt

Managing Director Institute for Enterprise Systems
University of Mannheim
Institut für Enterprise Systems
L 15, 1–6 – Room 417
68161 Mannheim