Evaluation of Advanced Multimodal Interfaces: Towards New Methodologies

8th or 9th June 2026 · @ AVI 2026

About the Workshop

As interfaces become increasingly advanced and multimodal, ranging from complex dashboards to XR applications, traditional evaluation methods and questionnaires are often inadequate for capturing the full spectrum of user experience. This workshop aims to bring together researchers and practitioners to discuss the development of new evaluation instruments and heuristics tailored to contemporary multimodal interfaces. The expected outcome is a modular questionnaire framework that supports rigorous and flexible assessment of user experience (including both qualitative and quantitative measures) across diverse interaction modalities.

This workshop is aimed at practitioners, PhD students, and senior researchers working with advanced visual interfaces and/or multimodal data representations. We think it is good if you have some previous experience of user centred evaluation, and an interest in working towards a toolbox of methods for evaluation of advanced visual and multimodal data representations.

With this workshop, we aim to foster deeper discussions and to initiate the work of collaboratively developing a modular questionnaire framework suitable for evaluating modern advanced visual interfaces.

List of Topics

Submit your evaluation experiences

There will not be a formal submission and reviewing process in relation to this worksohp, but we invite you to submit your experiences on evaluation. The main focus should be on experiences of current evaluation methodologies (questionnaires, heuristics, etc), but of course any experience such as what did go well, what did not go as planned, was the evaluation outcome easy to interpret, did the evaluation method used answer the research questions asked, and so on... is of great interest.

These submissions will be reviewed by the organizers and selected based on their relevance to the workshop. Selected contributions will be presented orally by the authors (about 5 minutes) during the workshop to inspire group discussions and collaborative activities. Information about this will be communicated in advance of the conference, at 1 of June.

Write a short description of your experiences, not more than 400-500 words, and submit this as a pdf-file to niklas.ronnberg@liu.se, at latest Friday 22 of May.

Important Dates

29th March 2026
Deadline for submission of evaluation experiences (PDF, max 400–500 words)
10th April 2026
Notification to selected contributors and information about presentations
8th or 9th June 2026
Workshop held at AVI 2026, Venice, Italy

Organizers

Camilla Forsell is Associate Professor in Evaluation Methodology and Visualization at the Department of Science and Technology, Linköping University, in Sweden.
Mail: camilla.forsell@liu.se

Niklas Rönnberg is Senior Associate Professor in Sound Technology at the Department of Science and Technology, Linköping University, Sweden.
Mail: niklas.ronnberg@liu.se

Workshop Format

Full-day, 6-7 hours, workshop.

We encourage participants to attend the entire workshop, as the collaborative discussions and group activities build on each other and are essential for achieving the intended outcomes. We are, however, flexible and can adjust the final duration in coordination with the conference organizers to ensure the best possible workshop experience.

The workshop will combine short presentations, hands-on sessions, and group discussions to actively engage attendees. Each session is approximately 30 minutes, adjustable depending on number of submissions and discussion flow, allowing flexibility for breaks and adjustments.

  1. Welcome and introductions: Brief introductions of all attendees.
  2. User centred evaluation: Overview of current methods and challenges.
  3. Presentation of heuristics and questionnaires: Review of existing evaluation instruments.
  4. Group work 1: Discussion and analysis of user evaluation practices and existing questionnaires.
  5. Reporting and discussion 1: Groups share insights, followed by general discussion.
  6. Individual or group activity (to be decided together with the attendees): Ideation through affinity diagrams: The attendees sketch and structure key ideas using affinity diagramming to identify gaps and patterns that will guide the subsequent group work.
  7. Group work 2: Collaborative creation of new heuristics, questions, and statements to address identified gaps.
  8. Reporting and discussion 2: Groups present their results, followed by plenary discussion.
  9. Formation of new questionnaire: Consolidation of ideas into a modular questionnaire.
  10. Planning next steps: Discussion of validation approaches for the new questionnaire (of the included heuristics, questions, and statements) and potential future publications. Reflect on the proposed questionnaire modules, outlining plans for confirmatory factor analysis and other validation procedures to ensure reliability, construct validity, and applicability across multimodal interface contexts.

Resources

Here follows some existing questionnaires and resources that are, at least to some extent, relevant for the workshop, and for user centered evaluation in general: