Evaluation

Escaping the McNamara Fallacy: toward more impactful recommender systems research
Recommender systems are among today’s most successful application areas of artificial intelligence. However, in the recommender systems …
Dietmar Jannach, Christine Bauer
PDF Cite DOI Postprint JIF 2023: 2.5 CORE 2020: C
Escaping the McNamara Fallacy: toward more impactful recommender systems research
multimethods.info released

In our joint effort, advocating for multi-method evaluation, Eva Zangerle and me have set up a dedicated website: https://multimethods.info. On that page, we collect resources that help to apply multi-method evaluation in research and development.

9 December 2019 1 min read News
CHIIR 2020 Tutorial on Multi-Method Evaluation

I am happy to announce that I will give a tutorial with the title ‘‘Leveraging multiple methods to answer what you were looking for’’ at CHIIR 2020. Details will follow.

Christine Bauer (2020). Multi-method evaluation: leveraging multiple methods to answer what you were looking for. 2020 Conference on Human Information Interaction and Retrieval (CHIIR 2020).

PDF Cite Project DOI ACM Author-izer

23 October 2019 1 min read News
Leveraging multi-method evaluation for multi-stakeholder settings
In this paper, we focus on recommendation settings with multiple stakeholders with possibly varying goals and interests, and argue that …
Christine Bauer, Eva Zangerle
PDF Cite Project Project Project Poster
Leveraging multi-method evaluation for multi-stakeholder settings
Tutor Sessions at the RecSys Summer School 2019

I am happy to announce that Martijn C. Willemsen and I organize tutor sessions in scope of the RecSys Summer School 2019. The idea is that each participant can discuss the specific research goals and questions with senior researchers/teachers of the summer school and fellow students.

6 September 2019 1 min read News
Speaker at RecSys Summer School 2019

I am happy to be a speaker at the ACM Summer School on Recommender Systems taking place in Gothenburg, Sweden, just a week before the official RecSys 2019 in Copenhagen, Denmark.

1 July 2019 1 min read News
IUadaptME great success!

Yesterday’s IUadaptME workshop at UMAP 2018 was a great success! Thank you to all participants and my co-organizers. We had interesting discussions.

iuadaptme2018-1.jpg
iuadaptme2018-2.jpg

Ilknur Celik, Ilaria Torre, Frosina Koceva, Christine Bauer, Eva Zangerle, Bart Knijnenburg (2018). UMAP 2018 Intelligent User-Adapted Interfaces: Design and Multi-Modal Evaluation (IUadaptMe) Workshop Chairs' Welcome & Organization. 26th Conference on User Modeling, Adaptation and Personalization (UMAP 2018).

PDF Cite Project DOI ACM Author-izer CORE 2023: B GGS 2021: B

9 July 2018 1 min read News
Project
IUadaptMe 2018: Intelligent User-Adapted Interfaces: Design and Multi-Modal Evaluation
Workshop on Intelligent User-Adapted Interfaces: Design and Multi-Modal Evaluation (IUadaptMe 2018) at UMAP 2018.
Ilknur Celik, Ilaria Torre, Frosina Koceva, Christine Bauer, Eva Zangerle, Bart P. Knijnenburg
8 July 2018 Event
Project DOI
UMAP 2018 Intelligent User-Adapted Interfaces: Design and Multi-Modal Evaluation (IUadaptMe) Workshop Chairs' Welcome & Organization
Ilknur Celik, Ilaria Torre, Frosina Koceva, Christine Bauer, Eva Zangerle, Bart Knijnenburg
PDF Cite Project DOI ACM Author-izer CORE 2023: B GGS 2021: B
Multi-method evaluation
The comprehensive evaluation of the performance of a system is a complex endeavor: many facets need to be considered in configuring an adequate and effective evaluation setting. A single evaluation method or measure is not able to evaluate all relevant aspects in a complex setting where a multitude of stakeholders are involved. Employing a multi-method evaluation, where multiple evaluation methods or measures are combined and integrated, allows for getting a richer picture and prevents blind spots in the evaluation outcome.
Multi-method evaluation