Comparing Humans and Algorithms in Feature Ranking: A Case-Study in the Medical Domain

MCML Authors

Jonas Hanselle

→ Group Eyke Hüllermeier
 Artificial Intelligence and Machine Learning

Eyke Hüllermeier

Prof. Dr.

Principal Investigator

Artificial Intelligence and Machine Learning

Abstract

The selection of useful, informative, and meaningful features is a key prerequisite for the successful application of machine learning in practice, especially in knowledge-intense domains like decision support. Here, the task of feature selection, or ranking features by importance, can, in principle, be solved automatically in a data-driven way but also supported by expert knowledge. Besides, one may of course, conceive a combined approach, in which a learning algorithm closely interacts with a human expert. In any case, finding an optimal approach requires a basic understanding of human capabilities in judging the importance of features compared to those of a learning algorithm. Hereto, we conducted a case study in the medical domain, comparing feature rankings based on human judgment to rankings automatically derived from data. The quality of a ranking is determined by the performance of a decision list processing features in the order specified by the ranking, more specifically by so-called probabilistic scoring systems.

inproceedings HKH+23

---

LWDA 2023

Conference on Lernen. Wissen. Daten. Analysen. Marburg, Germany, Oct 09-11, 2023.

---

Authors

J. Hanselle • J. Kornowicz • S. Heid • K. Thommes • E. Hüllermeier

---

Links

PDF

---

Research Area

 A3 | Computational Models