Abstract
xpressive evaluation metrics are indispensable for informative experiments in all areas, and while several metrics are established in some areas, in others, such as feature selection, only indirect or otherwise limited evaluation metrics are found. In this paper, we propose a novel evaluation metric to address several problems of its predecessors and allow for flexible and reliable evaluation of feature selection algorithms. The proposed metric is a dynamic metric with two properties that can be used to evaluate both the performance and the stability of a feature selection algorithm. We conduct several empirical experiments to illustrate the use of the proposed metric in the successful evaluation of feature selection algorithms. We also provide a comparison and analysis to show the different aspects involved in the evaluation of the feature selection algorithms. The results indicate that the proposed metric is successful in carrying out the evaluation task for feature selection algorithms.
Original language | English |
---|---|
Title of host publication | Similarity Search and Applications : 17th International Conference, SISAP 2024, Providence, RI, USA, November 4–6, 2024, Proceedings |
Editors | Edgar Chávez, Benjamin Kimia, Jakub Lokoč, Marco Patella, Jan Sedmidubsky |
Publisher | Springer |
Publication date | 2025 |
Pages | 65–72 |
ISBN (Print) | 9783031758225, 9783031758232 |
DOIs | |
Publication status | Published - 2025 |
Event | 17th International Conference of Similarity Search and Applications - Providence, United States Duration: 4. Nov 2024 → 6. Nov 2024 |
Conference
Conference | 17th International Conference of Similarity Search and Applications |
---|---|
Country/Territory | United States |
City | Providence |
Period | 04/11/2024 → 06/11/2024 |
Keywords
- cs.LG
- Feature Selection
- Stability Analysis
- Performance Analysis
- Evaluation Metric