Abstract
The performance of similarity measures for search, indexing, and data mining applications tends to degrade rapidly as the dimensionality of the data increases. The effects of the so-called 'curse of dimensionality' have been studied by researchers for data sets generated according to a single data distribution. In this paper, we study the effects of this phenomenon on different similarity measures for multiply-distributed data. In particular, we assess the performance of shared-neighbor similarity measures, which are secondary similarity measures based on the rankings of data objects induced by some primary distance measure. We find that rank-based similarity measures can result in more stable performance than their associated primary distance measures.
| Original language | English |
|---|---|
| Title of host publication | Scientific and Statistical Database Management - 22nd International Conference, SSDBM 2010, Proceedings |
| Editors | M. Gertz, B. Ludäscher |
| Publisher | Springer |
| Publication date | 3. Aug 2010 |
| Pages | 482-500 |
| ISBN (Print) | 978-3-642-13817-1 |
| ISBN (Electronic) | 978-3-642-13818-8 |
| DOIs | |
| Publication status | Published - 3. Aug 2010 |
| Externally published | Yes |
| Event | 22nd International Conference on Scientific and Statistical Database Management - Heidelberg, Germany Duration: 30. Jun 2010 → 2. Jul 2010 |
Conference
| Conference | 22nd International Conference on Scientific and Statistical Database Management |
|---|---|
| Country | Germany |
| City | Heidelberg |
| Period | 30/06/2010 → 02/07/2010 |
| Sponsor | Heidelberg University , Heidelberg Institute for Theoretical Studies (HITS) |
| Series | Lecture Notes in Computer Science |
|---|---|
| Volume | 6187 |
| ISSN | 0302-9743 |
Fingerprint
Cite this
}
Can shared-neighbor distances defeat the curse of dimensionality? / Houle, Michael E.; Kriegel, Hans Peter; Kröger, Peer; Schubert, Erich; Zimek, Arthur.
Scientific and Statistical Database Management - 22nd International Conference, SSDBM 2010, Proceedings. ed. / M. Gertz; B. Ludäscher. Springer, 2010. p. 482-500 (Lecture Notes in Computer Science, Vol. 6187).Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
TY - GEN
T1 - Can shared-neighbor distances defeat the curse of dimensionality?
AU - Houle, Michael E.
AU - Kriegel, Hans Peter
AU - Kröger, Peer
AU - Schubert, Erich
AU - Zimek, Arthur
PY - 2010/8/3
Y1 - 2010/8/3
N2 - The performance of similarity measures for search, indexing, and data mining applications tends to degrade rapidly as the dimensionality of the data increases. The effects of the so-called 'curse of dimensionality' have been studied by researchers for data sets generated according to a single data distribution. In this paper, we study the effects of this phenomenon on different similarity measures for multiply-distributed data. In particular, we assess the performance of shared-neighbor similarity measures, which are secondary similarity measures based on the rankings of data objects induced by some primary distance measure. We find that rank-based similarity measures can result in more stable performance than their associated primary distance measures.
AB - The performance of similarity measures for search, indexing, and data mining applications tends to degrade rapidly as the dimensionality of the data increases. The effects of the so-called 'curse of dimensionality' have been studied by researchers for data sets generated according to a single data distribution. In this paper, we study the effects of this phenomenon on different similarity measures for multiply-distributed data. In particular, we assess the performance of shared-neighbor similarity measures, which are secondary similarity measures based on the rankings of data objects induced by some primary distance measure. We find that rank-based similarity measures can result in more stable performance than their associated primary distance measures.
U2 - 10.1007/978-3-642-13818-8_34
DO - 10.1007/978-3-642-13818-8_34
M3 - Article in proceedings
AN - SCOPUS:77955045250
SN - 978-3-642-13817-1
T3 - Lecture Notes in Computer Science
SP - 482
EP - 500
BT - Scientific and Statistical Database Management - 22nd International Conference, SSDBM 2010, Proceedings
A2 - Gertz, M.
A2 - Ludäscher, B.
PB - Springer
ER -