Evolutionary k-means for distributed data sets

M. C. Naldi*, R. J.G.B. Campello

*Kontaktforfatter

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Abstract

One of the challenges for clustering resides in dealing with data distributed in separated repositories, because most clustering techniques require the data to be centralized. One of them, k-means, has been elected as one of the most influential data mining algorithms for being simple, scalable and easily modifiable to a variety of contexts and application domains. Although distributed versions of k-means have been proposed, the algorithm is still sensitive to the selection of the initial cluster prototypes and requires the number of clusters to be specified in advance. In this paper, we propose the use of evolutionary algorithms to overcome the k-means limitations and, at the same time, to deal with distributed data. Two different distribution approaches are adopted: the first obtains a final model identical to the centralized version of the clustering algorithm; the second generates and selects clusters for each distributed data subset and combines them afterwards. The algorithms are compared experimentally from two perspectives: the theoretical one, through asymptotic complexity analyses; and the experimental one, through a comparative evaluation of results obtained from a collection of experiments and statistical tests. The obtained results indicate which variant is more adequate for each application scenario.

OriginalsprogEngelsk
TidsskriftNeurocomputing
Vol/bind127
Sider (fra-til)30-42
ISSN0925-2312
DOI
StatusUdgivet - 15. mar. 2014
Udgivet eksterntJa

Bibliografisk note

Funding Information:
The authors acknowledge the Brazilian Research Agencies CNPq, FAPESP and FAPEMIG for financial support.

Fingeraftryk

Dyk ned i forskningsemnerne om 'Evolutionary k-means for distributed data sets'. Sammen danner de et unikt fingeraftryk.

Citationsformater