Standard energy data competition procedure:  A comprehensive review with a case study of the ADRENALIN load disaggregation competition

Balázs András Tolnai; Zheng Grace Ma; Bo Nørregaard Jørgensen

doi:10.1007/978-3-031-48649-4_4

Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition

Balázs András Tolnai, Zheng Grace Ma^*, Bo Nørregaard Jørgensen

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

Crowdsourcing data science competitions has become popular as a cost-effective alternative to solving complex energy-related challenges. However, comprehensive reviews on hosting processes remain scarce. Therefore, this paper undertakes a detailed review of 33 existing data competitions and 12 hosting platforms, complemented by an in-depth case study of the ADRENALIN load disaggregation competition. The review identifies essential elements of competition procedure, including platform selection, timeline, datasets, and submission and evaluation mechanisms. Based on proposed 16 evaluation criteria, the similarities and differences between data competition hosting platforms can be categorized into platform scoring and popularity, platform features, community engagement, open-source platforms, region-specific platforms, platform-specific purposes, and multi-purpose platforms. The case study underscores strategic planning's critical role, particularly platform selection. The case study also shows the importance of defining competition scope which influences the whole com-petition content and procedure, especially the datasets.

Original language	English
Title of host publication	Energy Informatics. EI.A 2023 : Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I
Editors	Bo Nørregaard Jørgensen, Luiz Carlos Pereira da Silva, Zheng Ma
Publisher	Springer
Publication date	2023
Pages	60-75
ISBN (Print)	978-3-031-48648-7
ISBN (Electronic)	978-3-031-48649-4
DOIs	https://doi.org/10.1007/978-3-031-48649-4_4
Publication status	Published - 2023
Event	Energy Informatics.Academy Conference 2023 - Unicamp campus, São Paulo , Brazil Duration: 6. Dec 2023 → 8. Dec 2023 Conference number: 3 https://www.energyinformatics.academy/eia-2023-conference

Conference

Conference	Energy Informatics.Academy Conference 2023
Number	3
Location	Unicamp campus
Country/Territory	Brazil
City	São Paulo
Period	06/12/2023 → 08/12/2023
Internet address	https://www.energyinformatics.academy/eia-2023-conference

Series	Lecture Notes in Computer Science
Volume	14467
ISSN	0302-9743

Keywords

Data science competition
Data competitions
Competition Plat-forms
Competition timelines

Documents & Links

10.1007/978-3-031-48649-4_4

https://arxiv.org/abs/2401.08673Licence: CC BY-NC-ND

Embargoed Document

Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition
Accepted manuscript, 408 KB
Embargo ends: 02/12/2024

Cite this

Tolnai, B. A., Ma, Z. G., & Jørgensen, B. N. (2023). Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition. In B. Nørregaard Jørgensen, L. C. Pereira da Silva, & Z. Ma (Eds.), Energy Informatics. EI.A 2023: Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I (pp. 60-75). Springer. https://doi.org/10.1007/978-3-031-48649-4_4

Tolnai, Balázs András ; Ma, Zheng Grace ; Jørgensen, Bo Nørregaard. / Standard energy data competition procedure : A comprehensive review with a case study of the ADRENALIN load disaggregation competition. Energy Informatics. EI.A 2023: Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I. editor / Bo Nørregaard Jørgensen ; Luiz Carlos Pereira da Silva ; Zheng Ma. Springer, 2023. pp. 60-75 (Lecture Notes in Computer Science, Vol. 14467).

@inproceedings{fe46a1b3d18944c79820e6b9ceb10859,

title = "Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition",

abstract = "Crowdsourcing data science competitions has become popular as a cost-effective alternative to solving complex energy-related challenges. However, comprehensive reviews on hosting processes remain scarce. Therefore, this paper undertakes a detailed review of 33 existing data competitions and 12 hosting platforms, complemented by an in-depth case study of the ADRENALIN load disaggregation competition. The review identifies essential elements of competition procedure, including platform selection, timeline, datasets, and submission and evaluation mechanisms. Based on proposed 16 evaluation criteria, the similarities and differences between data competition hosting platforms can be categorized into platform scoring and popularity, platform features, community engagement, open-source platforms, region-specific platforms, platform-specific purposes, and multi-purpose platforms. The case study underscores strategic planning's critical role, particularly platform selection. The case study also shows the importance of defining competition scope which influences the whole com-petition content and procedure, especially the datasets.",

keywords = "Data science competition, Data competitions, Competition Plat-forms, Competition timelines",

author = "Tolnai, {Bal{\'a}zs Andr{\'a}s} and Ma, {Zheng Grace} and J{\o}rgensen, {Bo N{\o}rregaard}",

year = "2023",

doi = "10.1007/978-3-031-48649-4_4",

language = "English",

isbn = "978-3-031-48648-7",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "60--75",

editor = "{N{\o}rregaard J{\o}rgensen}, Bo and {Pereira da Silva}, {Luiz Carlos} and Zheng Ma",

booktitle = "Energy Informatics. EI.A 2023",

address = "Germany",

note = "Energy Informatics.Academy Conference 2023, EI.A 2023 ; Conference date: 06-12-2023 Through 08-12-2023",

url = "https://www.energyinformatics.academy/eia-2023-conference",

}

Tolnai, BA , Ma, ZG & Jørgensen, BN 2023, Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition. in B Nørregaard Jørgensen, LC Pereira da Silva & Z Ma (eds), Energy Informatics. EI.A 2023: Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I. Springer, Lecture Notes in Computer Science, vol. 14467, pp. 60-75, Energy Informatics.Academy Conference 2023, São Paulo , Brazil, 06/12/2023. https://doi.org/10.1007/978-3-031-48649-4_4

Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition. / Tolnai, Balázs András ; Ma, Zheng Grace ; Jørgensen, Bo Nørregaard.
Energy Informatics. EI.A 2023: Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I. ed. / Bo Nørregaard Jørgensen; Luiz Carlos Pereira da Silva; Zheng Ma. Springer, 2023. p. 60-75 (Lecture Notes in Computer Science, Vol. 14467).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - Standard energy data competition procedure

T2 - Energy Informatics.Academy Conference 2023

AU - Tolnai, Balázs András

AU - Ma, Zheng Grace

AU - Jørgensen, Bo Nørregaard

N1 - Conference code: 3

PY - 2023

Y1 - 2023

N2 - Crowdsourcing data science competitions has become popular as a cost-effective alternative to solving complex energy-related challenges. However, comprehensive reviews on hosting processes remain scarce. Therefore, this paper undertakes a detailed review of 33 existing data competitions and 12 hosting platforms, complemented by an in-depth case study of the ADRENALIN load disaggregation competition. The review identifies essential elements of competition procedure, including platform selection, timeline, datasets, and submission and evaluation mechanisms. Based on proposed 16 evaluation criteria, the similarities and differences between data competition hosting platforms can be categorized into platform scoring and popularity, platform features, community engagement, open-source platforms, region-specific platforms, platform-specific purposes, and multi-purpose platforms. The case study underscores strategic planning's critical role, particularly platform selection. The case study also shows the importance of defining competition scope which influences the whole com-petition content and procedure, especially the datasets.

AB - Crowdsourcing data science competitions has become popular as a cost-effective alternative to solving complex energy-related challenges. However, comprehensive reviews on hosting processes remain scarce. Therefore, this paper undertakes a detailed review of 33 existing data competitions and 12 hosting platforms, complemented by an in-depth case study of the ADRENALIN load disaggregation competition. The review identifies essential elements of competition procedure, including platform selection, timeline, datasets, and submission and evaluation mechanisms. Based on proposed 16 evaluation criteria, the similarities and differences between data competition hosting platforms can be categorized into platform scoring and popularity, platform features, community engagement, open-source platforms, region-specific platforms, platform-specific purposes, and multi-purpose platforms. The case study underscores strategic planning's critical role, particularly platform selection. The case study also shows the importance of defining competition scope which influences the whole com-petition content and procedure, especially the datasets.

KW - Data science competition

KW - Data competitions

KW - Competition Plat-forms

KW - Competition timelines

U2 - 10.1007/978-3-031-48649-4_4

DO - 10.1007/978-3-031-48649-4_4

M3 - Article in proceedings

SN - 978-3-031-48648-7

T3 - Lecture Notes in Computer Science

SP - 60

EP - 75

BT - Energy Informatics. EI.A 2023

A2 - Nørregaard Jørgensen, Bo

A2 - Pereira da Silva, Luiz Carlos

A2 - Ma, Zheng

PB - Springer

Y2 - 6 December 2023 through 8 December 2023

ER -

Tolnai BA , Ma ZG , Jørgensen BN. Standard energy data competition procedure: A comprehensive review with a case study of the ADRENALIN load disaggregation competition. In Nørregaard Jørgensen B, Pereira da Silva LC, Ma Z, editors, Energy Informatics. EI.A 2023: Third Energy Informatics Academy Conference, EI.A 2023, Campinas, Brazil, December 6–8, 2023, Proceedings, Part I. Springer. 2023. p. 60-75. (Lecture Notes in Computer Science, Vol. 14467). doi: 10.1007/978-3-031-48649-4_4