Experimental Comparison of Open Source Discrete-Event Simulation Frameworks

Oskar Skak Kristiansen; Ulrik Sandberg; Casper Hansen; Morten Skovgaard Jensen; Jonas Friederich; Sanja Lazarova-Molnar

doi:10.1007/978-3-030-97124-3_24

Experimental Comparison of Open Source Discrete-Event Simulation Frameworks

Oskar Skak Kristiansen, Ulrik Sandberg, Casper Hansen, Morten Skovgaard Jensen, Jonas Friederich^*, Sanja Lazarova-Molnar

^*Corresponding author for this work

University of Southern Denmark

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

66 Downloads (Pure)

Abstract

Simulation is a growing and very relevant field today. With many application domains and increasing computational power, simulations are solving an increasing number of real-world problems in a safe and efficient manner. The aim of this study is to make an experimental comparison among popular open-source discrete-event simulation frameworks, selected through a thorough survey. The experimental comparison considers numerous parameters, the most important of which were studied via an operational experiment of performance, as well as a survey of surface level characteristics and usability. We initially surveyed 50 frameworks for high-level parameters relating to corresponding implementations, filtered by the generality of domain, license, popularity, etc. As a result, we shortlisted five frameworks, which we then performance-tested in an operational experiment. We discovered significant performance differences under the given loads. We also completed a usability survey to provide a holistic impression of the frameworks, further identifying key differences.

Original language	English
Title of host publication	Simulation Tools and Techniques : 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings
Editors	Dingde Jiang, Houbing Song
Publisher	Springer
Publication date	2022
Pages	315-330
ISBN (Print)	9783030971236
DOIs	https://doi.org/10.1007/978-3-030-97124-3_24
Publication status	Published - 2022
Event	13th EAI International Conference on Simulation Tools and Techniques, SIMUtools 2021 - Virtual, Online Duration: 5. Nov 2021 → 6. Nov 2021

Conference

Conference	13th EAI International Conference on Simulation Tools and Techniques, SIMUtools 2021
City	Virtual, Online
Period	05/11/2021 → 06/11/2021

Series	Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume	424 LNICST
ISSN	1867-8211

Keywords

Discrete-event simulation
Open source
Performance comparison

Documents & Links

10.1007/978-3-030-97124-3_24

Open access VersionAccepted manuscript, 351 KB

1 Ph.D. thesis

Data-Driven Assessment of Reliability for Cyber-Physical Production Systems
Friederich, J., 12. Oct 2023, Syddansk Universitet. Det Tekniske Fakultet. 128 p.
Research output: Thesis › Ph.D. thesis

Open Access
File
50 Downloads (Pure)

Cite this

Kristiansen, O. S., Sandberg, U., Hansen, C., Jensen, M. S., Friederich, J., & Lazarova-Molnar, S. (2022). Experimental Comparison of Open Source Discrete-Event Simulation Frameworks. In D. Jiang, & H. Song (Eds.), Simulation Tools and Techniques: 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings (pp. 315-330). Springer. https://doi.org/10.1007/978-3-030-97124-3_24

Kristiansen, Oskar Skak ; Sandberg, Ulrik ; Hansen, Casper et al. / Experimental Comparison of Open Source Discrete-Event Simulation Frameworks. Simulation Tools and Techniques: 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings. editor / Dingde Jiang ; Houbing Song. Springer, 2022. pp. 315-330 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Vol. 424 LNICST).

@inproceedings{09ad8feae34d4c479a5c0a9e4a57d93b,

title = "Experimental Comparison of Open Source Discrete-Event Simulation Frameworks",

abstract = "Simulation is a growing and very relevant field today. With many application domains and increasing computational power, simulations are solving an increasing number of real-world problems in a safe and efficient manner. The aim of this study is to make an experimental comparison among popular open-source discrete-event simulation frameworks, selected through a thorough survey. The experimental comparison considers numerous parameters, the most important of which were studied via an operational experiment of performance, as well as a survey of surface level characteristics and usability. We initially surveyed 50 frameworks for high-level parameters relating to corresponding implementations, filtered by the generality of domain, license, popularity, etc. As a result, we shortlisted five frameworks, which we then performance-tested in an operational experiment. We discovered significant performance differences under the given loads. We also completed a usability survey to provide a holistic impression of the frameworks, further identifying key differences.",

keywords = "Discrete-event simulation, Open source, Performance comparison",

author = "Kristiansen, {Oskar Skak} and Ulrik Sandberg and Casper Hansen and Jensen, {Morten Skovgaard} and Jonas Friederich and Sanja Lazarova-Molnar",

note = "Publisher Copyright: {\textcopyright} 2022, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.; 13th EAI International Conference on Simulation Tools and Techniques, SIMUtools 2021 ; Conference date: 05-11-2021 Through 06-11-2021",

year = "2022",

doi = "10.1007/978-3-030-97124-3_24",

language = "English",

isbn = "9783030971236",

series = "Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST",

publisher = "Springer",

pages = "315--330",

editor = "Dingde Jiang and Houbing Song",

booktitle = "Simulation Tools and Techniques",

address = "Germany",

}

Kristiansen, OS, Sandberg, U, Hansen, C, Jensen, MS, Friederich, J & Lazarova-Molnar, S 2022, Experimental Comparison of Open Source Discrete-Event Simulation Frameworks. in D Jiang & H Song (eds), Simulation Tools and Techniques: 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings. Springer, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, vol. 424 LNICST, pp. 315-330, 13th EAI International Conference on Simulation Tools and Techniques, SIMUtools 2021, Virtual, Online, 05/11/2021. https://doi.org/10.1007/978-3-030-97124-3_24

Experimental Comparison of Open Source Discrete-Event Simulation Frameworks. / Kristiansen, Oskar Skak; Sandberg, Ulrik; Hansen, Casper et al.
Simulation Tools and Techniques: 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings. ed. / Dingde Jiang; Houbing Song. Springer, 2022. p. 315-330 (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Vol. 424 LNICST).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - Experimental Comparison of Open Source Discrete-Event Simulation Frameworks

AU - Kristiansen, Oskar Skak

AU - Sandberg, Ulrik

AU - Hansen, Casper

AU - Jensen, Morten Skovgaard

AU - Friederich, Jonas

AU - Lazarova-Molnar, Sanja

PY - 2022

Y1 - 2022

N2 - Simulation is a growing and very relevant field today. With many application domains and increasing computational power, simulations are solving an increasing number of real-world problems in a safe and efficient manner. The aim of this study is to make an experimental comparison among popular open-source discrete-event simulation frameworks, selected through a thorough survey. The experimental comparison considers numerous parameters, the most important of which were studied via an operational experiment of performance, as well as a survey of surface level characteristics and usability. We initially surveyed 50 frameworks for high-level parameters relating to corresponding implementations, filtered by the generality of domain, license, popularity, etc. As a result, we shortlisted five frameworks, which we then performance-tested in an operational experiment. We discovered significant performance differences under the given loads. We also completed a usability survey to provide a holistic impression of the frameworks, further identifying key differences.

AB - Simulation is a growing and very relevant field today. With many application domains and increasing computational power, simulations are solving an increasing number of real-world problems in a safe and efficient manner. The aim of this study is to make an experimental comparison among popular open-source discrete-event simulation frameworks, selected through a thorough survey. The experimental comparison considers numerous parameters, the most important of which were studied via an operational experiment of performance, as well as a survey of surface level characteristics and usability. We initially surveyed 50 frameworks for high-level parameters relating to corresponding implementations, filtered by the generality of domain, license, popularity, etc. As a result, we shortlisted five frameworks, which we then performance-tested in an operational experiment. We discovered significant performance differences under the given loads. We also completed a usability survey to provide a holistic impression of the frameworks, further identifying key differences.

KW - Discrete-event simulation

KW - Open source

KW - Performance comparison

U2 - 10.1007/978-3-030-97124-3_24

DO - 10.1007/978-3-030-97124-3_24

M3 - Article in proceedings

AN - SCOPUS:85128450927

SN - 9783030971236

T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST

SP - 315

EP - 330

BT - Simulation Tools and Techniques

A2 - Jiang, Dingde

A2 - Song, Houbing

PB - Springer

T2 - 13th EAI International Conference on Simulation Tools and Techniques, SIMUtools 2021

Y2 - 5 November 2021 through 6 November 2021

ER -

Kristiansen OS, Sandberg U, Hansen C, Jensen MS, Friederich J , Lazarova-Molnar S. Experimental Comparison of Open Source Discrete-Event Simulation Frameworks. In Jiang D, Song H, editors, Simulation Tools and Techniques: 13th EAI International Conference, SIMUtools 2021, Virtual Event, November 5-6, 2021, Proceedings. Springer. 2022. p. 315-330. (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Vol. 424 LNICST). doi: 10.1007/978-3-030-97124-3_24

Experimental Comparison of Open Source Discrete-Event Simulation Frameworks

Abstract

Conference

Keywords

Documents & Links

Fingerprint

Related Research Output

Data-Driven Assessment of Reliability for Cyber-Physical Production Systems

Cite this