A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring

Jan Waller, Wilhelm Hasselbring

Code and Data Abstract

Application-level monitoring frameworks, such as Kieker, provide insight into the inner workings and the dynamic behavior of software systems. However, depending on the number of monitoring probes used, these frameworks may introduce significant runtime overhead. Consequently, planning the instrumentation of continuously operating software systems requires detailed knowledge of the performance impact of each monitoring probe. In this paper, we present our benchmark engineering approach to quantify the monitoring overhead caused by each probe under controlled and repeatable conditions. Our developed MooBench benchmark provides a basis for performance evaluations and comparisons of application-level monitoring frameworks. To evaluate its capabilities, we employ our benchmark to conduct a performance comparison of all available Kieker releases from version 0.91 to the current release 1.8.


Jan Waller, Wilhelm Hasselbring, et al. "A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring."     Retrieved 10/23/2018 from researchcompendia.org/compendia/2014.393/

Compendium Type: Working Papers
Primary Research Field: Computer and Information Sciences
Secondary Research Field: Mathematics
Content License: Public Domain Mark
Code License: MIT License

Page Owner


created 01/17/2014

modified 01/17/2014

blog comments powered by Disqus