The IoT Benchmarking consortium gathers academics from the low-power wireless networking community worldwide.
The community has put a lot of effort in building testbeds and tools to enable realistic experimental validation. Yet, a standardized evaluation methodology is still missing!
An ideal benchmark would
- Provide a set of tools and practices for performance evaluation
- Enable fair comparisons between new and existing approaches,
even when code is not openly available
- Enable repeatability of experimental results
Our vision is to raise the bar in the quality of experimental data, and provide researchers and engineers in both academia and industry with an objective view of the strengths and weaknesses among existing protocols.