Measurement
For the common part of the measurement method see the main
Technical details page.
Execution time is measured three times per test case with the program
/usr/bin/time in user mode: time -f "%U" <execution command>
All queries through the web provide runtime which is the median of
the three values. While execution time is measured, only the vital processes
are running on the machine.
This measurement was introduced in CSiBE version 2.0.0.
The measurement scripts are part of the downloadable
CSiBE.
|