average normalized score | |
---|---|
fuzzer | |
symqemu_aflplusplus | 99.95 |
sydr_aflplusplus | 99.67 |
average rank | |
---|---|
fuzzer | |
sydr_aflplusplus | 1.5 |
symqemu_aflplusplus | 1.5 |
Note: The relative coverage summary table shows the median
relative performance of each fuzzer to the experiment maximum. Thus the
highest relative performance may not be 100%.
trial_relative_coverage = trial_coverage / experiment_max_coverage
symqemu_aflplusplus | sydr_aflplusplus | |
---|---|---|
FuzzerMedian | 98.47 | 98.38 |
FuzzerMean | 97.85 | 97.59 |
libxml2-v2.9.2 | 93.99 | 92.90 |
mbedtls_fuzz_dtlsclient | 99.06 | 99.22 |
re2-2014-12-09 | 99.32 | 99.40 |
vorbis-2017-12-11 | 99.10 | 98.90 |
woff2-2016-05-06 | 97.79 | 97.87 |
zlib_zlib_uncompress_fuzzer | 97.87 | 97.23 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
symqemu_aflplusplus | 82800 | 10.0 | 8465.1 | 329.194455 | 8019.0 | 8203.25 | 8369.5 | 8802.75 | 8905.0 |
sydr_aflplusplus | 82800 | 10.0 | 8371.2 | 275.851329 | 7999.0 | 8167.75 | 8273.0 | 8575.50 | 8875.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 2539.8 | 15.991664 | 2500.0 | 2535.25 | 2544.0 | 2549.75 | 2555.0 |
symqemu_aflplusplus | 82800 | 10.0 | 2541.2 | 14.581571 | 2518.0 | 2535.25 | 2540.0 | 2549.00 | 2564.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 2551.5 | 7.849275 | 2537.0 | 2548.75 | 2551.5 | 2553.75 | 2566.0 |
symqemu_aflplusplus | 82800 | 10.0 | 2549.3 | 7.703535 | 2539.0 | 2544.25 | 2549.5 | 2551.75 | 2567.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
symqemu_aflplusplus | 82800 | 10.0 | 1262.0 | 4.666667 | 1257.0 | 1259.25 | 1260.5 | 1262.75 | 1272.0 |
sydr_aflplusplus | 82800 | 10.0 | 1259.2 | 5.349974 | 1254.0 | 1256.25 | 1258.0 | 1259.00 | 1271.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 1193.1 | 12.836147 | 1176.0 | 1181.75 | 1193.0 | 1204.0 | 1211.0 |
symqemu_aflplusplus | 82800 | 10.0 | 1193.2 | 12.470409 | 1174.0 | 1186.00 | 1192.0 | 1195.5 | 1219.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
symqemu_aflplusplus | 82800 | 10.0 | 458.9 | 5.626327 | 451.0 | 456.25 | 460.0 | 460.75 | 470.0 |
sydr_aflplusplus | 82800 | 10.0 | 457.7 | 1.888562 | 456.0 | 456.00 | 457.0 | 459.00 | 461.0 |
# Check out the right commit.
git checkout 8c45eab091f06a293801b2c7be036b481ed4ef4d
# Download the internal config file.
curl https://storage.googleapis.com//data/fuzzbench/experiment-data/fin-symqemu-p2-12/input/config/experiment.yaml > /tmp/experiment-config.yaml
make install-dependencies
# Launch the experiment using paramters from the internal config file.
PYTHONPATH=. python experiment/reproduce_experiment.py -c /tmp/experiment-config.yaml -e <new_experiment_name>