average normalized score | |
---|---|
fuzzer | |
sydr_aflplusplus | 99.84 |
fuzzolic_aflplusplus_z3 | 99.81 |
average rank | |
---|---|
fuzzer | |
sydr_aflplusplus | 1.4 |
fuzzolic_aflplusplus_z3 | 1.6 |
Note: The relative coverage summary table shows the median
relative performance of each fuzzer to the experiment maximum. Thus the
highest relative performance may not be 100%.
trial_relative_coverage = trial_coverage / experiment_max_coverage
sydr_aflplusplus | fuzzolic_aflplusplus_z3 | |
---|---|---|
FuzzerMedian | 99.03 | 98.92 |
FuzzerMean | 93.73 | 93.68 |
libxml2-v2.9.2 | 93.30 | 92.54 |
mbedtls_fuzz_dtlsclient | 77.99 | 78.52 |
re2-2014-12-09 | 99.26 | 99.38 |
vorbis-2017-12-11 | 99.10 | 99.06 |
zlib_zlib_uncompress_fuzzer | 99.03 | 98.92 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 8355.8 | 292.151331 | 7882.0 | 8160.5 | 8538.5 | 8581.75 | 8601.0 |
fuzzolic_aflplusplus_z3 | 82800 | 10.0 | 8457.9 | 370.700973 | 7884.0 | 8185.0 | 8469.0 | 8651.75 | 9152.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
fuzzolic_aflplusplus_z3 | 82800 | 10.0 | 2557.1 | 16.216932 | 2532.0 | 2546.0 | 2557.5 | 2567.00 | 2586.0 |
sydr_aflplusplus | 82800 | 10.0 | 2603.9 | 230.716974 | 2474.0 | 2530.5 | 2540.0 | 2549.75 | 3257.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
fuzzolic_aflplusplus_z3 | 82800 | 10.0 | 2551.7 | 7.273239 | 2543.0 | 2547.0 | 2551.0 | 2552.5 | 2567.0 |
sydr_aflplusplus | 82800 | 10.0 | 2549.0 | 8.273116 | 2539.0 | 2543.5 | 2548.0 | 2551.5 | 2564.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 1261.3 | 5.034327 | 1256.0 | 1257.25 | 1260.5 | 1262.75 | 1272.0 |
fuzzolic_aflplusplus_z3 | 82800 | 10.0 | 1260.7 | 3.020302 | 1257.0 | 1259.25 | 1260.0 | 1260.75 | 1266.0 |
count | mean | std | min | 25% | median | 75% | max | ||
---|---|---|---|---|---|---|---|---|---|
fuzzer | time | ||||||||
sydr_aflplusplus | 82800 | 10.0 | 460.0 | 2.708013 | 457.0 | 457.25 | 460.5 | 461.75 | 465.0 |
fuzzolic_aflplusplus_z3 | 82800 | 10.0 | 460.2 | 2.394438 | 456.0 | 459.25 | 460.0 | 462.00 | 463.0 |
# Check out the right commit.
git checkout 8c45eab091f06a293801b2c7be036b481ed4ef4d
# Download the internal config file.
curl https://storage.googleapis.com//data/fuzzbench/experiment-data/fin-fuzzolic-p2-11/input/config/experiment.yaml > /tmp/experiment-config.yaml
make install-dependencies
# Launch the experiment using paramters from the internal config file.
PYTHONPATH=. python experiment/reproduce_experiment.py -c /tmp/experiment-config.yaml -e <new_experiment_name>