1

1.1
1.1.1

Test Description
Platform
shiva

Architecure x86 64 Processor x86 64 Operating system Linux 3.2.0-41-generic (#66-Ubuntu SMP Thu Apr 25 03:27:11 UTC 2013)

1.2

Parameters

Test id k lin p Propositional symbols (#, freq) (3, 1) Nominals (#, freq) (0, 0) State variables (#, freq) (0, 0) Relations 1 Max. (global) depth 2 Force depth False Diamonds (depth, freq) (2, 1) At (depth, freq) (0, 0) Downarrow (depth, freq) (0, 0) Inverse modality (depth, freq) (0, 0) Universal modality (depth, freq) (0, 0) Dierence modality (depth, freq) (0, 0) Clause size distribution [0, 0, 1] Probability of a modal operator 50 Probability of negating a modal operator 50 Batch size 1 Range of clauses [1. . . 21] Step 1 Timeout 10 seconds

1.3
1.3.1

Provers
htab1

Prover htab Version 1.5.4 1.3.2 funcTrans spass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, /home/mdiaz1/repo/ftranslation/Codigo/GridTest/scratchk lin p.oq8xac/translations/funcTrans spass/batch-21/k lin p.txt.21.intohylo0] 1.3.3 optimised spass

Prover spass Version 3.7

Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, /home/mdiaz1/repo/ftranslation/Codigo/GridTest/scratchk lin p.oq8xac/translations/optimised spass/batch-21/k lin p.txt.21.intohylo0] 1.3.4 withoutSorts spass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, /home/mdiaz1/repo/ftranslation/Codigo/GridTest/scratchk lin p.oq8xac/translations/withoutSorts spass/batch-21/k lin p.txt.21.intohylo0] 1.3.5 withoutSortsNoPNF spass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, /home/mdiaz1/repo/ftranslation/Codigo/GridTest/scratchk lin p.oq8xac/translations/withoutSortsNoPNF spass/batch-21/k lin p.txt.21.intohylo0] 1.3.6 fun mspass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, -EMLTranslation=1, /home/mdiaz1/repo/ftranslation/Codigo/GridT k lin p.oq8xac/translations/fun mspass/batch-21/k lin p.txt.21.intohylo0] 1.3.7 opt mspass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, -EMLTranslation=2, /home/mdiaz1/repo/ftranslation/Codigo/GridT k lin p.oq8xac/translations/opt mspass/batch-21/k lin p.txt.21.intohylo0] 1.3.8 semi fun mspass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, -EMLTranslation=3, /home/mdiaz1/repo/ftranslation/Codigo/GridT k lin p.oq8xac/translations/semi fun mspass/batch-21/k lin p.txt.21.intohylo0] 1.3.9 pol fun mspass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, -EMLTranslation=1, -EMLFuncNary=1, /home/mdiaz1/repo/ftrans k lin p.oq8xac/translations/pol fun mspass/batch-21/k lin p.txt.21.intohylo0]

1.3.10

pol opt mspass

Prover spass Version 3.7 Conguration [/home/mdiaz1/repo/ftranslation/Codigo/GridTest/bin/SPASS, -Auto=1, -PProblem=0, -PGiven=0, -PStatistic=1, -TimeLimit=10, -EMLTranslation=2, -EMLFuncNary=1, /home/mdiaz1/repo/ftrans k lin p.oq8xac/translations/pol opt mspass/batch-21/k lin p.txt.21.intohylo0]

Satisability fraction
Sat/Unsat relation of htab1 with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of funcTrans_spass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of optimised_spass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of withoutSorts_spass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of withoutSortsNoPNF_spass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of fun_mspass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of opt_mspass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of semi_fun_mspass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of pol_fun_mspass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Sat/Unsat relation of pol_opt_mspass with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8

Satisfiability fraction

0.6

0.4

0.2

0 2 4 6 8 10 12 Number of clauses sat 14 unsat 16 18 timeout 20

Timings
usertime with V = 3, N = 0, R = 1, D = 2, L = [121] 101

Median execution time (s)

100

10-1 2 4 6 8 10 12 Number of clauses 14 16 18 20

htab1 funcTrans_spass optimised_spass withoutSorts_spass withoutSortsNoPNF_spass

fun_mspass opt_mspass semi_fun_mspass pol_fun_mspass pol_opt_mspass

realtime with V = 3, N = 0, R = 1, D = 2, L = [121] 101

Median execution time (s)

100

10-1 2 4 6 8 10 12 Number of clauses 14 16 18 20

htab1 funcTrans_spass optimised_spass withoutSorts_spass withoutSortsNoPNF_spass

fun_mspass opt_mspass semi_fun_mspass pol_fun_mspass pol_opt_mspass

2
2.1

Analysis of the provers responses

Inconsistent answers

None detected.

10

Unique responses
Test with V = 3, N = 0, R = 1, D = 2, L = [121] 1

0.8 Number of unique responses

0.6

0.4

0.2

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 Batch fun_mspass opt_mspass semi_fun_mspass pol_fun_mspass pol_opt_mspass

htab1 funcTrans_spass optimised_spass withoutSorts_spass withoutSortsNoPNF_spass

11