difficult Domains

• FLD
  • 281 unbiased problems, 90 easy, 38 difficult, 153 unsolved
  • Vampire (0.92) is way out front
• GEO (CNF)
  • 238 unbiased problems, 61 easy, 95 difficult, 82 unsolved
  • Top systems are Vampire (0.92), E (0.87), and Gandalf (0.85)
• GEO (FOF)
  • 73 unbiased problems, 11 easy, 10 difficult, 52 unsolved
  • Top systems are Vampire (0.90) and SPASS (0.70)
  • Both convert to CNF and refute
• GRP
  • 320 unbiased problems, 190 easy, 115 difficult, 15 unsolved
  • E (0.91) is way out front
• LAT
  • 44 unbiased problems, 28 easy, 9 difficult, 7 unsolved
  • E (1.00) solved all difficult problems
• NUM
  • 305 unbiased problems, 30 easy, 20 difficult, 255 unsolved
  • Vampire (0.75) is way out front
  • This domain is a challenge!
• RNG
  • 96 unbiased problems, 35 easy, 28 difficult, 31 unsolved
  • Leaders are E (0.79), Otter (0.71), and Vampire (0.68)
• SET (CNF)
  • 691 unbiased problems, 106 easy, 170 difficult, 415 unsolved
  • Leaders are Vampire (0.88), Gandalf (0.74), E (0.73)
• SET (FOF)
  • 321 unbiased problems, 57 easy, 239 difficult, 25 unsolved
  • Leaders are MUSCADET (0.67), Vampire (0.51)
  • MUSCADET uses natural deduction