On: Aristo – A system that reads, learns, and reasons ...

[tom_mellior]

Ugh, that's bad.

http://aristo-demo.allenai.org/ask?q=Who%20is%20smarter%3F%2...

    Who is smarter?

    (A) men
    (B) women

    Aristo's Answer: (A) men

    Confidence: 89.99%
    as computed from these reasoners:

    Information Retrieval: 98.11% More Info

    Justification Sentence: Who are smarter: men or women?

Interesting that the "justification sentence" is just a repetition of the question.

[xaedes → tom_mellior]

Did they "fix" it?

This is what I get as now:

Aristo is not sure about this one...

Aristo's best guess: (B) women

Confidence: 10.38%

as computed from these reasoners: Topic Matching: 85.98% MORE INFO

Topic: flourish

[tom_mellior → xaedes]

Yes, they seem to have changed a bunch of the examples linked in this thread. Dunno if it's general changes or quick manual hacks they bolted on for specific cases.