A new kind of question-answering dataset that combines commonsense, text-based, and unanswerable questions, balanced for different genres and reasoning types. Reasoning type annotation for 9 types of reasoning: temporal, causality, factoid, coreference, character properties, their belief states, subsequent entity states, event durations, and unanswerable. Genres: CC license fiction, Voice of America news, blogs, user stories from Quora 800 texts, 18 questions for each (~14K questions).
|1||29.7||30.4||30.8||30.8||32.1||29.2||26.7||24.2||17.9||45.4||matt.downey18||11 Feb 20 14:47 EST||PMI baseline UML Text Machine Lab|
After submission, please allow a few days for your results to show up in the leaderboard.