08/12/2020

DT-QDC: A Dataset for Question Comprehension in Online Test

Sijin Wu, Yujiu Yang, Nicholas Yung, Zhengchen Shen, Zeyang Lei

Keywords:

Abstract Paper Similar Papers

Abstract: With the transformation of education from the traditional classroom environment to online education and assessment, it is more and more important to accurately assess the difficulty of questions than ever. As teachers may not be able to follow the student’s performance and learning behavior closely, a well-defined method to measure the difficulty of questions to guide learning is necessary. In this paper, we explore the concept of question difficulty and provide our new Chinese DT-QDC dataset. This is currently the largest and only Chinese question dataset, and it also has enriched attributes and difficulty labels. Additional attributes such as keywords, chapter, and question type would allow models to understand questions more precisely. We proposed the MTMS-BERT and ORMS-BERT, which can improve the judgment of difficulty from different views. The proposed methods outperforms different baselines by 7.79% on F1-score and 15.92% on MAE, 28.26% on MSE on the new DT-QDC dataset, laying the foundation for the question difficulty comprehension task.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6218-dt-qdc-a-dataset-for-question-comprehension-in-online-test
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 4:11 
 0
 0
 0
 0
 9:17 
 0
 0
 0
 0
 12:08 
 0
 0
 0
 0
 6:59 
 0
 0
 0
 0
 10:02 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 15:29 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 10:45 
 0
 0
 0
 0
 8:51 
 0
 0
 0
 0
 9:34 
 0
 0
 0
 0
 15:18 
 0
 0
 0
 0
 13:12 
 0
 0
 0
 0
 13:08 
 0
 0
 0
 0
 9:19 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 12:43 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 10:36 
 0
 0
 0
 0
 2:00 
 0
 0
 0
 0
 10:29 
 0
 0
 0
 0
 10:54 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 11:34 
 0
 0
 0
 0
 11:01 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 7:05 
 0
 0
 0
 0
 7:04 
 0
 0
 0
 0
 12:53 
 0
 0
 0
 0
 11:51 
 0
 0
 0
 0
 16:18 
 0
 0
 0
 0
 10:07 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 5:00