Automatic Labeling of Problem-Solving Dialogues for Computational Microgenetic Learning Analytics

Yuanliang Meng Anna Rumshisky Florence Sullivan Kevin Keith

This study presents a recurrent neural network model to automate the analysis of students’ computational thinking in problem-solving dialogue. We have collected and annotated dialogue transcripts from middle school students solving a robotics challenge, and each dialogue turn is assigned a code.

We use sentence embeddings and speaker identities as features, and experiment with linear chain CRFs and RNNs with a CRF layer (LSTM-CRF). Both the linear chain CRF model and the LSTM-CRF model outperform the naive baselines by a large margin, and LSTM-CRF has an edge between the two. To our knowledge, this is the first study on dialogue segment annotation using neural network models. This study is also a stepping-stone to automating the microgenetic analysis of cognitive interactions between students.

Publications

Y. Meng A. Rumshisky F. Sullivan K. Keith Automatic Labeling of Problem-Solving Dialogues for Computational Microgenetic Learning Analytics. Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC). 2018

@inproceedings{meng2018automatic, title={Automatic Labeling of Problem-Solving Dialogues for Computational Microgenetic Learning Analytics.}, author={Meng, Yuanliang and Rumshisky, Anna and Sullivan, Florence}, booktitle={LREC}, year={2018} }