edit Data Mining for Collaboration at the Tabletop

Data Mining for Collaboration at the Tabletop

Roberto Martinez, Kalina Yacef, Judy Kay
School of Information Technologies, University of Sydney

Contact Person

Roberto Martinez
roberto@it.usyd.edu.au

Photo of Data Mining for Collaboration at the Tabletop

Project Description

We identify a number of open issues that are currently present in the intersection of three fields: tabletops in education from a Computer Supported Collaborative Learning (CSCL) perspective, Educational Data Mining and analytics (EDM), and research on interactive tabletop applications from a Human-Computer Interaction perspective (HCI). The intersection of these fields raises a challenging question: How can interaction data be automatically exploited to inform teachers and enhance their awareness of student’s collaborative activity using interactive tabletops?

The main objective of this project is to provide a novel approach to design, implement and evaluate the conceptual and technological infrastructure that captures student’s activity at interactive tabletops and analyses these data through Interaction Data Analytics techniques to provide support to teachers by enhancing their awareness of student’s collaboration.

We perform this in three steps: the exploration of the feasibility of the approach, the construction of a novel solution and the execution of the conceptual proposal both under controlled conditions and in the wild. A total of eight datasets were analysed for the studies that are described in this thesis.

The contribution of this project that is most strongly associated with the real practice is the implementation of a solution for an authentic classroom using multiple interactive tabletops. This classroom environment offers a number of functionalities for the teacher to orchestrate the script of the classroom session and look at live-visualisations of the on-task progress of each small-group produced from the data captured by our enriched tabletop environments. This approach can help teachers decide which group to attend next. The analysis also includes the discovery of trends in students interactions that can make visible aspects of collaborative work that may not be easily seen without the use of such technology.

Our work has pioneered in a number of areas including the application of data mining techniques to study collaboration at the tabletop, a plug-in solution to add user-identification to a regular tabletop using a depth sensor and the first multi-tabletop classroom used to run authentic collaborative activities associated with the curricula.

Key Publications

R. Martinez-Maldonado, K. Yacef, Y. Dimitriadis, M. Edbauer, and J. Kay. MTClassroom and MTDashboard: supporting analysis of teacher attention in an orchestrated multi-tabletop classroom. In International Conference on Computer-Supported Collaborative Learning, CSCL 2013, pages 119-128, 2013. [View Details]

R. Martinez-Maldonado, K. Yacef, and J. Kay. Data mining in the classroom: Discovering groups’ strategies at a multi-tabletop environment. In International Conference on Educational Data mining, EDM 2013, pages 121-128, 2013. [View Details]

R. Martinez-Maldonado, K. Yacef, and J. Kay. An automatic approach for mining patterns of collaboration around an interactive tabletop. In International Conference on Artificial Intelligence in Education, AIED 2013, pages 101-110, 2013. [View Details]

A. Clayphan, R. Martinez-Maldonado, and J. Kay. Open learner models to support reflection on brainstorming at interactive tabletops. In International Conference on Artificial Intelligence in Education, AIED 2013, pages 683-686, 2013. [View Details]

A. Clayphan, R. Martinez-Maldonado, and J. Kay. Designing olms for reflection about group brainstorming at interactive tabletops. In 2nd Workshop on Intelligent Support for Learning in Groups at the 16th International Conference on Artificial Intelligent in Education, volume 3, pages 27-36, 2013. [View Details]

A. Kharrufa, R. Martinez-Maldonado, J. Kay, and P. Olivier. Extending tabletop application design to the classroom. In International Conference on Interactive Tabletops and Surfaces, ITS 2013, pages 115-124, 2013. [View Details]

R. Martinez-Maldonado, Y. Dimitriadis, A. Martinez-Mones, J. Kay, and K. Yacef. Capturing and analyzing verbal and physical collaborative learning interactions at an enriched interactive tabletop. International Journal on Computer-Supported Collaborative Learning, 8(4):455-485, 2013. [View Details]

R. Martinez-Maldonado, A. Clayphan, and J. Kay. Towards the integration of collaboration analytics and interactive surfaces. In Workshop on Collaboration meets Interactive Surfaces - held at International Conference on Interactive Tabletops and Surfaces (ITS 2013), page to appear, 2013. [View Details]

R. Martinez-Maldonado, Y. Dimitriadis, A. Clayphan, J. A. Muñoz-Cristóbal, J. Kay, L. P. Prieto, and M. J. Rodríguez-Triana. Integrating orchestration of ubiquitous and pervasive learning environments. In OzCHI, Australian HCI Conference, pages 189-192, 2013. [View Details]

R. Martinez-Maldonado, A. Clayphan, K. Yacef, J. Kay, and C. J. Ackad. Sensing, tracking and modelling with ignition - a framework for supporting classroom collaboration. In Educational Interfaces, Software, and Technology 2012: 3rd Workshop on UI Technologies and Educational Pedagogy, 2012. [View Details]

C. Ackad, A. Clayphan, R. Martinez, and J. Kay. Seamless and continuous user identification for interactive tabletops using personal device handshaking and body tracking. In CHI '12: Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems (Extended Abstracts), pages 1775-1780, New York, NY, USA, 2012. ACM. [View Details]

R. Martinez-Maldonado, J. Kay, K. Yacef, and B. Schwendimann. Unpacking traces of collaboration from multimodal data of collaborative concept mapping at a tabletop. In International Conference of the Learning Sciences: The Future of learning, ICLS 2012, pages 241-245, 2012. [View Details]

R. Martinez-Maldonado, K. Yacef, J. Kay, and B. Schwendimann. An interactive teacher’s dashboard for monitoring groups in a multi-tabletop learning environment. In Proceedings of Intelligent Tutoring Systems, ITS 2012, pages 482-492. Springer, 2012. [View Details]

R. Martinez-Maldonado, J. Kay, and K. Yacef. Analysing knowledge generation and acquisition from individual and face-to-face collaborative concept mapping. In A. J. Canas, J. D. Novak, and J. Vanhear, editors, Concept Maps: Theory, Methodology, Technology Proc. of the Fifth Int. Conference on Concept Mapping, pages 17-24, 2012. [View Details]

R. Martinez-Maldonado, Y. Dimitriadis, J. Kay, K. Yacef, , and M.-T. Edbauer. Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection. In Proceedings of Interactive Tabletops and Surfaces, ITS 2012, pages 119-128. ACM, 2012. [View Details]

R. Martinez, J. Kay, and K. Yacef. Visualisations for longitudinal participation, contribution and progress of a collaborative task at the tabletop. In International Conference on Computer Supported Collaborative Learning, CSCL 2011, pages 25-32, 2011. [View Details]

R. Martinez, J. Kay, K. Yacef, and J. Wallace. Modelling symmetry of activity as an indicator of collocated group collaboration. In 19th International Conference on User Modeling, Adaptation and Personalization, UMAP 2011, pages 207-218, 2011. [View Details]

R. Martinez, J. Wallace, J. Kay, and K. Yacef. Modelling and identifying collaborative situations in a collocated multi-display groupware setting. In International Conference on Artificial Intelligence in Education, AIED 2011, pages 196-204, 2011. [View Details]

R. Martinez, K. Yacef, J. Kay, A. Kharrufa, and A. Al-Qaraghuli. Analysing frequent sequential patterns of collaborative learning activity around an interactive tabletop. In 4th International Conference on Educational Data Mining, EDM2011, pages 111-120, 2011. [View Details]

R. Martinez, C. Ackad, K. Yacef, and J. Kay. Designing tabletop-based systems for user modelling of collaboration. In In Adaptive Support for Team Collaboration (ASTC2011) Workshop - The 19th International Conference on User Modeling, Adaptation and Personalization,(UMAP2011), pages 47-51, 2011. [View Details]

R. Martinez, A. Collins, J. Kay, and K. Yacef. Who did what? who said that? Collaid: an environment for capturing traces of collaborative learning at the tabletop. In ACM International Conference on Interactive Tabletops and Surfaces, ITS 2011, pages 172-181, 2011. [View Details]

R. Martinez, J. Kay, and K. Yacef. Collaborative concept mapping at the tabletop. In ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pages 207-210, 2010. [View Details]