Skip to main content

Data Mining for Collaboration at the Tabletop

Contact Person

Kalina Yacef
Kalina Yacef - kalina.yacef@sydney.edu.au

Kalina Yacef's research lies in the fields of Artificial Intelligence in Education, Educational Data Mining and Human Computer Interaction.

Project Description

We identify a number of open issues that are currently present in the intersection of three fields: tabletops in education from a Computer Supported Collaborative Learning (CSCL) perspective, Educational Data Mining and analytics (EDM), and research on interactive tabletop applications from a Human-Computer Interaction perspective (HCI). The intersection of these fields raises a challenging question: How can interaction data be automatically exploited to inform teachers and enhance their awareness of student’s collaborative activity using interactive tabletops?

The main objective of this project is to provide a novel approach to design, implement and evaluate the conceptual and technological infrastructure that captures student’s activity at interactive tabletops and analyses these data through Interaction Data Analytics techniques to provide support to teachers by enhancing their awareness of student’s collaboration.

We perform this in three steps: the exploration of the feasibility of the approach, the construction of a novel solution and the execution of the conceptual proposal both under controlled conditions and in the wild. A total of eight datasets were analysed for the studies that are described in this thesis.

The contribution of this project that is most strongly associated with the real practice is the implementation of a solution for an authentic classroom using multiple interactive tabletops. This classroom environment offers a number of functionalities for the teacher to orchestrate the script of the classroom session and look at live-visualisations of the on-task progress of each small-group produced from the data captured by our enriched tabletop environments. This approach can help teachers decide which group to attend next. The analysis also includes the discovery of trends in students interactions that can make visible aspects of collaborative work that may not be easily seen without the use of such technology.

Our work has pioneered in a number of areas including the application of data mining techniques to study collaboration at the tabletop, a plug-in solution to add user-identification to a regular tabletop using a depth sensor and the first multi-tabletop classroom used to run authentic collaborative activities associated with the curricula.

Gallery

Media Coverage

  • A teacher, a classroom and four interactive tabletops

    “What will the classroom of the future look like? What will happen with teachers? What will be the role of technology? Some researchers of the Computer-Human Adapted Interaction (CHAI) group, at The University of Sydney, believe that the proliferation of new technologies, the central role of teachers and a

  • The classroom, but not as we know it: technology to revolutionise schools

    It’s the kind of futuristic technology familiar from sci-fi films, but touch screen tables, robot study buddies and 3D virtual learning environments could soon feature in the classroom. The high-tech developments were highlighted at the International Conference of the Learning Sciences at the University of Sydney, which focused on

Related Publications

2016

An In-the-Wild Study of Learning to Brainstorm: Comparing Cards, Tabletops and Wall Displays in the Classroom

Clayphan, Andrew; Martinez-Maldonado, Roberto; Tomitsch, Martin; Atkinson, Susan; Kay, Judy

An In-the-Wild Study of Learning to Brainstorm: Comparing Cards, Tabletops and Wall Displays in the Classroom Journal Article

Interacting with Computers, 28 (6), pp. 788-810, 2016.

Abstract | Links | BibTeX

2015

Martinez-Maldonado, R; Clayphan, A; Yacef, K; Kay, J

MTFeedback: Providing Notifications to Enhance Teacher Awareness of Small Group Work in the Classroom Journal Article

Learning Technologies, IEEE Transactions on, 8 (2), pp. 187-200, 2015, ISSN: 1939-1382.

Links | BibTeX

Martinez-Maldonado, Roberto; Clayphan, Andrew; Kay, Judy

Deploying and Visualising Teacher's Scripts of Small Group Activities in a Multi-surface Classroom Ecology: a Study in-the-wild Journal Article

Computer Supported Cooperative Work, 24 (2-3), pp. 177–221, 2015.

Links | BibTeX

Martinez-Maldonado, Roberto; Pardo, Abelardo; Mirriahi, Negin; Yacef, Kalina; Kay, Judy; Clayphan, Andrew

The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings Inproceedings

Proceedings of the Fifth International Conference on Learning Analytics And Knowledge, LAK '15, Poughkeepsie, NY, USA, March 16-20, 2015, pp. 1–10, 2015.

Links | BibTeX

Martinez-Maldonado, Roberto; Clayphan, Andrew; Kay, Judy

Deploying and Visualising Teacher's Scripts of Small Group Activities in a Multi-surface Classroom Ecology: a Study in-the-wild Journal Article

Computer Supported Cooperative Work (CSCW), 24 (2-3), pp. 177–221, 2015.

BibTeX

2014

Martinez-Maldonado, Roberto; Clayphan, Andrew; Yacef, Kalina; Kay, Judy

Towards Providing Notifications to Enhance Teacher's Awareness in the Classroom Inproceedings

International Conference on Intelligent Tutoring Systems, ITS, pp. 510–515, Springer 2014.

BibTeX

2013

Martinez-Maldonado, Roberto; Yacef, Kalina; Dimitriadis, Yannis; Edbauer, Maresa; Kay, Judy

MTClassroom and MTDashboard: supporting analysis of teacher attention in an orchestrated multi-tabletop classroom Inproceedings

International Conference on Computer-Supported Collaborative Learning, CSCL 2013, pp. 119-128, 2013.

BibTeX

Martinez-Maldonado, Roberto; Yacef, Kalina; Kay, Judy

Data Mining in the Classroom: Discovering Groups’ Strategies at a Multi-tabletop Environment Inproceedings

International Conference on Educational Data mining, EDM 2013, pp. 121-128, 2013.

BibTeX

Martinez-Maldonado, Roberto; Yacef, Kalina; Kay, Judy

An automatic approach for mining patterns of collaboration around an interactive tabletop. Inproceedings

International Conference on Artificial Intelligence in Education, AIED 2013, pp. 101-110, 2013.

BibTeX

Clayphan, Andrew; Martinez-Maldonado, Roberto; Kay, Judy

Open learner models to support reflection on brainstorming at interactive tabletops. Inproceedings

International Conference on Artificial Intelligence in Education, AIED 2013, pp. 683-686, 2013.

BibTeX

Clayphan, Andrew; Martinez-Maldonado, Roberto; Kay, Judy

Designing OLMs for Reflection about Group Brainstorming at Interactive Tabletops Inproceedings

2nd Workshop on Intelligent Support for Learning in Groups at the 16th International Conference on Artificial Intelligent in Education, pp. 27-36, 2013.

BibTeX

Kharrufa, Ahmed; Martinez-Maldonado, Roberto; Kay, Judy; Olivier, Patrick

Extending tabletop application design to the classroom Inproceedings

International Conference on Interactive Tabletops and Surfaces, ITS 2013, pp. 115-124, 2013.

BibTeX

Martinez-Maldonado, R; Dimitriadis, Y; Martinez-Mones, A; Kay, J; Yacef, K

Capturing and analyzing verbal and physical collaborative learning interactions at an enriched interactive tabletop Journal Article

International Journal on Computer-Supported Collaborative Learning, 8 (4), pp. 455-485, 2013.

BibTeX

Martinez-Maldonado, R; Clayphan, A; Kay., J

Towards the Integration of Collaboration Analytics and Interactive Surfaces Inproceedings

Workshop on Collaboration meets Interactive Surfaces - held at International Conference on Interactive Tabletops and Surfaces (ITS 2013), pp. to appear, 2013.

BibTeX

Martinez-Maldonado, Roberto; Dimitriadis, Yannis; Clayphan, Andrew; Muñoz-Cristóbal, Juan Alberto; Kay, Judy; Prieto, Luis Pablo; Rodríguez-Triana, Maria Jesús

Integrating orchestration of ubiquitous and pervasive learning environments Inproceedings

OzCHI, Australian HCI Conference, pp. 189-192, 2013.

BibTeX

2012

Martinez-Maldonado, Roberto; Clayphan, Andrew; Yacef, Kalina; Kay, Judy; Ackad, Christopher James

Sensing, Tracking and Modelling with Ignition - a framework for supporting classroom collaboration. Inproceedings

Educational Interfaces, Software, and Technology 2012: 3rd Workshop on UI Technologies and Educational Pedagogy, Austin, Texas, 2012.

Links | BibTeX

Ackad, Christopher; Clayphan, Andrew; Martinez, Roberto; Kay, Judy

Seamless and continuous user identification for interactive tabletops using personal device handshaking and body tracking Inproceedings

CHI '12: Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems (Extended Abstracts), pp. 1775–1780, ACM, New York, NY, USA, 2012, ISBN: 978-1-4503-1016-1.

Links | BibTeX

Martinez-Maldonado, Roberto; Kay, Judy; Yacef, Kalina; Schwendimann, Beat

Unpacking traces of collaboration from multimodal data of collaborative concept mapping at a tabletop Inproceedings

International Conference of the Learning Sciences: The Future of learning, ICLS 2012, pp. 241-245, 2012.

BibTeX

Martinez-Maldonado, Roberto; Yacef, Kalina; Kay, Judy; Schwendimann, Beat

An Interactive Teacher's Dashboard for Monitoring Groups in a Multi-tabletop Learning Environment Inproceedings

Proceedings of Intelligent Tutoring Systems, ITS 2012, pp. 482-492, Springer, 2012.

BibTeX

Martinez-Maldonado, Roberto; Kay, Judy; Yacef, Kalina

ANALYSING KNOWLEDGE GENERATION AND ACQUISITION FROM INDIVIDUAL AND FACE-TO-FACE COLLABORATIVE CONCEPT MAPPING Inproceedings

Canas, A J; Novak, J D; Vanhear, J (Ed.): Concept Maps: Theory, Methodology, Technology Proc. of the Fifth Int. Conference on Concept Mapping, pp. 17-24, 2012.

BibTeX

Martinez-Maldonado, Roberto; Dimitriadis, Yannis; Kay, Judy; Yacef, Kalina; -T, M; Edbauer,

Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection Inproceedings

Proceedings of Interactive Tabletops and Surfaces, ITS 2012, pp. 119-128, ACM, 2012.

BibTeX

2011

Martinez, Roberto; Kay, Judy; Yacef, Kalina

Visualisations for longitudinal participation, contribution and progress of a collaborative task at the tabletop Inproceedings

International Conference on Computer Supported Collaborative Learning, CSCL 2011, pp. 25-32, 2011.

BibTeX

Martinez, Roberto; Kay, Judy; Yacef, Kalina; Wallace, James

Modelling symmetry of activity as an indicator of collocated group collaboration Inproceedings

19th International Conference on User Modeling, Adaptation and Personalization, UMAP 2011, pp. 207-218, 2011.

BibTeX

Martinez, Roberto; Wallace, James; Kay, Judy; Yacef, Kalina

Modelling and identifying collaborative situations in a collocated multi-display groupware setting Inproceedings

International Conference on Artificial Intelligence in Education, AIED 2011, pp. 196-204, 2011.

BibTeX

Martinez, Roberto; Ackad, Christopher; Yacef, Kalina; Kay, Judy

Designing tabletop-based systems for user modelling of collaboration Inproceedings

In Adaptive Support for Team Collaboration (ASTC2011) Workshop - The 19th International Conference on User Modeling, Adaptation and Personalization,(UMAP2011), pp. 47-51, 2011.

BibTeX

Martinez, Roberto; Collins, Anthony; Kay, Judy; Yacef, Kalina

Who did what? Who said that? Collaid: an environment for capturing traces of collaborative learning at the tabletop Inproceedings

ACM International Conference on Interactive Tabletops and Surfaces, ITS 2011, pp. 172–181, Kobe, Japan, 2011, ISBN: 978-1-4503-0871-7.

Links | BibTeX

Martinez, Roberto; Yacef, Kalina; Kay, Judy; Kharrufa, Ahmed; Al-Qaraghuli, Ammar

Analysing frequent sequential patterns of collaborative learning activity around an interactive tabletop Inproceedings

4th International Conference on Educational Data Mining, EDM2011, pp. 111-120, 2011.

BibTeX

2010

Martinez, Roberto; Kay, Judy; Yacef, Kalina

Collaborative Concept Mapping at the Tabletop Inproceedings

ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 207–210, 2010.

BibTeX