We identify a number of open issues that are currently present in the intersection of three fields: tabletops in education from a Computer Supported Collaborative Learning (CSCL) perspective, Educational Data Mining and analytics (EDM), and research on interactive tabletop applications from a Human-Computer Interaction perspective (HCI). The intersection of these fields raises a challenging question: How can interaction data be automatically exploited to inform teachers and enhance their awareness of student’s collaborative activity using interactive tabletops?
The main objective of this project is to provide a novel approach to design, implement and evaluate the conceptual and technological infrastructure that captures student’s activity at interactive tabletops and analyses these data through Interaction Data Analytics techniques to provide support to teachers by enhancing their awareness of student’s collaboration.
We perform this in three steps: the exploration of the feasibility of the approach, the construction of a novel solution and the execution of the conceptual proposal both under controlled conditions and in the wild. A total of eight datasets were analysed for the studies that are described in this thesis.
The contribution of this project that is most strongly associated with the real practice is the implementation of a solution for an authentic classroom using multiple interactive tabletops. This classroom environment offers a number of functionalities for the teacher to orchestrate the script of the classroom session and look at live-visualisations of the on-task progress of each small-group produced from the data captured by our enriched tabletop environments. This approach can help teachers decide which group to attend next. The analysis also includes the discovery of trends in students interactions that can make visible aspects of collaborative work that may not be easily seen without the use of such technology.
Our work has pioneered in a number of areas including the application of data mining techniques to study collaboration at the tabletop, a plug-in solution to add user-identification to a regular tabletop using a depth sensor and the first multi-tabletop classroom used to run authentic collaborative activities associated with the curricula.
- A teacher, a classroom and four interactive tabletops
“What will the classroom of the future look like? What will happen with teachers? What will be the role of technology? Some researchers of the Computer-Human Adapted Interaction (CHAI) group, at The University of Sydney, believe that the proliferation of new technologies, the central role of teachers and a
- The classroom, but not as we know it: technology to revolutionise schools
It’s the kind of futuristic technology familiar from sci-fi films, but touch screen tables, robot study buddies and 3D virtual learning environments could soon feature in the classroom. The high-tech developments were highlighted at the International Conference of the Learning Sciences at the University of Sydney, which focused on
Interacting with Computers, 28 (6), pp. 788-810, 2016.
MTClassroom and MTDashboard: supporting analysis of teacher attention in an orchestrated multi-tabletop classroom Inproceedings
International Conference on Computer-Supported Collaborative Learning, CSCL 2013, pp. 119-128, 2013.
Data Mining in the Classroom: Discovering Groupsâ€™ Strategies at a Multi-tabletop Environment Inproceedings
International Conference on Educational Data mining, EDM 2013, pp. 121-128, 2013.
An automatic approach for mining patterns of collaboration around an interactive tabletop. Inproceedings
International Conference on Artificial Intelligence in Education, AIED 2013, pp. 101-110, 2013.
Open learner models to support reflection on brainstorming at interactive tabletops. Inproceedings
International Conference on Artificial Intelligence in Education, AIED 2013, pp. 683-686, 2013.
Designing OLMs for Reflection about Group Brainstorming at Interactive Tabletops Inproceedings
2nd Workshop on Intelligent Support for Learning in Groups at the 16th International Conference on Artificial Intelligent in Education, pp. 27-36, 2013.
Extending tabletop application design to the classroom Inproceedings
International Conference on Interactive Tabletops and Surfaces, ITS 2013, pp. 115-124, 2013.
Capturing and analyzing verbal and physical collaborative learning interactions at an enriched interactive tabletop Journal Article
International Journal on Computer-Supported Collaborative Learning, 8 (4), pp. 455-485, 2013.
Towards the Integration of Collaboration Analytics and Interactive Surfaces Inproceedings
Workshop on Collaboration meets Interactive Surfaces - held at International Conference on Interactive Tabletops and Surfaces (ITS 2013), pp. to appear, 2013.
Integrating orchestration of ubiquitous and pervasive learning environments Inproceedings
OzCHI, Australian HCI Conference, pp. 189-192, 2013.
Educational Interfaces, Software, and Technology 2012: 3rd Workshop on UI Technologies and Educational Pedagogy, Austin, Texas, 2012.
CHI '12: Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems (Extended Abstracts), pp. 1775–1780, ACM, New York, NY, USA, 2012, ISBN: 978-1-4503-1016-1.
Unpacking traces of collaboration from multimodal data of collaborative concept mapping at a tabletop Inproceedings
International Conference of the Learning Sciences: The Future of learning, ICLS 2012, pp. 241-245, 2012.
An Interactive Teacher's Dashboard for Monitoring Groups in a Multi-tabletop Learning Environment Inproceedings
Proceedings of Intelligent Tutoring Systems, ITS 2012, pp. 482-492, Springer, 2012.
ANALYSING KNOWLEDGE GENERATION AND ACQUISITION FROM INDIVIDUAL AND FACE-TO-FACE COLLABORATIVE CONCEPT MAPPING Inproceedings
Canas, A J; Novak, J D; Vanhear, J (Ed.): Concept Maps: Theory, Methodology, Technology Proc. of the Fifth Int. Conference on Concept Mapping, pp. 17-24, 2012.
Orchestrating a multi-tabletop classroom: from activity design to enactment and reflection Inproceedings
Proceedings of Interactive Tabletops and Surfaces, ITS 2012, pp. 119-128, ACM, 2012.
Visualisations for longitudinal participation, contribution and progress of a collaborative task at the tabletop Inproceedings
International Conference on Computer Supported Collaborative Learning, CSCL 2011, pp. 25-32, 2011.
Modelling symmetry of activity as an indicator of collocated group collaboration Inproceedings
19th International Conference on User Modeling, Adaptation and Personalization, UMAP 2011, pp. 207-218, 2011.
Modelling and identifying collaborative situations in a collocated multi-display groupware setting Inproceedings
International Conference on Artificial Intelligence in Education, AIED 2011, pp. 196-204, 2011.
Designing tabletop-based systems for user modelling of collaboration Inproceedings
In Adaptive Support for Team Collaboration (ASTC2011) Workshop - The 19th International Conference on User Modeling, Adaptation and Personalization,(UMAP2011), pp. 47-51, 2011.
ACM International Conference on Interactive Tabletops and Surfaces, ITS 2011, pp. 172–181, Kobe, Japan, 2011, ISBN: 978-1-4503-0871-7.
Analysing frequent sequential patterns of collaborative learning activity around an interactive tabletop Inproceedings
4th International Conference on Educational Data Mining, EDM2011, pp. 111-120, 2011.
Collaborative Concept Mapping at the Tabletop Inproceedings
ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 207–210, 2010.