Group Analytics: Providing Feedback

to Co-located Groups
Vanessa Echeverria
PhD Student
EFFECTIVE GROUPS
EXPECTATION
 EXPECTATION

Effective Communication

Higher interdependence

Equal participation

Leadership

Communicating in small groups

Beebe & Masterson, 2003
REALITY
REALITY

Avoiding work
Communication
Conflicts Imposition
of ideas Non-related
conversations

Loafer Free-rider
 Epistemic

Co-
configuration

Physical Social
 RQ1: What multimodal data
Gathering data
can be unobtrusively captured
pervasively
from physical spaces?

RQ2: How can group activity

data be analysed to provide
Analysing group activity
automated formative
feedback?

RQ3: What are the design

Inform users through features that actionable
actionable and intelligible and intelligent formative
HOW DO TEACHERS AND STUDENTS
PERCEIVE GROUP WORK?
 T E AC H E R ’ S P E R S P E C T I V E

Time-consuming task

Assessment is complex

Feedback is scarcely provided

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
 T E AC H E R ’ S P E R S P E C T I V E

Time-consuming task

Assessment is complex

Feedback is scarcely provided

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
 T E AC H E R ’ S P E R S P E C T I V E

Time-consuming task

Assessment is complex

Feedback is scarcely provided

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
 STUDENT’S PERSPECTIVE

Unfair assessment

Unbalanced participation

Feedback only on outcome

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
 STUDENT’S PERSPECTIVE

Unfair assessment

Unbalanced participation

Feedback only on outcome

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
 STUDENT’S PERSPECTIVE

Unfair assessment

Unbalanced participation

Feedback only on outcome

A Systematic Literature Review of Teamwork Pedagogy in Higher Education

Riebe, Girardi, & Whitsed, 2016
I WISH I COULD…
P D : H E A LT H S I M U L AT I O N C L A S S

Student’s more aware of

group communication
Spend time with each
group/student
Provide snapshots of their
performance
Time to reflect upon the
activity
Opportunities for students to
see themselves
HOW C AN WE HELP GROUPS
TO BE MORE EFFICIENT?
 M U LT I M O DA L L E A R N I N G A N A LY T I C S ( M L A )

Make things visible from authentic

scenarios

Supporting traditional educational

research

Multimodal Learning Analytics, Handbook of Learning Analytics

Ochoa, X, 2017
 M U LT I M O DA L L E A R N I N G A N A LY T I C S ( M L A )

Make things visible from authentic

scenarios

Supporting traditional educational

research

Multimodal Learning Analytics, Handbook of Learning Analytics

Ochoa, X, 2017
CHALLENGES
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Product

Audio
Body language
Traces
G RO U P A N A LY T I C S C H A L L E N G E S

Tablet data
Position

Audio Roles

Manikin data
G RO U P A N A LY T I C S C H A L L E N G E S

Authenticity of the environment

Data capture

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Authenticity of the environment

Data capture
Group member’s differentiation

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Authenticity of the environment

Data capture
Group member’s differentiation

Group member’s authentication

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Authenticity of the environment

Data capture
Group member’s differentiation

Group member’s authentication

Data analysis Data accessibility

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Multimodal and multi-source data

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Multimodal and multi-source data

Data analysis Multi-person data

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Group or individual

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Group or individual

Guided reflection vs. Self-reflection

Data visualisation
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Group or individual

Guided reflection vs. Self-reflection

Data visualisation
Sense-making
G RO U P A N A LY T I C S C H A L L E N G E S

Data capture

Data analysis

Group or individual

Guided reflection vs. Self-reflection

Data visualisation
Sense-making
Validation and evaluation
THIS RESEARCH IS ABOUT …
AU TO M AT E D F O R M AT I V E F E E D B AC K

Design and validation of a tool to provide

formative feedback about group activities
from multimodal learning analytics
RESEARCH CHALLENGES

How can we capture multimodal data unobtrusively from co-located spaces?

What type of analysis should be covered to provide actionable

and intelligent feedback?

How can we validate intelligent and actionable feedback for sense-making of

group’s activity?
QUESTIONS ?

Does the same analysis that has been explored in online environments can be
applied to co-located environments?

How can we manage missing information from any group member or source?
THANKS!