Microsoft Research · Mixed-methods research and prototyping

Media2gether: sharing media together during a video call

People often want to show each other more than their faces during a call: photos from a trip, a map, a gift they're thinking of buying. In 2013, that was new territory: video calls were for seeing each other, with no easy way to share anything else. At Microsoft Research, I led a multi-phase study on how people share media during calls, built Media2gether, a working prototype for viewing and pointing at media together during a Skype call, and evaluated it with pairs of friends and family.

The problem

People wanted to share photos and web pages during calls, but tools let only one person steer.

My role

Lead researcher, from discovery interviews to the lab evaluation of the prototype.

What I did

Interviews, a survey, a working prototype and a lab study with 10 pairs of friends and family.

The impact

Recommendations presented to Skype's research and design team, and a peer-reviewed paper at ACM GROUP 2014.

The key insight

Sharing media pulled people's eyes away from each other's faces, yet calls felt just as close, because photos sparked stories and memories. Photos made calls more emotional; an open shared browser made them more useful.

Why it still matters

In 2013, when this study took place, video calls were mostly talking heads: people could see each other, but not do much together. Research like this contributed to the video apps that followed, which let people share all kinds of experiences together during a call. This study grew out of my PhD research on how families stay close across distance.

My photos Friend's photos Friend You
Media2gether's Photo View, with a photo a participant shared in the study: both people see the same photo, either can choose what's shown, and each has their own pointer.
  1. 01The question
  2. 02How I studied it
  3. 03What we learned
  4. 04From insight to decision
01 · The question

What does sharing media add to a video call, and what gets in the way?

In 2013, video calls were becoming an everyday way to stay close to family and friends, yet sharing something during a call meant sending a link or an attachment, or sharing a screen that only one person could control. Little was known about how often people shared during calls, or what it added.

  1. Question 1 · Current habitsHow and why do people share media during calls, and what gets in the way?
  2. Question 2 · ConnectionDoes sharing media make calls more enjoyable and emotionally connecting?
  3. Question 3 · UsefulnessDoes it make calls more useful, and which kinds of media add most?
02 · How I studied it

Interviews, a survey, a working prototype and a lab study

The study ran in three phases, each building on the last. Interviews with 20 people showed how they shared media during calls, and the workarounds they relied on. One woman circled details in her festival photos while sharing her screen; her mother could only point with words.

A survey of 125 people, across ages 18 to 65, measured how common this was and what people wished they could do. With a designer and a developer, I then built Media2gether, where both people see the same media and each has their own pointer.

In the lab, 10 pairs of friends, couples and family talked over Skype from separate rooms in four kinds of call: a plain call, and calls sharing photos, social posts or a browser. Each person brought ten photos to talk about, half of them about something the pair shared. Questionnaires after every call, rankings, observation and interviews showed how each call felt.

Interviews20 people's current habits and wishes
Survey125 people, aged 18 to 65
PrototypeSame view, shared control and a pointer each
Lab study10 pairs, four kinds of call, compared
Two participants in separate rooms of the lab, each with a laptop running Skype and a touch tablet
In the lab, each person sat in a separate room, with Skype on a laptop and the shared media on a touch tablet, like looking at a photo album during a call.
Media2gether in use during the study: a street view picture of a house in the middle, the partner's photos down the side, and the video call in the corner
Media2gether in use: a participant shows her partner a street view picture of her grandfather's house, one of the most moving moments in the study, with the video call in the corner.
03 · What we learned

Photos made calls more emotional; an open browser made them more useful

Across the survey and the lab, sharing media changed what a call was for. What people shared decided whether it brought them closer or helped them get things done.

Storieswhere the connection came from

Photos turned calls into stories

The most emotional moments came from the stories and memories that media sparked, sometimes only loosely related to it. Photos chosen for one person felt special in a way a social feed didn't, and reminiscing could turn into plans: one pair, looking at a photo from a trip they had taken together, started planning the next one.

Trade-offless eye contact, same closeness

Media drew eyes away from faces, without costing closeness

With media on screen, people watched their partner less, and rated a plain call highest for reading each other's emotions. Yet with photos or a browser, they felt just as close as on a plain call, and photos came close for feeling supported. The stories made up for the lost eye contact.

Try it: how did the four kinds of call compare?

Select a kind of call to see what happened in the lab.

73%of people who had shared media found calls more useful

An open browser was the most useful

Usefulness was the clearest benefit in the survey. In the lab, only 3 of 20 participants ranked the plain call most useful, and 11 ranked the browser first, for its flexibility: pairs watched videos, looked things up, planned trips and shopped. Planning and shopping gained most from hearing the other person's view.

Two-waywhat current tools lacked

Tools let only one person steer

People shared by sending links and attachments, or by sharing a screen that gave one person control and left the other to point with words. What participants valued in Media2gether was seeing the same thing, with both able to choose and point.

More callsif sharing were easy

Easy sharing could mean more, and longer, calls

Most survey respondents who had shared media found calls more engaging and more enjoyable. In the lab, signs of boredom appeared only in the plain call, and participants said an easy way to share would lead to more frequent and longer calls, most strongly for photos and the browser.

What it meant for Skype

Make sharing a two-way part of the call

Sharing media made calls more useful, more enjoyable and, with personal photos, more emotional. To get there, both people needed to see the same thing and act on it together, without losing sight of each other.

In the call
  • The same view for both, with shared control and a pointer each
  • Screen space split evenly between faces and media
  • One flexible shared space, not a separate tool for each kind of media
Around the call
  • A private space for each contact, to gather photos ahead of a call
  • Mutual friends' posts as conversation starters
04 · From insight to decision

Recommendations for Skype, and a peer-reviewed paper

I presented the findings and recommendations to Skype's research and design team. The work was also written up as an internal technical report, and published as a peer-reviewed paper at ACM GROUP 2014 with my Microsoft Research mentors.

Get in touch