User research guide

Raise awareness and empower public servants to do more user research when developing government products and services.
Sector

Government

Organization

Ontario Digital Service

My role

I was responsible for writing the user research guide, speaking at the Toronto’s user research lab open house, and co-hosting drop-in sessions as part of building better and consistent government services.

Study date

2018

Cover photo by Xiaopu Fung from Ontario Digital Service

There were so many questions about user research

When I first joined the Ontario Public Service (OPS), I was asked some challenging questions from OPS employees. Here are some highlights:

Identifying research objectives

  • When is the best time to do user research?
  • How long will it take to do user research?
  • How do I identify target user groups when we are meant to design for everyone?
  • When do you know that you have done enough user research?

Getting stakeholder buy-in

  • How do you get approvals to do user research?
  • How do I communicate the value of user research to my superiors?
  • How can I get my superiors more involved when they are so busy?

Conducting user research

  • How do you conduct interviews online?
  • What is the protocol for recording participants?
  • Do you have existing research plans we can use for reference?

Streamlining research operations

  • How much are we supposed to pay participants?
  • How do you recruit participants in my ministry?
  • Do you have an existing template to get consent from participants?

What employees wanted

  • Standardized user research guidelines.
  • Answers quickly, ideally before going through approvals.
  • Feedback on their projects from our user research team.
  • A space to do user research with their participants.
Lucia speaking in front of a large crowd in a meeting room
User research open house in Toronto 2018
Group of 12 people sitting on office chairs taking notes
View of overflow room
Group of people staring at a screen taking notes
Audience taking notes
Photos by Jen Lee from Ontario Digital Service

User research guide

Through collaboration and research, I gathered together best practices for:

  • how to get buy-in from stakeholders
  • recruitment strategies
  • consent and compensation guidelines
  • privacy considerations

Additional user research support

Photos from Ontario Digital Service

How the user research lab has made an impact

In the span of over a year from August 2018 to September 2019, the user research lab has connected with ministry partners to collectively share and implement best user research practices.

User research guide

2,621

Unique page views for Ontario’s User Research Guide with no marketing spend.

3 min 38 sec

Average time spent on the page. This is one minute higher compared to other pages on ontario.ca.

33%

Scroll to the bottom of the page.

User research drop-ins

27

Drop-in sessions were hosted to answer any questions or share expertise about user research and design.

133+

OPS employees and contractors have shown up in the drop-ins to talk about challenges and needs.

28+

Ministry departments connected at user research drop-in.

The user research lab continues to provide and improve user research services for OPS employees.

Takeaways

  • Although there are not many unique visitors to the user research guide, data suggests that people are engaged with the content once they land on the page.
  • Keeping the drop-in sessions informal created an open, non-judgemental and inclusive environment to hear shared experiences.
Thanks for inspiring me about user research and connecting the dots for me on how Lean and service design can connect through users and user research. Let’s continue the conversation to learn more about this.
— Hedia Balkhi
  • By connecting many ministry partners together, we were able to identify duplicate initiatives for the same problem. This enabled teams to connect with each other, diversify their approach and create more meaningful services.
  • In ministry departments that have only one analyst working on multiple products, it created a space to learn and bounce ideas off each other.

Acknowledgements

Champions of excellent service standards.

Guides and mentions

User research guide

2018

Design research guide

Adapted from Ontario’s user research guide.

2020

8 ways to make user research happen

2019

Ontario Digital Service Lab at Communitech wants to help government embrace digital services

2017

12 lessons learned about guerrilla testing

2017

Ontario Digital Service Lab opens shop in Communitech for user-based research

2017