ROHA Logo
Experiential Learning Platform

Adding intelligence to the skill creation process

Increasing the visibility, efficiency and outcomes of experiential learning

Year 2022
Role Lead Product Designer
Sector Education

About the company

The #1 experiential learning platform. Connecting learners, educators and experts in one place to execute real-world experiences to increase skills, networking and empowering learners.

Problem

Educators and managers running experiences on the platform don’t have a view of the learners' progress and the impact on their skills progression. This lack of visibility makes it hard to manage large cohorts, increasing the amount of manual work and decreasing outcomes.

Diagram of Experiential Learning Reporting
Diagram and analysis of the three main areas that define success in experiential learning

Research

Customers

We conducted multiple interviews with our actual customers to help us identify the different roles’ needs in terms of success measurement. We also reviewed custom-made reports by our customer success team for specific large customers.

Emoji Teacher

Programs team

The team has an important function in the setup and day-to-day running of experiences. They help us to identify all the blind spots and specific needs in terms of improving experience visibility and performance.

Emoji Superhero Woman

Data team

We organised a workshop with the data team who actively work on improvements and better ways to store and access our data. We reviewed the custom reports created on QuickSight for key customers and got their feedback and constraints about the possibilities of implementing them on the platform.

Emoji Brain
Quicksight Reports
Multiple reports used on custom-made Amazon QuickSight dashboards for specific customers

Customer success team

We collected all the requirements that the customer success team obtained from the large customers and our responses to them. This helped us to understand the needs and feasibility from their point of view.

Emoji Office Worker
End of experience report
Customer success end of the program/experience report sample wherein all the KPIs are calculated manually using disconnected data sources

Engineering team

We developed a few basic reports in the previous version of the platform. The engineering team had some ideas on how to improve performance and remove the barriers to implementing stronger analytics.

Emoji Astronaut

Findings

Amazing reports

We had exceptional customer reports to show the value of running experiences on our platform. However, they were custom solutions for specific customers that weren’t easy to replicate in different use cases.

Emoji Chart

Standardised data

Every experience we build is different and unique. This makes it tough to create analytics that work for every customer. It’s a huge opportunity to standardise some interaction elements as enrolment, satisfaction or assessment. This would provide us with the relations between items to generate better reporting.

Emoji Abacus

Tracking performance

We have satisfactory reporting at the end of an experience. However, we don’t have good analytics within it. More robust reporting during the progress of weeks or activities would give managers the ability to improve the outcomes of the experiences.

Emoji Chart

Granularity

We needed to set the option to drill in our analytics, such as questions regarding a whole cohort, a team’s performance or a specific learner’s progress. Filtering capabilities would help managers dig into different scenarios to find insights to improve the experiences’ performance.

Emoji Magnifier

Key business value

Analytics is one of the key values of the platform and makes it different from other learning management systems. Having the visibility of an experience running and the skills being generated was a game-changing value proposition for the customers.

Emoji Key

Solution: Out-of-the-box dashboards

We decided to implement a high-level, out-of-the-box dashboard for the experiences to help managers execute, track and measure impacts.

Based on our research, we defined the most important and relevant KPIs, status, engagement, progress and quality. With that in mind, we started to work on the wireframes.

Reporting Wirframe
Wireframe and feedback notes from the workshop with the data and engineering teams

We explored the best section in the platform to position the dashboard. After multiple tests, we defined the homepage of the experience as the most relevant place, as it keeps all the stakeholders involved in the experience’s progress and issues.

End of experience dashboard
Exploration of an end-of-experience dashboard

We iterated in different ways to visualise the flow of work, and we created a feedback cycle stream to show the cycle of tasks, feedback and acknowledgment.
Furthermore, in one view, the manager can have a holistic view of the experience and actionable indicators of late items or low performance.

Experience Overview Dashboard
Final version of the new overview dashboard with the experience overview of the KPIs (top), the new Feedback Cycle Stream visualisation (middle) and the relevant KPIs for each stage of the cycle (bottom)

This report is a game changer for managers. However, if something is missing, it isn't useful because it isn’t actionable. We decided to explore further to provide more value to our users.

Solution: Embed the analytics

With the need to increase the actionable KPIs, we decided to transform our data tables into live reports and add reports to specific entities on the platform.

Table Data Exploration
Exploration of the data by roles to show in the tables

Based on the research, we defined the most important KPIs for each type of user and explored the feasibility of showing the needed data.

Learners Table View
Final view of learners' table with the assessment status, sentiment, feedback perception and engagement

Users can see the performance of the experience from multiple angles, filter and take bulk actions when needed.

Altogether

We’ve improved the ways of interacting, tracking and increasing the performance of experiences using the platform. In this short video below, you can see how easy it is to identify issues or problems on multiple levels.

Flow from the main experience dashboard to each type of user reporting

Conclusion

Power users love our data

Our data and insights are delivering a huge amount of value to power users, The options to drill in from a report or filter the learners or experts to execute bulk actions are saving them time and improving their efficiency.

Emoji Love Letter

Unlike other learning management systems

The platform most powerful tools are its intelligence and measurable outcomes. Powerful reporting and smart insight capabilities are also huge business advantages.

Emoji Graduation Cap

Increase automation

The amount of generated data and actionable insights can be overwhelming in large cohorts. We aim to improve how the platform can automatically respond to actions to decrease the amount of user intervention whenever possible.

Emoji Robot

Standardisation vs customisation

We face the unique task of structuring and standardising our data without losing the customisation that large organisations need. This is a key challenge to increase the intelligence we can offer to our customers.

Crossed Fingers

Next steps

More Case Studies

Optimising the Checkout Process for Higher Conversions Streamlining the experiential learning creation process
lala
Let's work together! Send me an e-mail, connect on LinkedIn, or book time on my calendar.