Interactive Skill Benchmarks
Codecademy & Skillsoft
Context
Skillsoft, a leading B2B eLearning provider, had long been known for producing video-based content but faced growing pressure to compete with learning management systems. To adapt, they launched Percipio in 2017, entering the learning platform market but struggling to differentiate in a crowded space.
In 2021, Skillsoft acquired Codecademy, a platform known for its interactive, learn-by-doing model. While Codecademy primarily served B2C audiences, it had recently expanded into B2B with its Teams and TeamsPlus products. The acquisition aligned with Skillsoft’s goals to deliver more practical, skill-focused solutions for enterprise customers in the competitive technology training market.
Around the same time, Skillsoft introduced Skill Benchmarks, an assessment tool using multiple-choice questions extracted from course exams. These benchmarks were designed to help learners gauge their technical proficiency and provide administrators with actionable insights into team-wide skill levels.
Problem
While Skill Benchmarks were a step toward connecting learning outcomes with skill validation, they fell short of meeting user needs. Learners found the multiple-choice format ineffective for assessing practical skills, which limited their ability to gauge real-world readiness. Administrators struggled to derive meaningful insights from the data provided. Engagement with the feature was low, and feedback from both learners and administrators highlighted its lack of value. The benchmarks also failed to differentiate from competitors, making them less compelling in a crowded market. This left Skillsoft at a disadvantage in an industry increasingly focused on hands-on, application-based learning solutions.
Goal
Develop a hands-on, interactive assessment tool grounded in pedagogical best practices to effectively evaluate applied technical skills. The solution should differentiate Skillsoft’s offerings in the competitive eLearning market while providing meaningful insights to both learners and administrators.
Process
User feedback
Competitive analysis
Problem definition & discovery
User flows
My Role
Product design
Workshop facilitation
User research
Tools
Figjam
Figma
UserTesting
Confluence
Jira
User research prioritization and planning
The Solution
We built Interactive Skill Benchmarks to evaluate practical coding abilities through dynamic assessments that generate personalized learning recommendations for learners, while offering administrators actionable insights to track progress and address skill gaps.
Interactive Assessment Design
Real-World Skill Evaluation: Uses hands-on, executable code tasks to assess learners’ practical technical proficiency, moving beyond traditional multiple-choice formats.
Constructive Feedback Loop: Allows learners up to three attempts with tailored feedback after each try, enabling them to refine their responses without being penalized for minor mistakes.
Tailored Learning Recommendations
Targeted Skill Improvement: Connects missed learning outcomes from assessments to specific, relevant content, helping learners focus on areas where they need the most growth.
Streamlined Learning Path: Guides learners with clear, actionable next steps, making their learning journey more efficient and minimizing unnecessary repetition.
Valuable Insights for Administrators
Enhanced Reporting Tools: Delivers clear, easy-to-interpret results that simplify tracking progress and measuring the effectiveness of learning programs.
Actionable Data: Equips administrators with detailed insights into team-wide strengths and skill gaps, enabling targeted upskilling strategies and informed decision-making.