The American Board of Pediatrics’ (ABP) Saed Qunbar has been awarded the 2019 Graduate Student Research Award by the Association of Test Publishers (ATP). The award is given for his assessment recommender system, which could eventually be used to deliver certified pediatricians more relevant exam questions via the ABP’s new online, non-proctored assessment platform, MOCA-Peds (Maintenance of Certification Assessment for Pediatrics).
Qunbar, who is currently pursuing his PhD in the Educational Research Methodology and Evaluation program at the University of North Carolina at Greensboro, took on the project in his role as an intern in the ABP’s psychometrics department.
“The MOCA-Peds recommender system project falls at the intersection of three things that really motivate me: predictive modeling, learning new techniques and impactful problem solving,” he said. “When I was told the ABP was looking for a way to further personalize the MOCA-Peds system, I was very excited to help.”
After each exam question pediatricians answer in the MOCA-Peds platform, they are asked how relevant that question was to them. Qunbar’s recommender system takes that relevance data, runs it through an algorithm, which then helps predict how relevant a pediatrician will find future exam questions. The result is that pediatricians eventually receive exam questions that are more relevant to them and their practice. It works similarly to Netflix’s system, which offers personalized recommendations for what a person might like to watch based on what they’ve seen and liked before.
“My hope is that this will help certified pediatricians maximize their learning when they are interacting with MOCA-Peds,” Qunbar said. “If a doctor out there learns a new piece of information, or even brushes up on some knowledge, that is relevant to their specific practice because the recommender system served them a question they wouldn’t have otherwise been served, I’ll feel that we’ve done our job.”
As part of the award, Qunbar will present at the ATP’s Innovations in Testing Conference 2019 on March 19th.