Study of higher education during COVID-19 shutdowns shows certain subjects can be better taught online

When the COVID-19 pandemic hit in 2020, schools around the globe had to switch from regular, in-person classes to online learning overnight. This introduced numerous operational challenges, particularly in equipping students with quantitative skills essential for the labor market. New research from the University of Notre Dame looks at how the abrupt move from classroom teaching to online learning during the lockdown affected college students’ performance in China.

Surprisingly, the undergraduates performed better in math after switching to online classes — improving their scores by about eight to 11 points on a 100-point scale, according to Shijie Lu, the Howard J. and Geraldine F. Korth Associate Professor of Marketing at Notre Dame’s Mendoza College of Business. Lu’s research, “Effectiveness of Online Education During the COVID-19 Pandemic: Evidence from Chinese Universities,” is forthcoming in Production and Operations Management. Along with Xintong Han from Laval University in Quebec City, Shane Wang from Virginia Tech and Nan Cui at Wuhan University in China, Lu analyzed more than 15,000 course records from nearly 8,000 students across nine universities. They compared students’ grades from before the pandemic, when they learned in person, to those during the lockdown when all classes moved online. Results varied depending on the subject and the lockdown environment. Online learning worked especially well for reasoning-based subjects such as mathematics, where students could pause lectures, rewatch examples and practice problems at their own pace. In contrast, courses such as English that rely on discussion and interpretation, and are challenging to replicate effectively in virtual environments, benefited much less from the online format. “Contrary to the widespread belief that online education is less effective than face-to-face instruction, our findings show that students actually performed better online, at least in quantitative subjects during the pandemic,” said Lu, who specializes in business analytics and digital marketing. “This challenges the traditional view that in-person learning is always superior and suggests that, under certain conditions, well-structured online environments can enhance learning outcomes.” Results were linked to the strictness of stay-at-home orders or transportation bans to see how different types of governmental lockdown policies shaped learning outcomes. Using rigorous econometric methods, the researchers made sure that the improvements they observed were due to the switch to online learning and not other unrelated factors. They found that stricter stay-at-home orders issued by the government raised psychological stress and reduced the effectiveness of online learning. However, these negative effects were partially offset when workplace closures and public transportation suspensions helped some people maintain focus and discipline. One possible explanation is that as parents were more frequently home due to employment interruptions, they were better positioned to ensure their children attended virtual classes, remained focused on tasks and followed a structured schedule. Meanwhile, suspension of public transportation reduced opportunities for social outings and non-academic distractions, effectively creating a quieter, more focused study environment at home. “Our results show that online education when done thoughtfully can be more than just a backup plan during emergencies,” Lu said. “It can be an effective tool for learning, especially in analytical subjects.” For educators, this means designing online courses that take advantage of digital tools — such as interactive exercises or on-demand videos — rather than simply moving lectures onto Zoom. For policymakers, it highlights that not all lockdown policies have the same effect on educational outcomes. Strict stay-at-home orders hurt learning, but moderate workplace closures that allow parents to supervise their children help to improve outcomes. “These insights can help schools and governments better prepare for future disruptions — whether from pandemics, natural disasters or other emergencies — by understanding how to balance safety and learning effectiveness,” Lu said. The study shows that online learning programs need to be flexible and designed with the specific course material and students’ physical location in mind. Contact: Shijie Lu, 574-631-5883, slyu@nd.edu