Real-world learning in the AI era

Generating a polished answer is not the same as developing knowledge, judgment, or the capacity to act.

Clay illustration of students investigating a watershed model and sample jars while an educator listens.

Capability is not output

Generative AI can make an essay, image, plan, or block of code appear in seconds. That changes the cost of producing an output. It does not remove the work of building knowledge, deciding what matters, testing an idea, collaborating with other people, or explaining why a choice is sound.

The distinction matters because a learner can submit something plausible without being able to reconstruct the reasoning behind it. The OECD's 2026 outlook makes the same boundary visible: successful performance with a general-purpose AI tool does not automatically become a learning gain, and educational use should not replace cognitive effort.1

Two experiments show the gap directly. In a randomised field experiment at one Turkish high school, nearly 1,000 maths students who practised with an unrestricted GPT-4 chat interface scored 48% higher than a no-AI group during assisted practice, then 17% lower on a later exam taken without AI. A version with teacher-designed, hint-only guardrails avoided that drop, but its exam results were not significantly different from the no-AI group.2 In a separate lab experiment, 117 university students writing in a second language were randomly assigned different kinds of revision support. ChatGPT improved their essays more than any other condition, including a human writing expert, yet knowledge gain and transfer did not differ across groups.3

This is not an argument for pretending AI does not exist. It is an argument for designing learning around capability: what a learner can understand, do, explain, revise, and transfer when the shortcut is unavailable.

What real-world learning asks of a learner

Real-world learning connects disciplinary knowledge to a problem, audience, decision, or consequence beyond completing an assignment. The point is not that every lesson must simulate a workplace. The point is that students have reasons to inquire, make choices, encounter constraints, and improve work that someone can question.

Four qualities are especially valuable when polished output is cheap:

  1. Authenticity. The work has a credible purpose, audience, context, or impact.
  2. Inquiry. Students must frame questions, find and evaluate information, and make defensible choices.
  3. Collaboration. Other people introduce perspectives, expertise, disagreement, and accountability that a solitary prompt cannot reproduce.
  4. Reflection. Learners explain what changed, where they struggled, what evidence altered their view, and what they would do next.

PBLWorks names authenticity, sustained inquiry, and reflection among the seven design elements of its Gold Standard PBL model, alongside a challenging problem or question, student voice and choice, critique and revision, and a public product. It treats collaboration differently: as one of the success skills projects should help students develop, rather than as a design element.4

What the research can—and cannot—establish

Project-based learning is not one uniform intervention. A meta-analysis of 30 published studies found a positive average effect of PBL on academic achievement compared with conventional instruction, with results that varied by subject area, school location, and instructional hours.5 That pooled estimate needs a caution. Across 645 education evaluations, published studies and small trials reported effect sizes roughly twice as large as others,6 and the meta-analysis included only published articles, so the pooled estimate is likely to overstate the effect a school should expect. The individual evaluations below also suggest that implementation demands and school conditions matter, though these are harder to isolate. Two prominent studies show why both encouragement and caution belong in the same account.

An Education Endowment Foundation trial of a particular PBL programme found no clear impact on literacy, engagement, or attendance overall, and a statistically significant negative literacy impact for pupils eligible for free school meals, though not for lower-attaining pupils overall. The evaluation reported substantial attrition and crossover between groups, rated the findings as low security, and noted the organisational demands of implementation. Its process evaluation also reported perceived gains in oracy, communication, teamwork, and self-directed study skills, but those observations are not equivalent to a secure causal effect.7

A separate cluster-randomized study compared project-based and lecture-based approaches in two Advanced Placement courses. It found positive AP exam effects in both courses studied, including among students from lower- and higher-income households. The authors bound their conclusion to those courses, participating U.S. districts with open-enrollment AP policies, and settings supportive of the approach.8

Taken together, these studies do not support “PBL always works” or “PBL does not work.” They support a more useful question: what design, support, subject context, and implementation conditions help a particular group of learners develop particular capabilities?

Support is part of that question, not a detail. Kirschner, Sweller, and Clark argued that minimally guided inquiry works poorly for novices.9 Hmelo-Silver, Duncan, and Chinn replied that problem-based and inquiry learning are highly scaffolded rather than minimally guided.10 One way to read the exchange: both sides agree that novices need guidance, and they disagree about whether problem-based and inquiry approaches provide enough of it.

Design implications for educators

Make the process inspectable

Ask students to preserve the path, not just the final product: early questions, source choices, rejected ideas, drafts, feedback, and revisions. A process portfolio can give teachers evidence of developing understanding and give students material for reflection.

Ask students to preserve the path, not just the final product
  1. early questions
  2. source choices
  3. decisions under constraint
  4. revisions

Build in moments that require judgment

Use oral explanations, design critiques, demonstrations, field observations, peer review, and decisions under constraint. These are not “AI-proof” assessment tricks. They are opportunities to reveal how knowledge is being used.

There is also a learning reason to ask students to explain why. A meta-analysis of 64 reports found that prompting learners to explain material to themselves tended to support learning, and did so more than giving them an explanation provided by a teacher or the materials.11 That is evidence about how generating an explanation helps learning, not evidence that an oral assessment is valid or resistant to AI misuse.

Treat AI assistance as a design choice

Name when AI is unavailable, when it may be used, what must be disclosed, and what the learner remains responsible for. If a tool supplies a suggestion, the student should be able to test it, explain whether it belongs, and show what changed because of it.

Protect the teacher's role

Teachers connect disciplinary goals to the students in front of them. They notice misconceptions, motivation, context, and social dynamics that a generic system cannot fully know. Technology may help prepare options or scaffold inquiry, but educational judgment remains a human responsibility. Read our companion resource on teacher-led educational AI, the practical educator and school pathways, and our responsible AI principles.

Questions a school can ask now

  • What should students know and be able to do without AI?
  • Where can AI extend inquiry without replacing the thinking the task is meant to develop?
  • What evidence of process will students and teachers keep?
  • When will learners explain, demonstrate, defend, or revise their work with other people?
  • What support do teachers need to plan and sustain this kind of learning well?

Real-world learning is not valuable because it sounds modern. It is valuable when it gives learners disciplined practice in using knowledge with agency, judgment, other people, and consequences. In an AI-rich world, that practice becomes easier to overlook—and more important to design deliberately.

References and evidence boundaries

The note beneath each source states how this article uses—and limits—the evidence.

  1. OECD. OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education19 January 2026.

    Used for bounded claims about cognitive effort, purposeful GenAI use, and teacher expertise.

  2. Bastani et al., Proceedings of the National Academy of Sciences. Generative AI without guardrails can harm learning: Evidence from high school mathematicsVol. 122, no. 26, 2025.

    Used for evidence that unrestricted AI help raised practice scores while lowering later unassisted exam scores in one Turkish high school's maths course, and that a hint-only version avoided that drop without raising exam scores, not as evidence about other subjects, ages, or long-term outcomes.

  3. Fan et al., British Journal of Educational Technology. Beware of metacognitive laziness: Effects of generative artificial intelligence on learning motivation, processes, and performanceVol. 56, no. 2, 2025.

    Used for evidence that ChatGPT support improved an essay without improving knowledge gain or transfer in one short lab task with second-language university students, not as a measure of long-term learning or school-age learners.

  4. PBLWorks. Gold Standard PBL: Essential Project Design ElementsPublication date not stated.

    Used as a practitioner design framework, not as evidence that PBL causes universal outcomes.

  5. Chen & Yang, Educational Research Review. Revisiting the effects of project-based learning on students' academic achievement: A meta-analysis investigating moderatorsVol. 26, 2019.

    Used to show that pooled published PBL studies lean positive with variation by subject, setting, and instructional hours, not as an estimate of the effect a school should expect.

  6. Cheung & Slavin, Educational Researcher. How methodological features affect effect sizes in educationVol. 45, no. 5, 2016.

    Used for the caution that published studies and small trials tend to report larger effect sizes, not as a verdict on any particular PBL study.

  7. Education Endowment Foundation. Project-Based Learning trialEvaluation report published 2016.

    Used for the trial's null overall literacy, engagement, and attendance findings, its negative literacy finding for FSM-eligible pupils, implementation observations, and low-security limitations.

  8. Saavedra et al., Educational Evaluation and Policy Analysis. The Impact of Project-Based Learning on AP Exam PerformanceVol. 44, no. 4, 2022.

    Used only for the two AP courses, participating supportive U.S. districts, and open-enrollment context studied.

  9. Kirschner et al., Educational Psychologist. Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teachingVol. 41, no. 2, 2006.

    Used as one side of the long-running debate over guidance in problem-based, inquiry, and discovery learning, not as evidence that PBL fails in general.

  10. Hmelo-Silver et al., Educational Psychologist. Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006)Vol. 42, no. 2, 2007.

    Used as the reply in the debate over guidance in problem-based and inquiry learning, not as evidence that PBL succeeds in general.

  11. Bisra et al., Educational Psychology Review. Inducing self-explanation: A meta-analysisVol. 30, no. 3, 2018.

    Used for evidence that generating one's own explanations tends to support learning more than receiving them, not as evidence that oral or explanation-based assessment is valid or resistant to AI misuse.

Educators shaping a project together around a table

Help shape Dwyl.studio.

Dwyl.studio is still being built. We want educators and school leaders to help shape the decisions while they can still change.

What would make ambitious project learning easier to lead? Which challenges would stretch your students? What would you need to see in a report to know how to help?

If those questions matter to you too, we would value your perspective.

Early access is an invitation to contribute. It is not a promise of immediate access to a finished platform or proven classroom outcomes.

Building with educators

Join educator early access

Help shape Dwyl.studio while we build a teacher-first workspace for real-world projects.

We use these details only to respond to your interest. Read our privacy information.