Designing with Love
Designing with Love
What does it take to design learning experiences that truly work? Join Jackie Pelegrin, award-winning instructional designer and Grand Canyon University (GCU) adjunct instructor, as she explores instructional design, e-learning, and AI integration. Expect actionable tips, real-world insights, and conversations with students, alumni, and industry leaders shaping the future of learning.
Nov. 18, 2026

Assessment Reinvented: Authentic, Continuous, and Data-Smart

Assessment Reinvented: Authentic, Continuous, and Data-Smart
Assessment Reinvented: Authentic, Continuous, and Data-Smart
Designing with Love
Assessment Reinvented: Authentic, Continuous, and Data-Smart

Key Takeaways

  • Assessment reinvention shifts the focus from measuring a final product to gathering meaningful, process-based evidence of learning, especially in an era shaped by AI.
  • Instructional designers should move from simple recall questions to authentic evidence tasks that require learners to apply knowledge in relevant, real-world contexts.
  • Implementing continuous assessment means breaking high-stakes evaluation into smaller, purposeful checkpoints that allow for practice, feedback, and revision over time.
  • Smart data collection focuses on actionable insights that help educators and learners answer critical questions, rather than simply hoarding completion metrics and clicks.
  • The Assessment Reinvention Check provides a practical tool to evaluate existing assignments by asking whether they are authentic, offer a chance to improve, and yield actionable data.

A polished final project used to feel like solid proof of learning. Now it can be a snapshot of memorization, a mismatch with a learner’s test skills, or a perfectly edited artifact shaped by AI. So we ask a tougher, more useful question: what evidence shows learning actually happened, and how can assessment help learners get better before it’s too late?

We walk through a future-ready assessment mindset that shifts measurement toward meaningful evidence across the learning process. In this episode, Jackie breaks down why formative assessment and feedback change learner behavior, how authentic assessment reveals application and judgment, and what “continuous evidence” looks like without turning your course into an endless grading marathon. Think intentional checkpoints, practice, reflection, revision, and transfer tasks that show growth over time.

You’ll leave with a simple tool you can try this week: the Assessment Reinvention Check. If this helps you rethink how you design assessment in a world shaped by AI in education, subscribe, share the episode with a colleague, and leave a review so more people can find the show.

🔗 Episode Links

Please check out the resources mentioned in the episode. Enjoy!

2026 EDUCAUSE Horizon Report: Teaching and Learning Edition

Future-Ready Design Brief: Assessment Reinvented

OECD: Using Formative Assessment and Feedback

OECD: Key Findings and Integration Strategies on the Impact of Digital Technologies on Students’ Learning

Send Jackie a Text

Join PodMatch!
Use the link to join PodMatch, a place for hosts and guests to connect.

Disclaimer: This post contains affiliate links. If you make a purchase, I may receive a commission at no extra cost to you.

Support the show

💟 Designing with Love + allows you to support the show by keeping the mic on and the ideas flowing. Click on the link above to provide your support.

☕ Buy Me a Coffee is another way you can support the show, either as a one-time gift or through a monthly subscription.

🗣️ Want to be a guest on Designing with Love? Send Jackie Pelegrin a message on PodMatch, here: Be a guest on the show

🌐 Check out the show's website here: Designing with Love

📱 Send a text to the show by clicking the Send Jackie a Text link above.

👍🏼 Please make sure to like and share this episode with others. Here's to great learning!


Frequently Asked Questions

What is assessment reinvention in instructional design?

Assessment reinvention is the shift from high-stakes final exams and polished end-products toward authentic, continuous, and data-smart measurement that captures learning as it develops.

How does artificial intelligence impact traditional assessment?

AI complicates traditional testing and final papers because learners can easily generate polished artifacts that may not reflect their actual thinking, forcing educators to design more process-based and authentic evaluations.

What are the three core shifts of future-ready assessment?

The three shifts include moving from recall to authentic evidence, transitioning from one big grading moment to continuous evidence across checkpoints, and utilizing smarter, actionable data rather than overwhelming amounts of metrics.

What is the Assessment Reinvention Check?

It is a simple tool educators can use to evaluate an existing assessment by asking three key questions: Is it authentic? Is there a chance to improve? Is the data actionable?

00:00 - Why Assessment Must Change

01:32 - AI & The Evidence Problem

04:28 - Three Shifts for Better Assessment

08:01 - The Assessment Reinvention Check

09:09 - Reflection & Key Takeaways

11:09 - Resource & Ways To Support

Why Assessment Must Change

Jackie Pelegrin

Hello, and welcome to the Designing with Love Podcast. I am your host, Jackie Pelegrin, where my goal is to bring you information, tips, and tricks as an instructional designer. Hello, instructional designers and educators. Welcome to episode 169 of the Designing with Love Podcast. Today we are continuing our series, Future Ready Learning, Designing Education for What Comes Next. In our last episode, we explored the new rules of engagement and how we can create learning that is relevant, participatory, and worth the learner's attention. Today we are tackling something that sits at the heart of almost every learning experience, assessment. For a long time, assessment has often meant reaching the end of a unit, course, or training, and asking, did the learner pass? What score did they earn? Did they complete the assignment? Those questions still have a place, but future ready assessment asks us to go further. Can learners actually use what they learned? Can we see how their thinking developed? Can feedback help them improve before the learning experience is over? And can the data we collect tell us something useful without turning learners into numbers on a dashboard? That is where assessment is heading, toward learning that is more authentic, continuous, and data smart. So grab your notebook, a cup of coffee, and settle in as we explore this topic together.

AI & The Evidence Problem

Jackie Pelegrin

Here is today's future ready signal. Assessment is beginning to shift from measuring a final product toward gathering meaningful evidence of learning throughout the process. And artificial intelligence is accelerating that conversation. The 2026 EDUCAUS Horizon Report notes that AI is increasingly complicating traditional assessment and that institutions are moving toward more authentic and process-based demonstrations of learning. A separate 2026 EduCause study surveyed 438 faculty and staff who actively design or deliver assessments and found that AI is already changing assessment practices in higher education. But this conversation is bigger than AI. For years, educators have known that one high-stakes exam or one polished final product does not always tell us everything we need to know about learning. A learner might memorize enough information to pass a test and forget it soon afterward. Another learner might understand the material but struggle with one particular testing format. And today, a learner might use AI to create a polished final product that reveals very little about how they actually thought through the task. So the question is changing. Instead of asking only what did the learner produced, we also need to ask, what evidence shows that learning actually happened? This matters because assessment influences how learners approach learning. If the only thing that counts is one final exam, learners may naturally focus on preparing for that exam. If the only thing being graded is the final product, they may focus primarily on producing the product. But if assessment includes practice, feedback, revision, explanation, and application, we send a different message. We tell learners the process matters too. This is where formative assessment becomes especially valuable. The OECD describes formative assessment and feedback as an ongoing process of identifying where learners are in relation to the desired outcome, providing feedback, and adapting instruction to help them move forward. It also notes strong research consensus that these practices can have a significant positive impact on learning. That is assessment doing more than measuring. It is assessment supporting learning. And when we add authentic tasks and useful learning data to that process, assessment can become much more informative for both learners and educators. Today's design shift is move from assessment as a final checkpoint to assessment as evidence, feedback, and direction. There are three shifts that can help us

Three Shifts for Better Assessment

Jackie Pelegrin

get there. Shift number one, from recall to authentic evidence. The first shift is moving from asking learners primarily to recall information toward giving them opportunities to demonstrate what they can do with it. That does not mean quizzes or knowledge checks disappear. Foundational knowledge matters, but sometimes the strongest evidence comes from application. Instead of only asking a learner to identify the steps of resolving a workplace conflict, we might give them a scenario and ask them to choose and justify a response. Instead of only asking students to explain ethical AI use, we might give them an AI-generated output and ask them to evaluate its accuracy, bias, and appropriateness. Those tasks give richer evidence. Future ready assessment asks, can the learner use what they know in a meaningful context? Shift number two, from one big moment to continuous evidence. The second shift is moving from one large assessment event towards smaller opportunities to see learning develop over time. Imagine assessment as a series of snapshots. One early activity shows what learners already understand. A practice activity shows where they are struggling. Feedback gives them direction. A revision shows whether they can use the feedback, and later application shows whether they can transfer the learning. Now we have a much richer picture than one score at the end. Continuous assessment does not mean constantly grading learners. That sounds exhausting for everyone. It means creating purposeful checkpoints where learners and educators can see progress. Those checkpoints might include a short knowledge check, scenario, draft, pure feedback, self-assessment, reflection, quick demonstration, or a revision. The important thing is that the information has somewhere to go. Assessment should create an opportunity for a next step. Shift number three, from more data to smarter data. The third shift is moving from simply collecting more learner data toward using data that actually helps us make decisions. Digital learning environments can give us enormous amounts of information, such as completion rates, quiz scores, time spent, attempts, clicks, progress, and patterns. But more data does not automatically mean better insight. If a dashboard tells us a learner clicked around 12 times, so what? What can we actually do with that information? Data becomes useful when it helps answer questions such as, where are learners struggling? Which concept may need another explanation? Who might benefit from additional practice? Are learners making progress toward the outcome? Is part of the learning experience creating unnecessary difficulties? OECD research notes that learning analytics can support goal setting and progress monitoring, particularly when combined with educator guidance. That last part matters. Being data smart does not mean letting an algorithm decide everything. It means combining useful evidence with human interpretation. And it also means being thoughtful about privacy. We should collect data because it helps support learning, not simply because the technology allows us to collect it.

The Assessment Reinvention Check

Jackie Pelegrin

Here's something simple you can try this week. Choose one assessment you currently use, then run it through the assessment reinvention check, and ask yourself three questions. Question number one, is it authentic? Does the assessment ask learners to do something meaningful with what they know? Where appropriate, could it include a decision, scenario, application, explanation, or real-world task? Question number two, is there a chance to improve? Does assessment happen early enough for feedback to make a difference? Could learners practice, receive feedback, revise, or try again before the final evaluation? Question number three, is the data actionable? What information does the assessment give you or the learner? And most importantly, what will someone do differently because of that information? If the answer is nothing, we may be collecting data without creating much value. Authentic, continuous, and data smart. Those three questions can help turn assessment from an endpoint into part of the learning process itself.

Reflection & Key Takeaways

Jackie Pelegrin

Before we close, here is one reflection question to carry with you. Does my assessment simply tell me whether a learner succeeded, or does it help the learner become more successful? That distinction gets to the heart of this episode. Assessment still needs rigor. Standards still matter. Evidence still matters. But assessment can be rigorous and developmental. It can measure learning while also helping to create more learning. As we wrap up, here are the key takeaways from today's episode. First, future ready assessment focuses on meaningful evidence of what learners know and can do. Second, authentic assessment gives learners opportunities to apply knowledge in relevant contexts. Third, assessment does not have to wait until the end. Purposeful checkpoints, feedback, and revision can reveal learning as it develops. Fourth, moral learner data is not automatically better. Data should be actionable, ethical, and connected to decisions that support learning. And finally, assessment should not simply answer, did the learner get it? Whenever possible, it should also help answer, what will help the learner move forward? Here is an inspiring quote by John Dewey. Failure is instructive. The person who really thinks learners learn quite as much from his failures as from his successes. And that reminds us of something important about assessment. A mistake does not have to be the end of the learning story. It can be information. A first attempt can reveal a gap. Feedback can provide direction. A second attempt can show growth. An assessment can become less about catching learners at one moment in time and more about helping them understand where they are, where they need to go, and how they can get there. That is assessment reinvented.

Resource & Ways To Support

Jackie Pelegrin

To help you apply what we discussed today, I've created an interactive companion resource called the Future Ready Design Brief, Assessment Reinvented. Inside the brief, you will use the Assessment Reinvention Check to examine whether one of your assessments is authentic, continuous, and data smart. And if this episode helped you rethink the role assessment can play in learning, please share it with another educator, instructional designer, trainer, or learning leader who is designing assessments for a changing learning environment. These conversations are better when we are learning and designing together. In the next episode of our Future Ready Learning series, we will continue exploring the shifts shaping how we design education for what comes next. Thank you for joining me today. Until next time, keep learning, keep growing, and keep designing with love. Thank you for taking some time to listen to this podcast episode today. Your support means the world to me. If you'd like to help keep the podcast going, you can share it with a friend or colleague, leave a heartfelt review, or offer a monetary contribution. Every act of support, big or small, makes a difference, and I'm truly thankful for you.