assessment

13 Formative Assessments That Inspire Creativity — from edutopia.org by Paige Tutt
Sometimes mixing in formative assessments that go a step beyond exit slips and low-stakes quizzes can inject some fun—and creativity—into learning.

Excerpt:

Quick checks for understanding aren’t new, of course, but when time allows, occasionally injecting an element of creativity into formative assessments can deliver unexpected benefits. For example—regardless of a student’s artistic talent—research suggests that drawing the information they’re learning can increase student recall by nearly double. And when kids are encouraged to tap into their imagination to show what they know, they tend to ask more innovative questions of themselves, brainstorm fresh solutions to problems, and synthesize material in original and surprising ways.

Here are 13 formative assessment strategies that lean into creativity—inspired by the work of several Edutopia contributors, and from Finley’s handy list of quick checks for understanding.

Also see:

Is This Elementary School Near Pittsburgh the Future of Education? — from smithsonianmag.com by Kellie B. Gormly; with thanks to Tom Vander Ark out on Twitter for this resource
Ehrman Crest Elementary and Middle School is an innovative blend of children’s museum and classroom

Excerpt (emphasis DSC):

At Seneca Valley’s Ehrman Crest Elementary and Middle School, K-6 students are benefiting from an unusual collaboration. School leaders, architects and the Children’s Museum of Pittsburgh teamed up on the $63 million project, which opened in August 2022 after 790 construction days. With a student capacity of 1,400, the 200,000-square-foot facility takes a novel approach, forgoing the traditional school design for the playful, interactive, colorful elements of a children’s museum. Time magazine declared it one of the “Best Inventions of 2022.”
…
Matilda McQuaid, acting curatorial director at Cooper Hewitt, Smithsonian Design Museum in New York City, says this is the first time she has heard of a museum collaborating with a school to create a new environment from the ground up.

From DSC:
I love this collaboration — a children’s museum and a school district! — and the energy and creativity throughout this learning space!

17 Engaging Taxonomy Activities — from teachingexpertise.com

Students Need More Exercise. Here’s How to Add Activity Without Disrupting Learning — from edweek.org by Sarah D. Sparks

5 Ways to Inspire a Love for Learning in Students — from edweek.org by Elizabeth Heubeck

Introducing Q-Chat, the world’s first AI tutor built with OpenAI’s ChatGPT [Bayer]

On 03/06/2023, in 21st century, 24x7x365 access, Artificial Intelligence / Machine Learning / Deep Learning / Algorithms, assessment, digital learning, education, education technology, emerging technologies, engagement / engaging students, experimentation, game-changing environment, homeschooling/homeschoolers, human-computer interaction (HCI), ideas, innovation, instructional design, intelligent systems, intelligent tutoring, interactivity, K-12 related, languages and translation, learner profiles, learning, learning agents, learning ecosystem, Learning Experience Design, Learning from the Living [Class] Room, learning preferences, more voice more choice more control, participation, personalized/customized learning, platforms, productivity / tips and tricks, story, storytelling, student-related, teachers, teaching & learning, tools, vendors, virtual tutoring, vision/possibilities, by Daniel Christian

Introducing Q-Chat, the world’s first AI tutor built with OpenAI’s ChatGPT — from quizlet.com by Lex Bayer

Excerpt:

Modeled on research demonstrating that the most effective form of learning is one-on-one tutoring1, Q-Chat offers students the experience of interacting with a personal AI tutor in an effective and conversational way. Whether they’re learning French vocabulary or Roman History, Q-Chat engages students with adaptive questions based on relevant study materials delivered through a fun chat experience. Pulling from Quizlet’s massive educational content library and using the question-based Socratic method to promote active learning, Q-Chat has the ability to test a student’s knowledge of educational content, ask in-depth questions to get at underlying concepts, test reading comprehension, help students learn a language and encourage students on healthy learning habits.

Three Ways to Deal with Learners Who Skip the Content & Go to the Quiz [Kuhlmann]

On 02/23/2023, in adult learning, assessment, corporate universities / corporate training, instructional design, learning, Learning Experience Design, training / L&D, by Daniel Christian

Three Ways to Deal with Learners Who Skip the Content & Go to the Quiz — from blogs.articulate.com by Tom Kuhlmann

Excerpt:

Quiz Tip #1: Provide a Pre-Test
Don’t fight skipping to the quiz. Instead, put it up front. Give the learners who know the content the opportunity to prove it upfront.

If they can pass the quiz, then they demonstrate they know the content (or at least to the level that you’re quizzing). Pass the quiz, get credit for completion. Don’t pass the quiz, go to page 1 of the course.

On a somewhat relevant note, see:

Creating Better Video For Learning, Part 3 — from elearningindustry.com by Patti Shank

Summary:

Which principles are valuable for making instructional video better for mental processing? Part 3 of my series on better video for learning primarily discusses processing issues and Mayer’s (2021) and Brame’s (2016) instructional video design principles.

Start Building Your Knowledge About Artificial Intelligence — from learningguild.com by Bill Brandon

Excerpt:

In this article I have listed some resources that I believe will help readers get started on the journey toward more fully understanding the technology and its applications to the field of learning and development.

Five Predictions for the Future of Learning in the Age of AI [Lee Skates]

On 02/10/2023, in 21st century, 24x7x365 access, Artificial Intelligence / Machine Learning / Deep Learning / Algorithms, assessment, credentialing, education technology, emerging technologies, experimentation, future, personalized/customized learning, United States, vendors, by Daniel Christian

Five Predictions for the Future of Learning in the Age of AI — from a16z.com by Anne Lee Skates

Excerpts:

Seeing as education is one of AI’s first consumer use cases, and programs like ChatGPT are how millions of kids, teachers, and administrators will be introduced to AI, it is critical that we pay attention to the applications of AI and its implications for our lives. Below, we explore five predictions for AI and the future of learning, knowledge, and education.

Introducing: ChatGPT Edu-Mega-Prompts [Hardman] + several other items re: AI

On 02/06/2023, in adjunct faculty, Artificial Intelligence / Machine Learning / Deep Learning / Algorithms, assessment, bots, colleges, community colleges, content development, aggregation, repositories, corporate / business world, corporate universities / corporate training, digital audio, education, education technology, emerging technologies, faculty, higher education, ideas, innovation, instructional design, intelligent systems, intelligent tutoring, journalism, K-12 related, languages and translation, law schools, learning, learning agents, learning ecosystem, Learning Experience Design, learning theories, liberal arts, memory, Natural Language Processing (NLP), open courseware and systems, pedagogy, productivity / tips and tricks, psychology, skills, streams of content, teachers, teaching & learning, tools, training / L&D, vision/possibilities, voice recognition / voice enabled interfaces, by Daniel Christian

Introducing: ChatGPT Edu-Mega-Prompts — from drphilippahardman.substack.com by Dr. Philippa Hardman; with thanks to Ray Schroeder out on LinkedIn for this resource
How to combine the power of AI + learning science to improve your efficiency & effectiveness as an educator

From DSC:
Before relaying some excerpts, I want to say that I get the gist of what Dr. Hardman is saying re: quizzes. But I’m surprised to hear she had so many pedagogical concerns with quizzes. I, too, would like to see quizzes used as an instrument of learning and to practice recall — and not just for assessment. But I would give quizzes a higher thumbs up than what she did. I think she was also trying to say that quizzes don’t always identify misconceptions or inaccurate foundational information.

Excerpts:

The Bad News: Most AI technologies that have been built specifically for educators in the last few years and months imitate and threaten to spread the use of broken instructional practices (i.e. content + quiz).

The Good News: Armed with prompts which are carefully crafted to ask the right thing in the right way, educators can use AI like GPT3 to improve the effectiveness of their instructional practices.

As is always the case, ChatGPT is your assistant. If you’re not happy with the result, you can edit and refine it using your expertise, either alone or through further conversation with ChatGPT.

For example, once the first response is generated, you can ask ChatGPT to make the activity more or less complex, to change the scenario and/or suggest more or different resources – the options are endless.

Philippa recommended checking out Rob Lennon’s streams of content. Here’s an example from his Twitter account:

Everyone’s using ChatGPT.

But almost everyone’s STUCK in beginner mode.

10 techniques to get massively ahead with AI:

(cut-and-paste these prompts?)

— Rob Lennon ? | Audience Growth (@thatroblennon) January 3, 2023

Also relevant/see:

3 Trends That May Unlock AI’s Potential for L&D in 2023 — from learningguild.com by Juan Naranjo

Excerpts:

AI-assisted design and development work
This is the trend most likely to have a dramatic evolution this year.
…
Solutions like large language models, speech generators, content generators, image generators, translation tools, transcription tools, and video generators, among many others, will transform the way IDs create the learning experiences our organizations use. Two examples are:

1. IDs will be doing more curation and less creation:

Many IDs will start pulling raw material from content generators (built using natural language processing platforms like Open AI’s GPT-3, Microsoft’s LUIS, IBM’s Watson, Google’s BERT, etc.) to obtain ideas and drafts that they can then clean up and add to the assets they are assembling. As technology advances, the output from these platforms will be more suitable to become final drafts, and the curation and clean-up tasks will be faster and easier.
Then, the designer can leverage a solution like DALL-E 2 (or a product developed based on it) to obtain visuals that can (or not) be modified with programs like Illustrator or Photoshop (see image below for Dall-E’s “Cubist interpretation of AI and brain science.”

2. IDs will spend less, and in some cases no time at all, creating learning pathways

AI engines contained in LXPs and other platforms will select the right courses for employees and guide these learners from their current level of knowledge and skill to their goal state with substantially less human intervention.

The Creator of ChatGPT Thinks AI Should Be Regulated — from time.com by John Simons

Excerpts:

Somehow, Mira Murati can forthrightly discuss the dangers of AI while making you feel like it’s all going to be OK.
…
A growing number of leaders in the field are warning of the dangers of AI. Do you have any misgivings about the technology?

This is a unique moment in time where we do have agency in how it shapes society. And it goes both ways: the technology shapes us and we shape it. There are a lot of hard problems to figure out. How do you get the model to do the thing that you want it to do, and how you make sure it’s aligned with human intention and ultimately in service of humanity? There are also a ton of questions around societal impact, and there are a lot of ethical and philosophical questions that we need to consider. And it’s important that we bring in different voices, like philosophers, social scientists, artists, and people from the humanities.

Whispers of A.I.’s Modular Future — from newyorker.com by James Somers; via Sam DeBrule

Excerpts:

Gerganov adapted it from a program called Whisper, released in September by OpenAI, the same organization behind ChatGPTand dall-e. Whisper transcribes speech in more than ninety languages. In some of them, the software is capable of superhuman performance—that is, it can actually parse what somebody’s saying better than a human can.
…
Until recently, world-beating A.I.s like Whisper were the exclusive province of the big tech firms that developed them.

Ever since I’ve had tape to type up—lectures to transcribe, interviews to write down—I’ve dreamed of a program that would do it for me. The transcription process took so long, requiring so many small rewindings, that my hands and back would cramp. As a journalist, knowing what awaited me probably warped my reporting: instead of meeting someone in person with a tape recorder, it often seemed easier just to talk on the phone, typing up the good parts in the moment.

From DSC:
Journalism majors — and even seasoned journalists — should keep an eye on this type of application, as it will save them a significant amount of time and/or money.

Microsoft Teams Premium: Cut costs and add AI-powered productivity — from microsoft.com by Nicole Herskowitz

Excerpt:

Built on the familiar, all-in-one collaborative experience of Microsoft Teams, Teams Premium brings the latest technologies, including Large Language Models powered by OpenAI’s GPT-3.5, to make meetings more intelligent, personalized, and protected—whether it’s one-on-one, large meetings, virtual appointments, or webinars.

Unbundled: Designing Personalized Pathways for Every Learner [Nate McClennen & Co.]

On 01/31/2023, in assessment, Blockchain, change, changing business models, competency-based learning/education, content development, aggregation, repositories, credentialing, Design Thinking, education, education reform, engagement / engaging students, ideas, innovation, instructional design, K-12 related, leadership, learner profiles, learning, learning agents, learning ecosystem, Learning Experience Design, Learning from the Living [Class] Room, learning hubs & pods & microschooling, learning preferences, love of learning, marketplaces, microlearning, more voice more choice more control, motivation, new business models, online learning, participation, passions, personalized/customized learning, platforms, reinvent, society, streams of content, student-related, teachers, teaching & learning, technology (general), ubiquitous learning, United States, user experience (UX), vendors, vision/possibilities, vocational / trades, youth, by Daniel Christian

Unbundled: Designing Personalized Pathways for Every Learner — from gettingsmart.com by Nate McClennen “with contributions from the Getting Smart team and numerous friends and partners in the field”

Excerpts:

In this publication, we articulate the critical steps needed to unbundle the learning ecosystem, build core competencies, design learning experiences, curate new opportunities, and rebundle these experiences into coherent pathways.
.

Vision

Every learner deserves an unlimited number of unbundled opportunities to explore, engage, and define experiences that advance their progress along a co-designed educational pathway. Each pathway provides equitable and personalized access to stacked learning experiences leading to post-secondary credentials and secure family-sustaining employment. Throughout the journey, supportive coaches focus on helping learners build skills to navigate with agency. In parallel, learners develop foundational skills (literacy, math), technical skills, and durable skills and connect these to challenging co-designed experiences. The breadth and depth of experiences increase over time, and, in partnership, learners and coaches map progress towards reaching community-defined goals. This vision is only enabled by an unbundled learning ecosystem.
…

Recommendations

Solutions already exist in the ecosystem and need to be combined and scaled. Funding models (like My Tech High), badging/credentialing at the competency level (like VLACS), coaching models (like Big Thought), and open ecosystems (like NH Learn Everywhere) provide an excellent foundation. Thus, building unbundled systems has already begun but needs systemic changes to become widely available and accepted.

1. 1. Build a robust competency-based system.
  2. Create a two-way marketplace for unbundled learning.
  3. Implement policy to support credit for out-of-system experiences.
  4. Invest in technology infrastructure for Learning and Employment Records.
  5. Design interoperable badging systems that connect to credentials.

Virtual Exam Case Primes Privacy Fight Over College Room Scans [Witley]

On 01/31/2023, in assessment, colleges, community colleges, education technology, higher education, instructional design, IT in HE, law schools, legislatures / government / legal, platforms, policy, tools, United States, universities, vendors, videoconferencing, web-based collaboration, by Daniel Christian

Virtual Exam Case Primes Privacy Fight Over College Room Scans — from news.bloomberglaw.com by Skye Witley

Cleveland State case centers on remote proctoring software
Fourth Amendment protections in question before Sixth Circuit

Excerpt:

A legal dispute over a university’s use of exam proctoring software that allegedly scanned students’ rooms is set to shape the scope of Fourth Amendment and privacy protections for online college tests.

Cleveland State University last week asked a federal appeals court in Cincinnati to review a district court finding that the “room scans” were unconstitutional searches. The case could influence how other students litigate their privacy rights and change how universities virtually monitor their students during exams, attorneys said.

Colleges consider overhauling grading system for freshmen to ease transition to higher learning — from mercurynews.com by Kate Hull
Supporters say ‘ungrading’ could result in less stress and a more level playing field for students from less rigorous high schools

Excerpt:

Dubbed “weed-out” or “gatekeeper” classes, they can be dream-crushing for many students — especially those hoping to enter the science, technology, engineering and math (STEM) fields. And a growing body of research says the courses can be particularly discriminatory toward historically excluded groups such as Latinos and Black and Indigenous people.

One possible remedy, some educators say, is “ungrading,” a style of teaching and assessment that seeks to evaluate students in other ways besides A-F letter grades — usually just in their freshman year.

“You’re trying to move the focus from a score to the learning,” said Robin Dunkin, who teaches biology and is the assistant faculty director at UCSC’s Center for Innovations in Teaching and Learning. “For that reason, it’s immensely powerful.”

Also relevant see the #Ungrading hashtag on Twitter, from which the below item was taken:

Any educators out there who are #ungrading in a standards-based grading school district? I’ve been studying @Jessifer’s work for a bit & I’d love to go full-implementation next year.

If you have any experience, let me know. I’d love to pick your brain! https://t.co/ClnwZsBdl9

— Adrian Neibauer, EdD (@MrNeibauer) January 25, 2023

Excerpts from Jesse Stommel’s Ungrading: an Introduction presentation:

Also relevant/see Robert Talbert’s Grading for Growth.

AI, Instructional Design, and OER [Wiley]

On 01/25/2023, in Artificial Intelligence / Machine Learning / Deep Learning / Algorithms, assessment, instructional design, learning ecosystem, open courseware and systems, pedagogy, teaching & learning, by Daniel Christian

AI, Instructional Design, and OER — from opencontent.org by David Wiley

Excerpt:

LLMs Will Make Creating the Content Infrastructure Significantly Easier, Faster, and Cheaper
LLMs will dramatically increase the speed of creating the informational resources that comprise the content infrastructure. Of course the drafts of these informational resources will need to be reviewed and improvements will need to be made – just as is the case with all first drafts – to insure accuracy and timeliness. But it appears that LLMs can get us 80% or so of the way to reasonable first drafts orders of magnitude faster, eliminating the majority of the expense involved in this part of the process. Here’s an example of what I’m talking about. Imagine you’re a SME who has been tasked with writing the content for an introductory economics textbook. (The following examples are from ChatGPT.)

Speaking of ID and higher education, also relevant/see:

5 Myths About Instructional Design in Higher Education — from drlukehobson.com by Luke Hobson
Fulfillment in Higher Education / Other Roles Besides Instructional Designer / Confused Subject Matter Experts — from drlukehobson.com by Luke Hobson

Education is about to radically change: AI for the masses [McClennen & Dené Poth]

On 01/07/2023, in 21st century, 24x7x365 access, Artificial Intelligence / Machine Learning / Deep Learning / Algorithms, assessment, Bias | Diversity Equity & Inclusion (DE&I), bots, change, copyright/ownership/NFTs, education, education reform, education technology, emerging technologies, experimentation, future, game-changing environment, human-computer interaction (HCI), ideas, innovation, instructional design, intelligent systems, intelligent tutoring, K-12 related, learner profiles, learning, learning agents, learning ecosystem, Learning Experience Design, Learning from the Living [Class] Room, more voice more choice more control, new business models, Personal Learning Networks (PLNs), platforms, society, student-related, teachers, teaching & learning, United States, vendors, vision/possibilities, youth, by Daniel Christian

Education is about to radically change: AI for the masses — from gettingsmart.com by Nate McClennen and Rachelle Dené Poth

Key Points:

AI already does and will continue to impact education – along with every other sector.
Innovative education leaders have an opportunity to build the foundation for the most personalized learning system we have ever seen.

Action

Education leaders need to consider these possible futures now. There is no doubt that K-12 and higher ed learners will be using these tools immediately. It is not a question of preventing “AI plagiarism” (if such a thing could exist), but a question of how to modify teaching to take advantage of these new tools.

From DSC:
They go on to list some solid ideas and experiments to try out — both for students and for teachers. Thanks Nate and Rachelle!

Also from Rachelle, see:

How Can We Prepare K-12 Students for the Future? — from rdene915.com by Rachelle Dené Poth

GPT Takes the Bar Exam — from papers.ssrn.com by Michael James Bommarito and Daniel Martin Katz; with thanks to Gabe Teninbaum for his tweet on this

Excerpt from the Abstract (emphasis DSC):

While our ability to interpret these results is limited by nascent scientific understanding of LLMs and the proprietary nature of GPT, we believe that these results strongly suggest that an LLM will pass the MBE component of the Bar Exam in the near future.

LLM — Large Language Model
MBE — Multistate Bar Examination

14 charts this year that helped us better understand COVID’s impact on students, teachers, & schools — from the 74million.org by Kevin Mahnken

Excerpt:

By the end of last year, a steady trickle of research had already begun to reveal the harm wrought by prolonged school closures and the transition to virtual instruction. But this fall brought the most definitive evidence yet of the scale of learning lost over more than two years of COVID-disrupted schooling: fresh testing data from the National Assessment of Educational Progress, sometimes called the Nation’s Report Card, pointing to severe declines in core subjects.

From DSC:
While not minimizing the impact of the “learning loss” that is often written about, I do wonder if maybe the types of learning going on during the pandemic weren’t captured on a standardized test. Maybe the types of learning that our youth and families learned about help set them up for our present VOCA (Volatility, Uncertainty, Complexity and Ambiguity) world. And for a future where change doesn’t seem to be slowing down anytime soon.

Some of the types of learning that might not show up on the standardized tests include:

Dealing with life’s challenges and tumultuous changes
Being flexible
Adapting
The importance of having sufficient Internet connections and the corresponding hardware and software to keep on learning remotely
Where or to whom does one go to for help?

Also, as has been said elsewhere, bashing online learning or virtual instruction is often unfair. The remote learning that teachers and faculty members were thrust into lacked appropriate instructional design. Many teachers and faculty members hadn’t yet been trained on how to put together solid online-based courses and/or to use the tools that are required to offer such courses. Also, many in society didn’t have Internet access (or insufficient access), a quiet place to study and/or participate in online-based learning.

From DSC:
I’d like to thank Sarah Huibregtse for her post out on LinkedIn where she commented on and referenced the following item from Nicholas Thompson (CEO at The Atlantic):

Also relevant/see:

Also related/see the following item which I thank Sam DeBrule’s Machine Learnings newsletter for:

There’s a certain feeling that happens when a new technology adjusts your thinking about computing. Google did it. Firefox did it. AWS did it. iPhone did it. OpenAI is doing it with ChatGPT.

— Aaron Levie (@levie) December 4, 2022

Also, somewhat related, see the following item that Julie Johnston mentioned out on LinkedIn:

Top 10 conversational AI trends for 2023 — from linkedin.com by Kane Simms and Tim Holve, Tarren Corbett-Drummond, Arte Merritt, and Kevin Fredrick.

Excerpt:

In 2023, businesses will realise that, in order to get out of FAQ Land, they need to synchronise business systems together to deliver personalised transactional experiences for customers.

“We finally have the technologies to do all the things we imagined 10 years ago.”

MADE Podcast on Branching Scenarios [Tucker]

On 12/01/2022, in assessment, Canada, colleges, community colleges, corporate universities / corporate training, education technology, experimentation, higher education, human-computer interaction (HCI), instructional design, Learning Experience Design, multimedia, podcasting, tools, training / L&D, by Daniel Christian

MADE Podcast on Branching Scenarios — from christytuckerlearning.com by Christy Tucker
My interview for the MADE podcast on branching scenarios: when to use them, challenges, tools, planning, and getting started.

Excerpt:

MADE is the Media and Design in Education team for the University of Toronto. Inga Breede from this educational technology group recently interviewed me for their podcast. We talked about scenario-based learning and specifically about branching scenarios.

What we discussed
We covered several topics in our 20-minute conversation.

When should branching scenarios be used in learning experiences?
What are some of the challenges and limitations that designers typically come across when they’re building a branching scenario?
What are the key components to consider in the planning stage?
What are my favorite tools to use to build branching scenarios?
For learning designers who are interested in scenario building, where can they begin their journey of discovery?

ABA advances proposal to end LSAT requirements [Bauer-Wolf]

On 11/13/2022, in assessment, law schools, legal reform, United States, by Daniel Christian

ABA advances proposal to end LSAT requirements — from highereddive.com by Jeremy Bauer-Wolf

Dive Brief:

An American Bar Association governing body will vote next week whether to ax a requirement that ABA-accredited law schools use an entrance exam, like the Law School Admission Test, or LSAT, eroding the assessment’s long-standing influence in admissions.
A key ABA committee, the Strategic Review Committee, on Friday recommended the association end admissions test requirements.
If the governing board votes Nov. 18 to repeal assessment mandates, the ABA House of Delegates will be in line to finalize the new policy at its February meeting.

Learning Ecosystems

Three Ways to Deal with Learners Who Skip the Content & Go to the Quiz [Kuhlmann]

Five Predictions for the Future of Learning in the Age of AI [Lee Skates]

Virtual Exam Case Primes Privacy Fight Over College Room Scans [Witley]

AI, Instructional Design, and OER [Wiley]

GPT to likely pass the Bar Exam in the near future [Bommarito & Katz]

MADE Podcast on Branching Scenarios [Tucker]

ABA advances proposal to end LSAT requirements [Bauer-Wolf]

Categories

Tags