From DSC:
Low-stakes formative assessments offer enormous benefits and should be used extensively throughout K-12, higher education, L&D/corporate universities, in law schools, medical schools, dental schools, and more. 

Below are my notes from the following article – with the provided emphasis/bolding/highlighting via colors, etc. coming from me:

Duhart, Olympia. “The “F” Word: The Top Five Complaints (and Solutions) About Formative Assessment.” Journal of Legal Education, vol. 67, no. 2 (winter 2018), pp. 531-49. <– with thanks to Emily Horvath, Director of Academic Services & Associate Professor, WMU-Cooley Law School

 


 

“No one gets behind the wheel of a car for the first time on the day of the DMV road test. People know that practice counts.” (p. 531)

“Yet many law professors abandon this common-sense principle when it comes to teaching law students. Instead of providing multiple opportunities for practice with plenty of space to fail, adjust, and improve, many law school professors place almost everything on a single high-stakes test at the end of the semester.” (p. 531)

 

“The benefits of formative assessment are supported by cognitive science, learning theory, legal education experts, and common sense. An exhaustive review of the literature on formative assessment in various schools settings has shown that it consistently improves academic performance.” (p. 544)

 

ABA’s new formative assessment standards (see pg 23)
An emphasis on formative assessments, not just a mid-term and/or a final exam – which are typically called “summative assessments.”

“The reliance on a single high-stakes exam at the end of the semester is comparable to taking the student driver straight to the DMV without spending any time practicing behind the wheel of a car. In contrast, formative assessment focuses on a feedback loop. It provides critical information to both the students and instructor about student learning.” (p. 533)

“Now a combination of external pressure and a renewed focus on developing self-regulated lawyers has brought formative assessment front and center for law schools.” (p. 533)

“In fall 2016, the ABA implemented new standards that require the use of formative assessment in law schools. Standard 314 explicitly requires law schools to use both formative and summative assessment to “’measure and improve’ student learning.” (pgs. 533-534)

 

Standard 314. ASSESSMENT OF STUDENT LEARNING
A law school shall utilize both formative and summative assessment methods in its curriculum to measure and improve student learning and provide meaningful feedback to students.

 Interpretation 314-1
Formative assessment methods are measurements at different points during a particular course or at different points over the span of a student’s education that provide meaningful feedback to improve student learning. Summative assessment methods are measurements at the culmination of a particular course or at the culmination of any part of a student’s legal education that measure the degree of student learning.

 Interpretation 314-2

A law school need not apply multiple assessment methods in any particular course. Assessment methods are likely to be different from school to school. Law schools are not required by Standard 314 to use any particular assessment method.

 


From DSC:
Formative assessments use tests as a learning tool/strategy. They help identify gaps in students’ understanding and can help the instructor adjust their teaching methods/ideas on a particular topic. What are the learners getting? What are they not getting? These types of assessments are especially important in the learning experiences of students in their first year of law school.  All students need feedback, and these assessments can help give them feedback as to how they are doing.

Practice. Repetition. Feedback.  <– all key elements in providing a solid learning experience!


 

“…effective assessment practices are linked to the development of effective lawyers.” (pg. 535)

Low-risk formative assessment give students multiple opportunities to make mistakes and actively engage with the material they are learning.” (p. 537)

Formative assessments force the students to practice recall. This is very helpful in terms of helping students actually remember the information. The spaced out practice of forcing recall – no matter how much the struggle of recalling it – aids in retaining information and moving items into longer-term memory. (See Make It Stick: The Science of Successful Learning by Peter C. Brown, Henry L. Roediger III, & Mark A. McDaniel). In fact, according to this book’s authors, the more the struggle in recalling the information, the greater the learning.

Formative assessments can help students own their own learning. Self-regulation. Provide opportunities for students to practice meta-cognition – i.e., thinking about their thinking.

“Lawyers need to be experts at self-regulated learning.” (p. 541)

The use of numerous, low-stakes quizzes and more opportunities for feedback reduces test anxiety and can help with the mental health of students. Can reduce depression and help build a community of learners. (p. 542)

“Millennials prefer interactive learning opportunities, regular assessments, and immediate feedback.” (p. 544)

 


Ideas:


  • As a professor, you don’t have to manually grade every formative assessment. Technology can help you out big time. Consider building a test bank of multiple-choice questions and then drawing upon them to build a series of formative assessments. Have the technology grade the exams for you.
    • Digital quizzes using Blackboard Learn, Canvas, etc.
    • Tools like Socrative
  • Alternatively, have the students grade each other’s work or their own work. Formative assessments don’t have to be graded or count towards a grade. The keys are in learners practicing their recall, checking their own understanding, and, for the faculty member, perhaps pointing out the need to re-address something and/or to experiment with one’s teaching methods.
  • Consider the use of rubrics to help make formative assessments more efficient. Rubrics can relay the expectations of the instructors on any given assignment/assessment. Rubrics can also help TA’s grade items or even the students in grading each other’s items.
  • Formative assessments don’t have to be a quiz/test per se. They can be games, presentations, collaborations with each other.

 


For further insights on this topic (and more) from Northwestern University, see:

New ABA Requirements Bring Changes to Law School Classrooms, Creating Opportunity, and Chaos –from blog.northwesternlaw.review by Jacob Wentzel

Excerpt:

Unbeknownst to many students J.D. and L.L.M. students, our classroom experiences are embarking upon a long-term path toward what could be significant changes as a trio of ABA requirements for law schools nationwide begin to take effect.

The requirements are Standards 302, 314, and 315 , each of which defines a new type of requirement: learning outcomes (302), assessments (314), and global evaluations of these (315). According to Christopher M. Martin, Assistant Dean and Clinical Assistant Professor at Northwestern Pritzker School of Law, these standards take after similar ones that the Department of Education rolled out for undergraduate universities years ago. In theory, they seek to help law schools improve their effectiveness by, among other things, telling students what they should be learning and tracking students’ progress throughout the semester. Indeed, as a law student, it often feels like you lose the forest for the trees, imbibing immense quantities of information without grasping the bigger picture, let alone the skills the legal profession demands.

By contrast, formative assessment is about assessing students “at different points during a particular course,” precisely when many courses typically do not. Formative assessments are also about generating information and ideas about what professors do in the classroom. Such assessment methods include quizzes, midterms, drafts, rubrics, and more. Again, professors are not required to show students the results of such assessments, but must maintain and collect the data for institutional purposes—to help law schools track how students are learning material during the semester and to make long-term improvements.

 

And/or see a Google query on “ABA new formative assessment standards”

 

 

 

Skill shift: Automation and the future of the workforce — from mckinsey.com by Jacques Bughin, Eric Hazan, Susan Lund, Peter Dahlström, Anna Wiesinger, and Amresh Subramaniam
Demand for technological, social and emotional, and higher cognitive skills will rise by 2030. How will workers and organizations adapt?

Excerpt:

Skill shifts have accompanied the introduction of new technologies in the workplace since at least the Industrial Revolution, but adoption of automation and artificial intelligence (AI) will mark an acceleration over the shifts of even the recent past. The need for some skills, such as technological as well as social and emotional skills, will rise, even as the demand for others, including physical and manual skills, will fall. These changes will require workers everywhere to deepen their existing skill sets or acquire new ones. Companies, too, will need to rethink how work is organized within their organizations.

This briefing, part of our ongoing research on the impact of technology on the economy, business, and society, quantifies time spent on 25 core workplace skills today and in the future for five European countries—France, Germany, Italy, Spain, and the United Kingdom—and the United States and examines the implications of those shifts.

Topics include:
How will demand for workforce skills change with automation?
Shifting skill requirements in five sectors
How will organizations adapt?
Building the workforce of the future

 

 

From DSC:
How do we best help folks impacted by these changes reinvent themselves? And to what? What adjustments to our educational systems do we need to make in order to help people stay marketable and employed?

Given the pace of change and the need for lifelong learning, we need to practice some serious design thinking on our new reality.

 


 

The amount of retail space closing in 2018 is on pace to break a record — from cnbc.com by Lauren Thomas

  • Bon-Ton’s more than 200 stores encompass roughly 24 million square feet.
  • CoStar Group has calculated already more than 90 million square feet of retail space (including Bon-Ton) is set to close in 2018.
  • That’s easily on track to surpass a record 105 million square feet of space shuttered in 2017.

 


 

 

 

Transforming the Postsecondary Professional Education Experience — from by Mary Grush & Thomas Finholt

Excerpt:

So, among other factors currently influencing change, those are the predominate ones. I’ll sum it up this way: The tried-and-true residential model has worked so far, but a number of factors are forcing transformation: emerging technologies, new expectations about when learning will occur in a student’s lifespan, and the introduction of a whole new population of students that had never been imagined before.

Grush: What are your latest efforts or experiments in new professional education offerings that you see as part of this transformation? When did you make a start and what impacts do you see so far?
Finholt: The biggest transformation for us to date has been our entry into the MOOC space. That movement began with a few small trials, but it’s now rapidly expanding and may include, ultimately, full degree offerings. I would describe our period of experimentation with MOOCs to have started in 2013, gaining especially significant momentum in the past two years. Over the next couple of years, our efforts will expand even more dramatically, if we elect to offer fully online degrees. As a measure of the magnitude of impact of MOOCs so far, one of our MOOC specializations in the Python programming language is among the most popular offerings on Coursera — I believe that it has reached more than a million learners at this point. A significant fraction of those learners have opted to sit for an exam to get a certificate in Python programming.

 

 

One is, as announced at the March 6th Coursera meeting, that we have joined in a partnership with Coursera and the University of Michigan’s Office of Academic Innovation to design and get approved, a brand-new online master’s degree in Applied Data Science. 

 

 

 

From DSC:
Mary and Thomas’ solid article reminds me of a graphic I put together a while back:

 

 

 

 

“The process of obtaining postgraduate credentials is becoming something that one works on over the entire span of one’s career… Working professionals will have an array of punctuated intervals, if you will — periods of time when they work intensively to update their credentials.” (source)

 

 

 

 

Students are being prepared for jobs that no longer exist. Here’s how that could change. — from nbcnews.com by Sarah Gonser, The Hechinger Report
As automation disrupts the labor market and good middle-class jobs disappear, schools are struggling to equip students with future-proof skills.

Excerpts:

In many ways, the future of Lowell, once the largest textile manufacturing hub in the United States, is tied to the success of students like Ben Lara. Like many cities across America, Lowell is struggling to find its economic footing as millions of blue-collar jobs in manufacturing, construction and transportation disappear, subject to offshoring and automation.

The jobs that once kept the city prosperous are being replaced by skilled jobs in service sectors such as health care, finance and information technology — positions that require more education than just a high-school diploma, thus squeezing out many of those blue-collar, traditionally middle-class workers.

 

As emerging technologies rapidly and thoroughly transform the workplace, some experts predict that by 2030 400 million to 800 million people worldwide could be displaced and need to find new jobs. The ability to adapt and quickly acquire new skills will become a necessity for survival.

 

 

“We’re preparing kids for these jobs of tomorrow, but we really don’t even know what they are,” said Amy McLeod, the school’s director of curriculum, instruction and assessment. “It’s almost like we’re doing this with blinders on. … We’re doing all we can to give them the finite skills, the computer languages, the programming, but technology is expanding so rapidly, we almost can’t keep up.”

 

 

 

For students like Amber, who would rather do just about anything but go to school, the Pathways program serves another function: It makes learning engaging, maybe even fun, and possibly keeps her in school and on track to graduate.

“I think we’re turning kids off to learning in this country by putting them in rows and giving them multiple-choice tests — the compliance model,” McLeod said. “But my hope is that in the pathways courses, we’re teaching them to love learning. And they’re learning about options in the field — there’s plenty of options for kids to try here.”

 

 

 

Embracing Digital Tools of the Millennial Trade. — from virtuallyinspired.org

Excerpt:

Thus, millennials are well-acquainted with – if not highly dependent on – the digital tools they use in their personal and professional lives. Tools that empower them to connect and collaborate in a way that is immediate and efficient, interactive and self-directed. Which is why they expect technology-enhanced education to replicate this user experience in the virtual classroom. And when their expectations fall short or go unmet altogether, millennials are more likely to go in search of other alternatives.

 

 

From DSC:
There are several solid tools mentioned in this article, and I always appreciate the high-level of innovation arising from Susan Aldridge, Marci Powell, and the folks at virtuallyinspired.org.

After reading the article, the key considerations that come to my mind involve the topics of usability and advocating for the students’ perspective. That is, we need to approach things from the student’s/learner’s standpoint — from a usability and user experience standpoint. For example, a seamless/single sign-on for each of these tools would be a requirement for implementing them. Otherwise, learners would have to be constantly logging into a variety of systems and services. Not only is that process time consuming, but a learner would need to keep track of additional passwords — and who doesn’t have enough of those to keep track of these days (I realize there are tools for that, but even those tools require additional time to investigate, setup, and maintain).

So plug-ins for the various CMSs/LMSs are needed that allow for a nice plug-and-play situation here.

 

 

The number of Americans working for themselves could triple by 2020 — from work.qz.com by Amy Wang

Excerpt (emphasis DSC):

Americans are as eager to work as ever. Just no longer for somebody else.

According to FreshBooks, a cloud-based accounting company that has conducted a study on self-employment for two years, the number of Americans working for themselves looks to triple—to 42 million people—by 2020.

The trend, gauged in a survey of more than 2,700 full-time US workers in traditional, independent, and small business roles about their career plans, is largely being driven by millennial workers. FreshBooks estimates that of the next 27 million independent workers, 42% will be millennials. The survey, conducted with Research Now, also finds that Americans who already work for themselves are suddenly very content to keep doing so, with 97% of independent workers (up 10% from 2016) reporting no desire to return to traditional work.

 

 

From DSC:
With the continued trend towards more freelancing and the growth of a more contingent workforce…have our students had enough practice in selling themselves and their businesses to be successful in this new, developing landscape?

We need to start offering more courses, advice, and opportunities for practicing these types of skills — and the sooner the better!  I’m serious. Our students will be far more successful with these types of skills under their belt. Conversely, they won’t be able to persuade others and sell themselves and their businesses without such skills.

 

 

 

Michelle Weise: ‘We Need to Design the Learning Ecosystem of the Future’ — from edsurge.com  by Michelle Weise

Excerpts:

These days, education reformers, evangelists and foundations pay a lot of lip service to the notion of lifelong learning, but we do little to invest in the systems, architecture and infrastructure needed to facilitate seamless movements in and out of learning and work.

Talk of lifelong learning doesn’t translate into action. In fact, resources and funding are often geared toward the traditional 17- to 22-year-old college-going population and less often to working adults, our growing new-traditional student population.

We’ll need a different investment thesis: For most adults, taking time off work to attend classes at a local, brick-and-mortar community college or a four-year institution will not be the answer. The opportunity costs will be too high. Our current system of traditional higher education is ill-suited to facilitate flexible, seamless cost-effective learning pathways for these students to keep up with the emergent demands of the workforce.

Many adults may have no interest in coming back to college. Out of the 37 million Americans with some college and no degree, many have already failed one or twice before and will be wholly uninterested in experiencing more educational trauma.We can’t just say, “Here’s a MOOC, or here’s an online degree, or a 6- to 12-week immersive bootcamp.”

 

We have to do better. Let’s begin seeding the foundational elements of a learning ecosystem of the future—flexible enough for adults to move consistently in and out of learning and work. Enough talk about lifelong learning: Let’s build the foundations of that learning ecosystem of the future.

 

 

From DSC:
I couldn’t agree more with Michelle that we need a new learning ecosystem of the future. In fact, I have been calling such an effort “Learning from the Living [Class] Room — and it outlines a next generation learning platform that aims to deliver everything Michelle talks about in her solid article out at edsurge.com.

The Living [Class] Room -- by Daniel Christian -- July 2012 -- a second device used in conjunction with a Smart/Connected TV

 

Along these lines…I just saw that Amazon is building out more cashierless stores (and Walmart is also at work on introducing more cashierless stores.) Now, let’s say that you are currently a cashier. 2-5 years from now (depending upon where you’re currently working and which stores are in your community), what are you going to do? The opportunities for such a position will be fewer and fewer. Who can help you do what Michelle mentioned here:

Working learners will also need help articulating their learning goals and envisioning a future for themselves. People don’t know how to translate their skills from one industry to another. How does a student begin to understand that 30% of what they already know could be channeled into a totally different and potentially promising pathway they never even knew was within reach?

And that cashier may have had a tough time with K-12 education and/or with higher education. As Michelle writes:

Many adults may have no interest in coming back to college. Out of the 37 million Americans with some college and no degree, many have already failed one or twice before and will be wholly uninterested in experiencing more educational trauma. We can’t just say, “Here’s a MOOC, or here’s an online degree, or a 6- to 12-week immersive bootcamp.”

And like the cashier in this example…we are quickly approaching an era where, I believe, many of us will need to reinvent ourselves in order to:

  • stay marketable
  • keep bread and butter on the table
  • continue to have a sense of purpose and meaning in our lives

Higher ed, if it wants to remain relevant, must pick up the pace of experimentation and increase the willingness to innovate, and to develop new business models — to develop new “learning channels” so to speak. Such channels need to be:

  • Up-to-date
  • Serving relevant data and information– especially regarding the job market and which jobs appear to be safe for the next 5-10 years
  • Inexpensive/affordable
  • Highly convenient

 

 

 

 

Mapping the Trends on Our Doorstep: The Pace of Change Has Changed — from an article that I did out at — and with — evoLLLution.com [where LLL stands for lifelong learning]; my thanks to Mr. Amrit Ahluwalia, Managing Editor out at evolllution.com and to his staff as well!
The higher education industry has changed significantly over the past decade, and given the pace and significance of change hitting other industries as a result of technological advances, it’s fair to say the postsecondary space is ripe for further transformation.

 

From DSC:
From the perspective of those of us working within higher education, we see massive changes occurring in the corporate world, and we see innovations and changes also occurring in the world of K-12. Higher education should also be adapting, changing, questioning, and reflecting upon how we can best prepare our students for a rapidly changing workplace.

Below is another interesting item that I believe gives credence to the idea that we are now on an exponential pace of change. Companies are coming and going on the S&P Index…at an ever faster pace.

The 33-year average tenure of companies on the S&P 500 in 1964 narrowed to 24 years by 2016 and is forecast to shrink to just 12 years by 2027 (Chart 1).

 

Here is the video:

This is the transcript with the original graphs in it.

This is a nice PDF file from evoLLLution.com with the transcript, with some different graphics and some other

 

 

 

 
 

Looking for something?

Use the form below to search the site:

Still not finding what you're looking for? Drop a comment on a post or contact us so we can take care of it!

© 2018 | Daniel Christian