社区黑料

Explore

Carnegie, ETS Team Up to Develop Competency-Based Assessments

Amid a tough market for testing, two leading players in education are collaborating on a project to measure academic skills differently

Eamonn Fitzmaurice / T74

Get stories like this delivered straight to your inbox. Sign up for 社区黑料 Newsletter

Two major players in K鈥12 education launched a joint effort last month to develop new assessments that could help shift schools鈥 focus away from traditional 鈥渟eat time鈥 requirements and toward more accurate measures of mastery over academic content.  

The new tests, to be created by the Educational Testing Service and the Carnegie Foundation for the Advancement of Teaching, are meant to usher in competency-based forms of schooling that would allow students to proceed through academic material at their own pace. Leaders of both organizations hope they will also capture a broader array of non-cognitive qualities, like teamwork and relatability, that are highly prized in the modern workforce but undetectable through conventional academic metrics like grade point average or school attendance. 

The adoption of more personalized instruction and assessment has faced a key obstacle in the form of , the namesake foundation鈥檚 strict definition of annual credit hours that students must accrue to demonstrate their grasp of material. (The calculation essentially breaks down to one hour of seat time per day, per subject, for 24 weeks.) Though largely unknown outside the education world, many high schools and universities have based their academic requirements on the Carnegie Unit . 

But Timothy Knowles, the foundation鈥檚 president, said that while the Carnegie Unit had served a useful purpose at one point, new discoveries in neuroscience and cognitive psychology have proven that pupils learn different subjects at highly variable rates. What鈥檚 more, he added, the capacity now exists to test for valuable qualities that were previously invisible to admissions officers and employers.  

鈥淲e’re in a position to do something that we hadn’t before,鈥 Knowles said. 鈥淯nlike 20 years ago, we can actually reliably measure the skills that we know are predictive of success in postsecondary education and work.鈥

Competency-based learning and assessment has long been theorized as a preferable alternative to existing educational models, which critics describe as too standardized to deliver instruction to individual students with vastly divergent levels of academic preparation. Instead, they allege, the status quo came to reflect the production processes of 20th-century industry, with students replacing widgets as the product. In , Knowles himself telegraphed his desire to phase out the Carnegie Unit, calling time a 鈥渃rude鈥 metric to determine educational attainment.

Carnegie Foundation President Timothy Knowles and Educational Testing Service CEO Amit Sevak at ASU+GSV summit in April.

With a range of philanthropic and education-focused advocates backing the movement, has promoted some version of competency-based policies. Those efforts hit in Maine, where high school graduation requirements were refigured over the last decade to emphasize proficiency on subject material. But disputes over the definition of proficiency and teachers鈥 differing grading standards led many to question the new approach, with legislators later backing away from the competency-based model.

Similarly rocky transitions were seen in and , which attempted similar shifts. The central puzzle facing critics of the current model (i.e., calendar-centered requirements and standardized assessment) is what will come to supplant it. 

Scott Marion, president of the , said that the challenge in executing the hoped-for switch to competency-based learning lay in designing realistic measures of achievement to replace existing tests. To deliver on advocates鈥 promises, he observed, such measures would need to be both tailored to individual students and academically credible.

鈥淐ompetency-based assessment is not for the faint of heart,鈥 Marion said. 鈥淚t’s being done quite poorly in a lot of places. So if ETS and Carnegie can bring a little more rigor to it, it might be good.”

With interest in competency-based approaches growing, more players have leapt into the field, with the best-known among them that developed a 鈥渕astery transcript.鈥 The project has gained adherence among high schools over the last year.  

The ETS-Carnegie proposal is also emerging at a time when traditional high school admissions exams, such as the SAT and ACT, have lost significant market share. Both the aftereffects of the pandemic and concerns about inequitable outcomes from standardized testing to go test-optional in the last few school years. With those leading indicators of secondary achievement potentially passing from the scene, demand is expected to rise for measures that could take their place.  

ETS, which administers the widely used GRE, PRAXIS, and TOEIC tests, during and after the pandemic.

Perhaps the biggest question hanging over the newly announced partnership is the proposed measurement of not just cognitive and behavioral skills 鈥 including everything from comprehension of math content to teamwork and leadership 鈥 but so-called 鈥渁ffective鈥 skills as well. As described by ETS head Amit Sevak at the educational technology conference ASU-GSV, such skills could include something like emotional intelligence, or the ability to successfully convey sincerity and empathy to others. Just how those kinds of competencies can be conveyed to students, let alone measured by third parties, is debatable even to backers of competency-based instruction.

Michael Horn, a cofounder of Harvard鈥檚 Clayton Christensen Institute for Disruptive Education, said he would be watching the development of such measures carefully.

鈥淭his part, from my reading of the literature on assessment, is both unproven and underdeveloped. So the how is going to be very important,鈥 Horn said. 鈥淚’m going to be very curious to see what the investments look like as they go forward, and I hope they don’t overpromise.鈥

While no concrete timeline has been released for the conception of the new suite of assessments, Carnegie and ETS to conduct a multi-state pilot that could begin as early as next year. In an interview, Sevak said he envisioned students being able to access a digital 鈥渢ranscript鈥 detailing their ongoing growth in areas like collaboration and creativity. Real-time data could build their awareness of their comparative strengths and weaknesses, he added.

鈥淭hat more holistic approach is in contrast to much of the assessments in K鈥12 and higher education, which are really cognitive-driven and tied to logic and reason,鈥 Sevak said. We’re looking at a more holistic approach that is more tied to the future of work.鈥

Did you use this article in your work?

We鈥檇 love to hear how 社区黑料鈥檚 reporting is helping educators, researchers, and policymakers.

Republish This Article

We want our stories to be shared as widely as possible 鈥 for free.

Please view 社区黑料's republishing terms.





On 社区黑料 Today