DailyDirt: Can Computers Grade Written Essays?
from the urls-we-dig-up dept
Technology aimed at education could really benefit an incredible number of students by making classes and learning (potentially) a more pleasant and efficient experience. Computers can't replace a really good human teacher, but they can make it easier for good human teachers to reach a vast audience of students. Massively open online courses (MOOCs) promise to change how education works, but there are some technological tools that might be missing. It's pretty straightforward to test students on math problems in an automated way, but grading essays is a much more daunting problem. There have been some calls for automated grading software from various organizations (like the Hewlett Foundation). But at the same time, the National Council of Teachers of English argues that computers simply can't grade essays. Here are just a few more links on this debate over the use of algorithms over English professors (or grad students).- EdX, the non-profit started by Harvard and MIT, is releasing some software to automagically grade human-written essays. Some see this software as just another tool for educators to use for more immediate feedback to students, while others are worried that these algorithms will be used incorrectly and lead to disastrous educational policies and outcomes. [url]
- There are studies that show algorithms are statistically comparable to humans when it comes to ranking essays on a 5 point scale. There are things machines can do better and things humans do better -- just make sure you know the differences and automated essay grading can be done productively in the right context. [url]
- Automated essay readers can grade 16,000 essays in 20 seconds. The Educational Testing Service is testing out automation, so students may soon be facing algorithmic grading for their college entrance exams. [url]
- Grading a few sentences can be harder than it might look. Professional (human) teachers are obviously better at interpreting the insights and ideas behind the words a student writes, but computers scale much better and never tire of horrible spelling mistakes or misplaced modifiers.... [url]
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: ai, algorithms, artificial intelligence, automation, education, edx, essays, ets, exams, grading, mooc, nlp, tests
Companies: harvard, hewlett foundation, kaggle, mit
Reader Comments
Subscribe: RSS
View by: Time | Thread
I imagine they'll start using this for grading bar exams soon...
[ link to this | view in chronology ]
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Here's an idea!
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re:
Nothing is as influential as a bureaucrat trying to preserve their own job. If it goes through without a return to sanity well you punished the morons behind it by making them unemployed and you aren't worse off. Not to mention the tax revenue saved. It is a heads you lose tails I win situation.
[ link to this | view in chronology ]
Re:
Swearing is illegal and you get a printout for each infraction. I'd better hurry and invest in paper companies before its cool.
[ link to this | view in chronology ]
Grading? Easy
[ link to this | view in chronology ]
Depends
It would take some smarts to do that, too. Neither would be satisfactory.
[ link to this | view in chronology ]
Re: Depends
Reminds me of a segment regarding the author of In Search of Excellence. He was a new professor on his first day, and he handed out the final exam to all of the students. A more senior professor was passing by and noticed this atrocity. He cornered his junior and remonstrated him for giving out the final exam. The new to the campus professor retorted, (to the best of my memory) "Not only am I giving them the final exam on the first day, I intend to spend the rest of the semester giving them the answers."
As an experienced employer, with at times thousands of employees, my philosophy on hiring is: I don't care what you know, I care what you can do! Education provides knowledge. Knowledge, TRAINING, AND EXPERIENCE provide skill. Skill is what one sells on the marketplace. Either to a new employer, or a customer.
Unfortunately, other employers are not so enlightened. They care what your grades are and what is on your Facebook page, and if those keywords weren't on the resume, we wouldn't even be talk'n.
For me, teach the student the basics (read'n, rite'n, and rithmitic) then teach them to think, make decisions, take stances, be critical without animosity, resolve issues, expand creativity (I wish art and music were required, but creativity can come elsewhere, even in math), and to 'do it, try it, fix it.
I care not what the grades were, I care what they can do, and if they might grow with us.
[ link to this | view in chronology ]
Re: Re: Depends
[ link to this | view in chronology ]
Re: Re: Depends
Evaluating the lower levels ranges from trivially easy to simple. As you look for higher-level skills, you begin to require expert judgment. I'll assert that expert judgment is almost impossible to implement as an algorithm.
I'm doing a MOOC atm. It is sitting squarely in the lower cognitive domains. It'll replace a bad teacher easily. It won't replace the best a university can do.
[ link to this | view in chronology ]
Re: Depends
Here's the NYT article about it:
http://www.nytimes.com/2012/04/23/education/robo-readers-used-to-grade-test-essays.html
And here's his top-scoring essay:
http://www.documentcloud.org/documents/346138-essay-awarded-a-top-grade-by-e-rater.html
I f nothing else, it's worth skimming through the essay. Among other things, it includes a line from Howl and claims that the union of teaching assistants is more powerful than the Freemasons (although less powerful than the Jedi Knights).
Textual analysis is hard. It can potentially test for writing style, but it can't test for comprehension or content.
[ link to this | view in chronology ]
Re: Re: Depends
but it kind of fits with the times: style over substance...
art guerrilla
aka ann archy
eof
[ link to this | view in chronology ]
Need to worry about people gaming the models
Yes, computers can apparently grade essays written for humans as well as underpaid and overworked graders do (which is badly). But once you start having computers actually grade the students, the students will start writing their essays to fool the computer graders (likely with help of computer programs)...
[ link to this | view in chronology ]
The day they write software that can recognize and appreciate a pun is the day they can dream about writing software that can recognize and appreciate a sound argument.
This sounds more like the kind of dumbing down we get from standardized testing. And I suppose if they really do want to reduce our children to mindless drones, then this is another step in the right direction
[ link to this | view in chronology ]
Assignment writer uk
[ link to this | view in chronology ]
essay
[ link to this | view in chronology ]
good
http://www.dreamfilm.ws/forfattare/edgar-wright
[ link to this | view in chronology ]
Great
http://www.123movies.biz/423-criminal-full-movie.html
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm mol
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thanks
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Thloolm
[ link to this | view in chronology ]
Streama Hundraettåringen som smet från notan och försvann
[ link to this | view in chronology ]
www.genvideos.ws
[ link to this | view in chronology ]
www.pubfilm.ws
[ link to this | view in chronology ]
pubfilm.ws
[ link to this | view in chronology ]
www.putlockers.la
[ link to this | view in chronology ]
Streama Film
http://gratis-filmer.tv Streama Film Online
[ link to this | view in chronology ]
MS Word has a disturbingly good auto-summary feature, but just because software can build a summary doesn't mean it can recognize a good one.
The day they're writing software that recognizes and appreciates a joke is the day they can dream of writing software that can recognize and appreciate a sound statement.
Watch online movies 2020 on 123Movies new site.
[ link to this | view in chronology ]