Tag Archives: artificial intelligence

Could AI ever replace diplomacy?

Posted on by

A thought from watching the impeachment proceedings: the relationship between major countries hinges on the personal interactions of a relatively small set of people on each side. The interests of the United States, a global power with more than 327 million people, come down to personal interactions between diplomats. However deep the Deep State might be, a small set of relationships matter for all countries in how they get along with other countries.

In the world of the Internet and computers, does it seem feasible to replace person-to-person diplomacy with Artificial Intelligence? Two humorous examples suggest this could be very hard:

1. The diplomacy built in to the computer game Civilization that never seems to work that well.

2. The arduous negotiations that can occur in the board game Diplomacy over relatively simple moves.

But, imagine the possibilities. A much reduced diplomatic staff! Quicker negotiations! Being able to blame an algorithm for mistakes rather than people!

Ultimately, would governments trust artificial intelligence to put their diplomatic fate in its hands?

The prospect of the automated grading of essays

Posted on by

As the American public debates the exploits of Watson (and one commentator suggests it should, among other things, sort out Charlie Sheen’s problem) how about turning over grading essays to computers? There are programs in the works to make this happen:

At George Mason University Saturday, at the Fourth International Conference on Writing Research, the Educational Testing Service presented evidence that a pilot test of automated grading of freshman writing placement tests at the New Jersey Institute of Technology showed that computer programs can be trusted with the job. The NJIT results represent the first “validity testing” — in which a series of tests are conducted to make sure that the scoring was accurate — that ETS has conducted of automated grading of college students’ essays. Based on the positive results, ETS plans to sign up more colleges to grade placement tests in this way — and is already doing so.

But a writing scholar at the Massachusetts Institute of Technology presented research questioning the ETS findings, and arguing that the testing service’s formula for automated essay grading favors verbosity over originality. Further, the critique suggested that ETS was able to get good results only because it tested short answer essays with limited time for students — and an ETS official admitted that the testing service has not conducted any validity studies on longer form, and longer timed, writing.

Such programs are only as good as the algorithm and method behind it. And it sounds like this program from ETS still has some issues. The process of grading is a skill that teachers develop. Much of this can be quantified and placed into rubrics. But I would also guess that many teachers develop an intuition that helps them quickly apply these important factors to work that they read and grade.

But on a broader scale, what would happen if the right programs could be developed? Could we soon reach a point where professors and teachers would agree that a program could effectively grade writing?