Channels ▼

Mark Nelson

Dr. Dobb's Bloggers

HAL Still Not Fully Baked

October 13, 2008

Most people who have studied Computer Science are well aware of the Turing Test.  This test was devised by Alan Turing to identify machines that appear to be as intelligent as a human being. The Wikipedia reference gives a nice summation:

A  human judge engages in a natural language conversation with one human and one machine, each of which try to appear human; if the judge cannot reliably tell which is which, then the machine is said to pass the test.

Because the Turing Test is considered such an important one,the Loebner Prize was created - it awards $2,000 in an annual competition, and will award a $100,000 prize to the first program that passes the test.

This Year's Results

This year's competition took place October 12 a the University of Reading. The contest methodology is pretty simple. 12 volunteers enter into split-screen conversations with two actors: one is a program, one is a human.  The tester is asked after five minutes to choose which of the two is a program.

The winner was a program called Elbot , which duped three of twelve judges, for a 25% success rate. Full transcripts are available , but you will need to install a PERL script in order to view the conversation in progress.

Conclusion

There is obviously a lot of work that needs to be done before we have a real winner in the Turing Test. Even when a program fools 6 judges in a five minute test, we will just be scratching the surface - that's not time enough for much of a conversation. The deeper question of what it will mean is of course open for endless debate.

Related Reading


More Insights






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 


Video