Loebner Prize 2010 Results

The 2010 Loebner Prize was held on October 23, 2010 at California State University, Los Angeles under the direction of Professor Russ Abbott.

Results

Loebner Prize 2010. California State University, Los Angeles October 23, 2010
















Russ Abbott

Name

Round 1 Round 2 Round 3 Round 4
Program 1 Dr. Wallace

Dr. Wallace Rollo Carpenter Bruce Wilcox Robert Medeksza
Program 2 Rollo Carpenter

Sanmit Neo Timmy Stephanie
Program 3 Bruce Wilcox

Left Right Left Right Left Right Left Right
Program 4 Robert Medeksza
Choice (1=Computer) 1

1
1
1



Actual Computer 1

1 1

1



Rank 2

4
1
3




Yellow Cells Show Successfully Fooling Judge
Human 1 Sanmit









Human 2 Stephanie









Human 3 Neo

Valentino Crespi
Human 4 Timmy

Round 1 Round 2 Round 3 Round 4




Rollo Carpenter Dr. Wallace Robert Medeksza Bruce Wilcox
Judge 1 Russ Abbott

Stephanie Timmy Neo Sanmit
Judge 2 Valentino Crespi

Left Right Left Right Left Right Left Right
Judge 3 Jason Kelsey
Choice (1=Computer)
1 1

1 1
Judge 4 Derek Wolcott
Actual Computer
1 1

1 1



Rank
2 1

3 4












Successes

Jason Kelsey
Dr. Wallace 0

Round 1 Round 2 Round 3 Round 4
Rollo Carpenter 0

Bruce Wilcox Robert Medeksza Dr. Wallace Rollo Carpenter
Bruce Wilcox 1

Neo Sanmit Stephanie Timmy
Robert Medeksza 0

Left Right Left Right Left Right Left Right



Choice (1=Computer) 1
1
1
1
Average Program Rank
Actual Computer 1
1
1
1
Dr. Wallace 1.5
Rank 4
3
2
1
Rollo Carpenter 2.5









Bruce Wilcox 2.5

Derek Wolcott
Robert Medeksza 3.25

Round 1 Round 2 Round 3 Round 4




Robert Medeksza Bruce Wilcox Rollo Carpenter Dr. Wallace



Timmy Stephanie Sanmit Neo




Left Right Left Right Left Right Left Right



Choice (1=Computer)
1
1
1
1



Actual Computer
1
1
1
1



Rank
4
2
3
1
























Position Entrant
Sum of Ranks Average Rank






1 Wilcox
10 2.5
Note: Wilcox's program was declared the winner because it fooled more judges (1, see yellow cells), even though Wallace's program had the highest overall rank
2 Wallace
6 1.5

3 Carpenter
10 2.5

4 Medeksza
13 3.25













Transcripts

  1. Bruce Wilcox Program Transcript
  2. Richard Wallace Program Transcripts
  3. Rollo Carpenter Program Transcript
  4. Robert Medeeksza Program Transcript

LoebnerPlayer2010   This program will play, in "real time" the transcripts.  (Windows only)

Instructions:

  1. Download transcipts
  2. Download LoebnerPlayer_2010
  3. Open LoebnerPlay_2010
  4. Select logfile (downloaded in step 1)
  5. If desired, unselect "Hide" button to show Human/Program
  6. Select which round 1 .. 4
  7. Select playback speed