The Turing Test in the Classroom
Authors: Lisa Torrey, Karen Johnson, Sid Sondergard, Pedro Ponce, Laura Desmond
AAAI 2016 | Conference PDF | Archive PDF | Plain Text | LLM Run Details
| Reproducibility Variable | Result | LLM Response |
|---|---|---|
| Research Type | Experimental | This paper discusses the Turing Test as an educational activity for undergraduate students. It describes in detail an experiment that we conducted in a first-year non-CS course. |
| Researcher Affiliation | Academia | Lisa Torrey, Karen Johnson, Sid Sondergard, Pedro Ponce, Laura Desmond St. Lawrence University |
| Pseudocode | No | The paper describes the software's design and functionality but does not include any pseudocode or algorithm blocks. |
| Open Source Code | No | For this reason, our software is available (via email) to any instructor who wishes to use it or build from it. |
| Open Datasets | No | The paper uses conversations generated during its own experiment with students and Cleverbot, but does not state that this data or any other dataset used is publicly available with concrete access information. |
| Dataset Splits | No | The paper describes a human-in-the-loop Turing Test experiment and does not involve typical machine learning dataset splits (training, validation, test) for model training and evaluation. |
| Hardware Specification | No | The paper mentions 'workstations' and 'networked machine' but does not specify any particular hardware details such as CPU/GPU models, memory, or specific computer specifications used for the experiments. |
| Software Dependencies | No | The paper states that the software is 'implemented in Java' but does not provide any specific version numbers for Java or any other software dependencies. |
| Experiment Setup | Yes | After 5 minutes, the judge had to label the contestant as human or computer. Most groups consisted of 5 judges, 3 confederates, and 2 transcribers; the smaller group was less one judge and one transcriber. The entire event took place within two 45-minute sessions... The computer role was performed by Cleverbot... The conversation topics were mostly unrestricted, but we did establish two rules: 1. Don’t be rude. 2. Don’t ask for personal or identifying information, and avoid giving such information if asked. |