University of Worcester Worcester Research and Publications
 
  USER PANEL:
  ABOUT THE COLLECTION:
  CONTACT DETAILS:

Covert Implementations of the Turing Test: A More Level Playing Field?

Burden, D., Savin-Baden, Maggi and Bhakta, Roy (2016) Covert Implementations of the Turing Test: A More Level Playing Field? In: Research and Development in Intelligent Systems XXXIII: Incorporating Applications and Innovations in Intelligent Systems XXIV. Springer International Publishing, Cham, pp. 195-207. ISBN Print: 978-3-319-47174-7 Online: 978-3-319-47175-4

Full text not available from this repository. (Request a copy)

Abstract

It has been suggested that a covert Turing Test, possibly in a virtual world, provides a more level playing field for a chatbot, and hence an earlier opportunity to pass the Turing Test (or equivalent) in its overt, declared form. This paper looks at two recent covert Turing Tests in order to test this hypothesis. In one test (at Loyola Marymount) run as a covert-singleton test, of 50 subjects who talked to the chatbot avatar 39 (78 % deception) did not identify that the avatar was being driven by a chatbot. In a more recent experiment at the University of Worcester groups of students took part in a set of problem-based learning chat sessions, each group having an undeclared chatbot. Not one participant volunteered the fact that a chatbot was present (a 100 % deception rate). However the chatbot character was generally seen as being the least engaged participant---highlighting that a chatbot needs to concentrate on achieving legitimacy once it can successfully escape detection.

Item Type: Book Section
Additional Information:

Refereed paper presented at AI-2016, the Thirty-sixth SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, held in Cambridge in December 2016 in both the technical and the application streams.

Uncontrolled Keywords: Turing Test, Natural Language, Chatbot, Virtual worlds, Second Life
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
T Technology > T Technology (General)
Divisions: Divisions (2019 and before) > Academic Departments > Institute of Education
Related URLs:
Depositing User: Maggi Savin-Baden
Date Deposited: 16 Jun 2019 04:52
Last Modified: 04 Oct 2019 08:28
URI: https://eprints.worc.ac.uk/id/eprint/8163

Actions (login required)

View Item View Item
 
     
Worcester Research and Publications is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.