Human vs. AI Game Test: Discover How 32% of Participants Struggle to Distinguish Between Humans and Robots

Home AI News Human vs. AI Game Test: Discover How 32% of Participants Struggle to Distinguish Between Humans and Robots

Updated on November 11 2023

Recently, AI21 Labs, a competitor of OpenAI, launched an engaging social experiment titled "Human or Not." This online game demonstrated that up to 32% of participants found it challenging to distinguish between humans and AI chatbots, marking it as the largest Turing Test to date. The study utilized advanced large language models (LLMs) such as OpenAI's GPT-4 and AI21's Jurassic-2, analyzing over a million interactions.

The findings were enlightening. Participants successfully identified human interlocutors 73% of the time but struggled with bots, achieving only a 60% accuracy rate. Researchers observed that players adopted various strategies to determine if they were interacting with a human or a machine. Many assumed that bots would not make spelling or grammatical errors and would avoid using slang. However, the chatbots were designed to make such errors and utilize casual language.

Participants often asked personal questions like, “Where are you from?” or “What’s your name?” believing AI lacked personal history. Surprisingly, many chatbots provided compelling responses, as they had been trained on a wide range of personal narratives.

After two minutes of conversation, users were challenged to guess whether their partner was human or a robot. Following over a month of play and millions of interactions, 32% of participants could not differentiate between the two. Interestingly, some speculated that excessive politeness might indicate an AI presence.

Concerned About iPhone 15 Data Leaks? Apple Bans ChatGPT for Enhanced Security

Call to AIGC Heroes: Baidu's Robin Li Unveils Geek Spirit

Most people like

IDWise

IDWise is an innovative AI-powered identity verification solution designed to assist businesses in seamlessly authenticating customer identities. With advanced technology, IDWise enhances security and builds trust, making identity verification efficient and reliable.

identity verification AI Product Description Generator

Frontly

38.1K

In today's fast-paced digital landscape, AI-powered no-code app development empowers individuals and businesses alike to create applications without extensive programming knowledge. This innovative approach leverages artificial intelligence to streamline the development process, enabling users to build, deploy, and customize apps quickly and efficiently. As organizations strive for agility and cost-effectiveness, embracing no-code platforms equipped with AI capabilities becomes essential for staying competitive in an ever-evolving market. Discover how this transformative technology can revolutionize your app creation journey.

AI AI Analytics Assistant

Slides Wizard

24.2K

Create Stunning Presentations in Seconds In today’s fast-paced world, the ability to generate captivating presentations quickly is essential for professionals and students alike. With cutting-edge tools at your fingertips, you can craft eye-catching slides in mere seconds, allowing you to focus on delivering your message effectively. Whether you’re preparing for a business meeting, academic lecture, or creative pitch, our streamlined process empowers you to produce high-quality presentations effortlessly. Say goodbye to hours of design work and hello to instant presentation perfection!

presentation AI Presentation Generator

AI Yes or No Tarot

47.3K

Explore the captivating synergy between age-old tarot traditions and cutting-edge technology. As the world evolves, so too does the way we connect with ancient wisdom. Discover how modern innovations are revitalizing tarot readings, enhancing accessibility, and bringing new dimensions to this age-old practice. Embrace the fusion of the mystical and the digital, and unlock the potential for deeper insights and transformative experiences through tarot in the digital age.

tarot AI Chatbot

Find AI tools in YBX