Training AIs to Solve CAPTCHAs

Schneier on Security

Overview

Researchers have developed a new system that trains artificial intelligence (AI) to solve visual CAPTCHAs more effectively. Unlike traditional CAPTCHA solvers that tackle each challenge independently, this system uses a combination of a fine-tuned YOLOv8 detector and a vision-language model (VLM) that learns from its experiences. As the AI encounters CAPTCHAs, it adapts and improves, achieving an accuracy of 85.4% across various categories. This advancement poses a challenge for CAPTCHA operators, as their attempts to disrupt the AI's performance can be countered by the VLM's ability to provide training labels. The research shows that adaptive AI can quickly recover from countermeasures, suggesting that current CAPTCHA defenses may be insufficient against evolving bot technologies.

Key Takeaways

  • Affected Systems: Visual CAPTCHAs, CAPTCHA systems, AI-based CAPTCHA solvers
  • Action Required: CAPTCHA systems may need to evolve to include more complex challenges or additional verification methods to counter adaptive AI.
  • Timeline: Newly disclosed

Original Article Summary

Interesting research: Abstract: Vision-language models (VLMs) can solve visual CAPTCHAs without task-specific training, but the agents built on them approach every challenge from scratch. For such an agent, the hundredth instance of a familiar puzzle costs as much time and compute as the first. Specialized detectors invert the trade-off, answering in milliseconds but only for categories they were trained on. Neither improves with exposure. We study what changes when a solver improves with use. Our system pairs a fine-tuned YOLOv8 detector with an open-weight VLM behind a confidence-based router, and runs entirely from screenshots and operating-system input events, with no browser automation or DOM access. It reaches 85.4% overall and 84.2% macro accuracy across 16 classes, exceeding either component alone. Every answer VLM produces also serves as a training label, so the detector absorbs categories it was never trained for, typically after one or two encounters and without human annotation. The same loop also repairs it. A CAPTCHA operator can perturb images against the publicly released detector and drive its accuracy to 0%, but the perturbations leave VLM untouched, and its labels let the detector recover. Under a year-long simulated arms race in which the CAPTCHA operator re-crafts its perturbations each month, the solver recovers every round, and a cheap ~70%-accurate open-weight teacher hardens it as effectively as a perfect oracle. Visual CAPTCHA defenses that assume a failing bot stays failing therefore understate how quickly an adaptive solver returns...

Impact

Visual CAPTCHAs, CAPTCHA systems, AI-based CAPTCHA solvers

Exploitation Status

The exploitation status is currently unknown. Monitor vendor advisories and security bulletins for updates.

Timeline

Newly disclosed

Remediation

CAPTCHA systems may need to evolve to include more complex challenges or additional verification methods to counter adaptive AI.

Additional Information

This threat intelligence is aggregated from trusted cybersecurity sources. For the most up-to-date information, technical details, and official vendor guidance, please refer to the original article linked below.

Related Topics: This incident relates to Oracle.

Related Coverage

Oracle EBS exploitation similar to Clop's MOVEit, GoAnywhere attacks

SCM feed for Latest

The Clop ransomware group has shifted its focus from exploiting file transfer tools to targeting legacy business systems like Oracle EBS. This change signifies an evolution in their attack strategy, posing a significant threat to organizations using these systems due to potential data breaches and operational disruptions.

Dec 1, 2025

Dartmouth College Confirms Data Theft in Oracle Hack

SecurityWeek

Dartmouth College has confirmed a significant data breach involving the theft of over 226 Gb of files by cybercriminals. This incident highlights the increasing risks associated with data security in educational institutions and raises concerns about the potential exposure of sensitive information.

Nov 26, 2025

Canon Says Subsidiary Impacted by Oracle EBS Hack

SecurityWeek

Canon has reported that one of its subsidiaries has been affected by the Oracle EBS hack, which has resulted in over 100 alleged victims being listed on the Cl0p ransomware website. This incident highlights the significant impact of the Oracle EBS campaign and raises concerns about the security of affected organizations.

Nov 25, 2025

Critical Flaw in Oracle Identity Manager Under Exploitation

darkreading

The article highlights the exploitation of CVE-2025-61757, which follows a breach of Oracle Cloud and an extortion campaign targeting Oracle E-Business Suite customers. This indicates a significant security threat that could impact numerous organizations relying on Oracle's services.

Nov 24, 2025

CISA Confirms Exploitation of Recent Oracle Identity Manager Vulnerability

SecurityWeek

CISA has confirmed the exploitation of a vulnerability in Oracle Identity Manager, identified as CVE-2025-61757, which has been added to its Known Exploited Vulnerabilities catalog. This indicates a significant security risk for organizations using the affected systems, necessitating immediate attention to mitigate potential breaches.

Nov 24, 2025

Mazda Says No Data Leakage or Operational Impact From Oracle Hack

SecurityWeek

Mazda has been identified as a victim of the Cl0p ransomware group's Oracle EBS campaign, but the company asserts that there has been no data leakage or operational impact from the incident. This situation highlights the ongoing threat posed by ransomware groups targeting enterprise systems.

Nov 24, 2025