Connect with us

Technology

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

Published

2 years ago

on

SAN FRANCISCO, Jan. 23, 2025 /PRNewswire/ — The Center for AI Safety (CAIS) and Scale AI today announced the results of a groundbreaking new AI benchmark that was designed to test the limits of AI knowledge and whether the models are capable of chain-of-thought reasoning. The results demonstrated a significant improvement from the reasoning capabilities of earlier models, but current models still were only able to answer fewer than 10 percent of the expert questions correctly.

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

The new benchmark, called “Humanity’s Last Exam,” evaluated whether AI systems have achieved world-class expert-level reasoning and knowledge capabilities across a wide range of fields, including math, humanities, and the natural sciences. Throughout the fall, CAIS and Scale AI crowdsourced questions from experts to assemble the hardest and broadest problems to stump the AI models. The exam was developed to address the challenge of “benchmark saturation”: models that regularly achieve near-perfect scores on existing tests, but may not be able to answer questions outside of those tests. Saturation reduces the utility of a benchmark as a precise measurement of future model progress.

“We wanted problems that would test the capabilities of the models at the frontier of human knowledge and reasoning,”  said Dan Hendrycks, CAIS co-founder and executive director. “We can’t predict how quickly the models will advance. When I released the MATH benchmark—a challenging competition mathematics dataset—in 2021, the best model scored less than 10%; few predicted that scores higher than 90% would be achieved just three years later. Right now, Humanity’s Last Exam shows that there are still some expert closed-ended questions that models are not able to answer.  We will see how long that lasts.”

Testing Methodology

Altogether, CAIS and Scale researchers collected more than 70,000 trial questions. That led to a selection of 13,000 questions for human expert review which, in turn, were finalized to a set of 3,000 questions on the final exam’s public release. The questions were aimed at world-class expert levels and were put to several multi-modal, frontier LLMs including OpenAI GPT-4o, Anthropic Claude 3.5 Sonnet, Google Gemini 1.5 Pro, and OpenAI o1.

“We know the AI revolution is being shaped by human ingenuity, and we’re proud to be at the forefront. To help humans measure AI progress, we engineered what might be the ultimate test, meticulously distilled and designed to challenge the world’s most advanced models at the frontiers of intelligence—requiring precise, multi-step logical reasoning and unambiguous answers at a level that pushes even the most sophisticated AI systems to their limits.” Summer Yue, Director of Research at Scale AI said.

Humanity’s Last Exam was a global collaborative effort involving nearly 1,000 contributors from more than 500 institutions across 50 countries, with most contributors being active researchers or professors. The questions spanned multiple formats, including text-only and multi-modal challenges that integrated images and diagrams.

The questions were designed to deeply test the capability of the models across diverse domains. For example, a question submitted in Ecology asked:
“Hummingbirds within Apodiformes uniquely have a bilaterally paired oval bone, a sesamoid embedded in the caudolateral portion of the expanded, cruciate aponeurosis of insertion of m. depressor caudae. How many paired tendons are supported by this sesamoid bone? Answer with a number.”

Additional sample questions can be found here (lastexam.ai).

In the final round of testing, Yue said they saw some of the models begin to answer a fraction of the questions correctly (less than 10%); however, she said variations frequently happen in model testing and could be the result of randomness. CAIS and Scale AI said they will open up the dataset to the research community, to dig deeper into the variations and to evaluate new AI systems while continuing to explore the limitations of existing models. A small subset of questions will be held back to preserve integrity for future evaluations.

Top Questions

CAIS and Scale AI offered financial awards for the best contributions to Humanity’s Last Exam, with $5,000 USD awarded for each of the top 50 questions and $500 USD for the next 500 best submissions, along with the opportunity for coauthorship of the final paper.

“By identifying the gaps in AI’s reasoning capabilities, Humanity’s Last Exam not only benchmarks current systems but also provides a roadmap for future research and development,” said Yue.

About The Center for AI Safety
The Center for AI Safety (CAIS) is a research organization whose mission is to reduce societal-scale and national security risks from AI. CAIS research focuses on mitigating high-consequence risks in areas like monitoring, alignment, and systemic safety. CAIS works to expand the field of AI safety and security by providing compute resources and technical infrastructure to top researchers and engaging with the global research community. Through its CAIS Action Fund, CAIS advocates for safe and secure AI. CAIS was founded in 2022 and is headquartered in San Francisco.

About Scale AI
Scale AI is the Humanity-first AI Company. Backed by our Data Foundry, we generate high quality data and provide technology solutions that allow our enterprise and public sector customers to build, deploy, and evaluate the smartest AI tools and applications. By making data abundant, rigorous, and high-quality, we are accelerating the progress of AI. Scale AI was founded in 2016 and is headquartered in San Francisco.

Contact:
Richard Crook, richardc@safe.ai
Fiorella Riccobono, fiorella.riccobono@scale.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/cais-and-scale-ai-unveil-results-of-humanitys-last-exam-a-groundbreaking-new-benchmark-302358108.html

SOURCE Center for AI Safety

Related Topics:
Continue Reading

Technology

Lubbock Plastic Surgeon Dr. Thanapoom Boonipat Leads Suturing Workshop for Texas Tech Women in STEM Premed Students

Published

2 minutes ago

on

October 25, 2026

By

Suturing workshop

LUBBOCK, Texas, Oct. 25, 2026 /PRNewswire/ — Dr. Thanapoom “Mo” Boonipat, plastic surgeon and founder of FacePlus Plastic Surgery Institute in Lubbock, led a hands-on suturing workshop and career Q&A session for premed students at Texas Tech University. The event was organized by Women in STEM at Texas Tech University.

During the workshop, students practiced suturing fundamentals on suture pads using surgical instruments, with Dr. Boonipat demonstrating technique and coaching students individually. The session also included an open discussion about the path to a career in medicine, including medical school, residency training, and choosing a surgical specialty.

“Every surgeon remembers the first time they held a needle driver. Giving premed students that experience early — along with honest answers about the road ahead — can make the path into medicine feel real and reachable. I was glad to spend the afternoon with such motivated students.” — Dr. Thanapoom Boonipat

“Organizations like Women in STEM do important work connecting young women with mentors and hands-on experience in fields where they are still underrepresented, including surgery. FacePlus is proud to support that effort here in our own community in Lubbock.” — Dr. Thanapoom Boonipat

Women in STEM is a Texas Tech University student organization that supports women pursuing undergraduate and graduate studies in science, technology, engineering and mathematics. Events like this connect students with practicing professionals and give them early, practical exposure to clinical skills.

Dr. Boonipat is a plastic and craniofacial surgeon. His training includes an integrated plastic surgery residency at Mayo Clinic and a craniofacial, maxillofacial, and facial aesthetics fellowship at Chang Gung Memorial Hospital in Taiwan, following medical school at Dartmouth and undergraduate study in biomedical engineering at Johns Hopkins. He founded FacePlus Plastic Surgery Institute in Lubbock in 2024.

About FacePlus Plastic Surgery Institute:
FacePlus Plastic Surgery Institute is a plastic surgery practice in Lubbock, Texas, founded by Thanapoom Boonipat, MD. The practice provides cosmetic and reconstructive plastic surgery, including facial, breast, and body procedures, serving patients in Lubbock and across West Texas. For more information, visit facepluspsi.com.

Media Contact:
FacePlus Plastic Surgery Institute
moboonipatmd@facepluspsi.com
(806) 503-2090
Lubbock, Texas

Press Release Service provided by 24-7PressRelease.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/lubbock-plastic-surgeon-dr-thanapoom-boonipat-leads-suturing-workshop-for-texas-tech-women-in-stem-premed-students-302918808.html

SOURCE FacePlus Plastic Surgery Institute

Continue Reading

Technology

Vantrue Announces Early Black Friday Sale with Up to 44% Off Select Dash Cams

Published

3 hours ago

on

October 25, 2026

By

November 1–21, 2026 | Official Website: Vantrue.com

SHENZHEN, China, Oct. 25, 2026 /PRNewswire/ — Vantrue, a dash cam brand dedicated to helping drivers capture the road with confidence, is launching its three-week Black Friday campaign from November 1 to November 21, 2026. The event brings together discounts of up to 44% on selected dash cams, a 100% win-rate prize wheel for subscribers, and exclusive bidding events, giving drivers multiple ways to discover and save on Vantrue products.

Every Eligible Spin Wins a Prize

The Black Friday excitement starts with Vantrue’s 100% win-rate spin wheel. Visitors can subscribe through the official website and spin for a chance to receive exciting rewards, including the latest Vantrue dash cams, special prize bundles, and other surprises. Each subscriber is eligible for one spin during the campaign.

Black Friday Deals in Two Waves

Vantrue’s Black Friday offers will roll out in two waves, featuring discounts on selected dash cams for everyday drivers, rideshare professionals, and those looking to upgrade their in-car recording setup.

Wave 1: November 1–10, 2026

Vantrue E1 Lite: 36% off — $69.99 (regular price: $109.99)
 Vantrue N2X: 36% off — $159.99 (regular price: $249.99)
 Vantrue N4S: 44% off — $199.99 (regular price: $359.99)
 

Wave 2: November 11–21, 2026

Vantrue E1 Pro S: 35% off — $129.99 (regular price: $199.99)
 Vantrue N5S: 36% off — $293.99 (regular price: $459.99)
 Vantrue N4 Pro S: 40% off — $279.99 (regular price: $469.99)
 

Exclusive Bidding Events Add More Excitement

In addition to the promotional pricing, Vantrue will host two special bidding events, offering participants another way to pursue selected dash cams at competitive prices.

BID #1: November 5–7, 2026 — Bid on featured products for a chance to secure them at a lower price.BID #2: November 12–14, 2026 — Return for another opportunity to bid on premium models.

With multiple ways to participate throughout the three-week event, Vantrue’s Black Friday campaign combines savings, interactive rewards, and special shopping opportunities in one destination.

Join Vantrue’s Black Friday Event

From November 1 through November 21, 2026, drivers can explore the latest offers, take part in the prize wheel, and join the bidding events through Vantrue’s official website.

Visit https://www.vantrue.com/ for campaign details and product offers.

About Vantrue

Founded in 2015, Vantrue is a leading global dash cam brand dedicated to providing intelligent, reliable, and user-centric driving solutions. With a focus on innovative technology, dependable performance, and user-friendly design, Vantrue develops dash cams for everyday drivers, families, and professionals on the road. Committed to helping drivers capture every journey with greater confidence and peace of mind, Vantrue continues to innovate to make every drive safer and every moment worth capturing.

Media Contact
Vantrue Media Relations
Email: support@vantrue.net
Website: https://www.vantrue.com

View original content:https://www.prnewswire.com/news-releases/vantrue-announces-early-black-friday-sale-with-up-to-44-off-select-dash-cams-302918196.html

SOURCE Vantrue

Continue Reading

Technology

LexisNexis Coplogic Solutions Introduces Field Clarity for LexisNexis® Desk Officer Reporting System (DORS) at IACP 2026

Published

6 hours ago

on

October 25, 2026

By

A new, modern DORS and Field Clarity, the First AI-Guided Smartphone Video Assistant, Enhances Community Experience and Helps Improve Evidence, Case Building

ORLANDO, Fla., Oct. 25, 2026 /PRNewswire/ — LexisNexis® Coplogic™ Solutions today announced its modernized LexisNexis® Desk Officer Reporting System (DORS) community online reporting solution and the addition of DORS with Field Clarity, an AI-guided video assistant designed to improve field documentation accuracy and enable faster resolution by law enforcement agencies (LEAs). Field Clarity is designed to help community members submit reports to their local LEAs using DORS via intuitive step-by-step instructions. A hands-on experience for DORS with Field Clarity will be available for demonstration during the 2026 International Association of Chiefs of Police (IACP) annual conference.

“Agencies generally look to strategic partners like us not just for technology, but also for relief, reinforcement, and credibility across three tightly connected challenges: public expectation, workforce strain and digital evidence overload,” said Jason LaRue, associate vice president, LexisNexis Coplogic Solutions. “Our modernized LexisNexis Desk Officer Reporting System (DORS) helps agencies improve officer safety along with community member experiences. Field Clarity strengthens video evidence quality and digital evidence management to reduce friction and alleviate strain on a challenged workforce.”

Key Highlights
Integrated into LexisNexis® Desk Officer Reporting System (DORS), Field Clarity is the first AI-Guided video assistant for community member online reporting that:

Transforms data capture from passive intake into intelligent, guided capture to help create more positive officer and civilian mobile-first experiencesDrives more accurate field documentation, evidence and case building to help with faster resolution and enhanced public safetyBenefits civilians submitting reports with intuitive, step-by-step instructions, almost like having a digital assistant with them in real timeBenefits officers by bringing video, photos and scanned data together for a clearer picture of an event without the need to track down additional details

How the DORS with Field Clarity Solution Works
DORS allows each law enforcement agency to collect information directly from civilians on more than 200 incident types based on the needs of their community. DORS and Field Clarity make the filing of an online report experience easier by guiding users intuitively through each step of the process on their smartphone device, similar to having a personal digital assistant. Instead of asking a driver, for example, to fill out forms and guess what’s needed, the Field Clarity conversational interface prompts them to scan their driver’s license, capture a VIN or record a short walkaround video explaining what happened during the incident, all while capturing the data necessary to complete the report.

For civilians, being able to easily film on-scene evidence means less confusion and need for reentries or follow-up by the sworn officer responsible for approving reports. For officers, the benefits include cleaner, more complete accident reports and less time spent requesting and gathering additional details. With reports fed directly into the agency’s Record Management System (RMS), law enforcement also benefits from more efficient workflows and stronger documented cases for their investigators. DORS is used by nearly 600 agencies in North America, saving agencies approximately 900,000 personnel hours and $90 million annually*

“Trust in law enforcement is built one interaction at a time. Every opportunity for a community member to engage with their police department matters, including something as routine as filing a report,” said Sarah E. Connolly, co-founder of Guardian Communications, FBI-LEEDA instructor and retired Baltimore Police lieutenant and PIO. “When technology makes that process easier, improves the quality of information collected and supports a more responsive agency, it has the potential to do more than improve efficiency. It can help strengthen the relationship between law enforcement and the communities they serve.”

LexisNexis Coplogic Solutions delivers solutions and capabilities that can create a clearer line of sight from the field to law enforcement leadership, strengthening the connection between daily operations, workforce support, data management and community trust. DORS with Field Clarity is available through LexisNexis® Command Center, a single access point to the LexisNexis Coplogic Solutions data and analytics solutions suite, including LexisNexis®  BuyCrash®, LexisNexis® eCrash and LexisNexis® eCitation solutions. Coplogic Solutions also offers Unified Performance Dashboards for crash and citation mapping and illustrated visualizations, which connect field data with contextual insight in a single, coherent view – so law enforcement leaders can better understand and more confidently explain to their communities not just what is happening in near-real time, but also why. 

To speak with Coplogic law enforcement experts about LexisNexis Desk Officer Reporting System (DORS) with Field Clarity and experience the solution firsthand, visit LexisNexis Coplogic Solutions at IACP Booth #941, October 24 – 27, 2026 in Orlando, Florida. To learn more, check out this video: LexisNexis® Desk Officer Reporting System (DORS).

About LexisNexis Risk Solutions
LexisNexis® Risk Solutions provides customers with information-based analytics and decision tools that combine public and industry-specific content with advanced technology and algorithms to assist them in evaluating and predicting risk and enhancing operational efficiency. Headquartered in metro Atlanta, Georgia, the company has offices throughout the world, serves customers in more than 190 countries and territories and is part of RELX. For more information, please visit LexisNexis Risk Solutions.

About LexisNexis Coplogic Solutions
LexisNexis® Coplogic™ Solutions is committed to meeting law enforcement agencies where they are on the road to saving more lives and helping take them where they want to be by delivering an innovative full suite of data sophistication solutions to create workflow efficiencies while delivering world-class crash and citation data and analytics visualizations through advanced technology. Our proven solutions, developed by and specifically for law enforcement, can help agencies operate more effectively, increase services to their communities and improve traffic and overall public safety through electronic, mobile-first authoring capabilities, web-based eCommerce solutions, analytics and more. For more information, please visit risk.lexisnexis.com/Coplogic.

Media Contacts: 
Chaz Abbott
LexisNexis Risk Solutions
chaz.abbott@lexisnexisrisk.com
+1 949.922.1167

*Based on a 2025 LexisNexis Coplogic Solutions internal study

View original content to download multimedia:https://www.prnewswire.com/news-releases/lexisnexis-coplogic-solutions-introduces-field-clarity-for-lexisnexis-desk-officer-reporting-system-dors-at-iacp-2026-302918694.html

SOURCE LexisNexis Risk Solutions

Continue Reading

Trending