Connect with us

Technology

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

Published

2 years ago

on

SAN FRANCISCO, Jan. 23, 2025 /PRNewswire/ — The Center for AI Safety (CAIS) and Scale AI today announced the results of a groundbreaking new AI benchmark that was designed to test the limits of AI knowledge and whether the models are capable of chain-of-thought reasoning. The results demonstrated a significant improvement from the reasoning capabilities of earlier models, but current models still were only able to answer fewer than 10 percent of the expert questions correctly.

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

The new benchmark, called “Humanity’s Last Exam,” evaluated whether AI systems have achieved world-class expert-level reasoning and knowledge capabilities across a wide range of fields, including math, humanities, and the natural sciences. Throughout the fall, CAIS and Scale AI crowdsourced questions from experts to assemble the hardest and broadest problems to stump the AI models. The exam was developed to address the challenge of “benchmark saturation”: models that regularly achieve near-perfect scores on existing tests, but may not be able to answer questions outside of those tests. Saturation reduces the utility of a benchmark as a precise measurement of future model progress.

“We wanted problems that would test the capabilities of the models at the frontier of human knowledge and reasoning,”  said Dan Hendrycks, CAIS co-founder and executive director. “We can’t predict how quickly the models will advance. When I released the MATH benchmark—a challenging competition mathematics dataset—in 2021, the best model scored less than 10%; few predicted that scores higher than 90% would be achieved just three years later. Right now, Humanity’s Last Exam shows that there are still some expert closed-ended questions that models are not able to answer.  We will see how long that lasts.”

Testing Methodology

Altogether, CAIS and Scale researchers collected more than 70,000 trial questions. That led to a selection of 13,000 questions for human expert review which, in turn, were finalized to a set of 3,000 questions on the final exam’s public release. The questions were aimed at world-class expert levels and were put to several multi-modal, frontier LLMs including OpenAI GPT-4o, Anthropic Claude 3.5 Sonnet, Google Gemini 1.5 Pro, and OpenAI o1.

“We know the AI revolution is being shaped by human ingenuity, and we’re proud to be at the forefront. To help humans measure AI progress, we engineered what might be the ultimate test, meticulously distilled and designed to challenge the world’s most advanced models at the frontiers of intelligence—requiring precise, multi-step logical reasoning and unambiguous answers at a level that pushes even the most sophisticated AI systems to their limits.” Summer Yue, Director of Research at Scale AI said.

Humanity’s Last Exam was a global collaborative effort involving nearly 1,000 contributors from more than 500 institutions across 50 countries, with most contributors being active researchers or professors. The questions spanned multiple formats, including text-only and multi-modal challenges that integrated images and diagrams.

The questions were designed to deeply test the capability of the models across diverse domains. For example, a question submitted in Ecology asked:
“Hummingbirds within Apodiformes uniquely have a bilaterally paired oval bone, a sesamoid embedded in the caudolateral portion of the expanded, cruciate aponeurosis of insertion of m. depressor caudae. How many paired tendons are supported by this sesamoid bone? Answer with a number.”

Additional sample questions can be found here (lastexam.ai).

In the final round of testing, Yue said they saw some of the models begin to answer a fraction of the questions correctly (less than 10%); however, she said variations frequently happen in model testing and could be the result of randomness. CAIS and Scale AI said they will open up the dataset to the research community, to dig deeper into the variations and to evaluate new AI systems while continuing to explore the limitations of existing models. A small subset of questions will be held back to preserve integrity for future evaluations.

Top Questions

CAIS and Scale AI offered financial awards for the best contributions to Humanity’s Last Exam, with $5,000 USD awarded for each of the top 50 questions and $500 USD for the next 500 best submissions, along with the opportunity for coauthorship of the final paper.

“By identifying the gaps in AI’s reasoning capabilities, Humanity’s Last Exam not only benchmarks current systems but also provides a roadmap for future research and development,” said Yue.

About The Center for AI Safety
The Center for AI Safety (CAIS) is a research organization whose mission is to reduce societal-scale and national security risks from AI. CAIS research focuses on mitigating high-consequence risks in areas like monitoring, alignment, and systemic safety. CAIS works to expand the field of AI safety and security by providing compute resources and technical infrastructure to top researchers and engaging with the global research community. Through its CAIS Action Fund, CAIS advocates for safe and secure AI. CAIS was founded in 2022 and is headquartered in San Francisco.

About Scale AI
Scale AI is the Humanity-first AI Company. Backed by our Data Foundry, we generate high quality data and provide technology solutions that allow our enterprise and public sector customers to build, deploy, and evaluate the smartest AI tools and applications. By making data abundant, rigorous, and high-quality, we are accelerating the progress of AI. Scale AI was founded in 2016 and is headquartered in San Francisco.

Contact:
Richard Crook, richardc@safe.ai
Fiorella Riccobono, fiorella.riccobono@scale.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/cais-and-scale-ai-unveil-results-of-humanitys-last-exam-a-groundbreaking-new-benchmark-302358108.html

SOURCE Center for AI Safety

Related Topics:
Continue Reading

Technology

The Ultimate Send-off to Summer: CSTS Debuts Global Entertainment IP PremierX at New York’s Pier 17, Ushering in a New Era of Live Entertainment

Published

1 hour ago

on

October 24, 2026

By

NEW YORK, Oct. 24, 2026 /PRNewswire/ — CSTS Enterprises (‘CSTS’), a New York-based sports, entertainment, integrated media and travel technology group, today announced the official launch of PremierXTM, its flagship live entertainment brand, with a landmark Halloween Weekend event “AFTER DARK” at The Rooftop at Pier 17 in New York on October 30, 2026.

Capping off Seaport’s 2026 Summer Season in unforgettable fashion, the grand finale brings a powerhouse lineup of stars to the PremierXTM stage at Pier 17, featuring Lil Xan, Armani White, DJ Soda, Nate Wyatt, and surprise A-list guest headliners. Set against the iconic Manhattan skyline, the landmark eventing unites chart-topping hip-hop and high-octane electronic music for a festival-grade experience as The Rooftop at Pier 17 transforms into the city’s premier live music destination.

Building on the momentum of the PremierXTM After Party for the 2026 World Cup Final that took place in New York on July 19th, “AFTER DARK” signals the official debut of PremierXTM, a proprietary, New York – born global entertainment IP created by CSTS to deliver defining cultural experiences at the intersection of music, sport, art and lifestyle. Centred on the power of cultural crossover, PremierXTM serves as an international bridge connecting East and West, modern innovation and timeless classical, while uniting world-class artists, creators, performers and audiences through the universal language of entertainment and premium live experiences.

The launch also marks the beginning of a promising relationship with Pier 17, providing a world-class stage for PremierXTM to accelerate its growth in the U.S. and engage international audiences over the long term. By combining PremierXTM’s global entertainment vision with Pier 17’s iconic waterfront setting, the partnership aims to create a premier destination for live experiences, empowering both platforms to expand their global reach, deepen audience engagement, and drive sustainable growth.

As a key pillar of CSTS’ integrated ecosystem spanning entertainment, sports, travel, integrated media and marketing solutions, PremierXTM further strengthens the Group’s ability to create high-impact experiences that connect audiences, destinations and brand partners. With the global live entertainment market projected to grow from approximately US$203 billion in 2025 to US$270 billion by 2030[1], PremierXTM is well-positioned to capitalize on the growing demand for premium, experience-led entertainment while creating long-term value to the Group through recurring audience engagement, tourism and brand partnerships.

“PremierX TM represents a significant milestone in CSTS’ evolution from a leading operator of global sports and hospitality platforms into a creator of world-class entertainment experiences,” said Abel Zhao, Group CEO and Executive Director at CSTS Enterprises. “The season finale at Pier17 marks the beginning of an exciting new chapter for CSTS as we expand our entertainment footprint and introduce a platform designed to deliver iconic live experiences and bring together artists and audiences from across the globe.”

“PremierXTM was built from the ground up as a bespoke platform to champion multicultural talent and visionary creative performers.” said Jason Liu, Regional Director of CSTS USA. “Starting from New York, we are building a scalable global brand that brings iconic live experiences to audiences worldwide while expanding our presence across key entertainment hubs in North America, Asia and Europe.”

Following its New York launch, PremierXTM plans to expand through a broader international rollout across North America, Asia and Europe, with future editions planned as part of a growing network of recurring live entertainment properties and flagship cultural events.

For ticket information on PremierXTM: “AFTER DARK”, visit
https://www.axs.com/events/1644912/after-dark-tickets

About CSTS Enterprises

CSTS Enterprises is an integrated media, entertainment, sports, and travel technology group. Headquartered in New York City, the company develops and partners with intellectual properties and brands to deliver compelling experiences that connect with audiences across the world. In addition to its own initiatives, including Generation CTM and PremierXTM, it collaborates with international IPs including FIFA World Cup, UEFA European Championship, and Formula 1.

CSTS integrates experiential marketing, travel, data, and technology to deliver seamless end-to-end audience experiences. The company engages consumers across physical events and digital channels, executing at scale worldwide, turning complex activations into co-ordinated, measurable outcomes.

[1] Source: Industry research by Markets and Markets, Live Entertainment Market Size, Share, Latest Trends & Growth Analysis, 2025-2030, Live Entertainment Market Size, Share, Latest Trends & Growth Analysis, 2025-2030.

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/the-ultimate-send-off-to-summer-csts-debuts-global-entertainment-ip-premierx-at-new-yorks-pier-17-ushering-in-a-new-era-of-live-entertainment-302918645.html

SOURCE CSTS Enterprises

Continue Reading

Technology

Swanson Vitamins Launches Swanson Vitamins Nexus Pro to Champion Registered Dietitians and Licensed Nutritionists at Every Stage of Their Careers

Published

1 hour ago

on

October 24, 2026

By

New network for health and nutrition professionals offers CPEU-accredited continuing education, profession-wide promotion, practicum support and exam scholarships

FARGO, N.D., Oct. 24, 2026 /PRNewswire/ — Swanson Vitamins today launched Swanson Vitamins Nexus Pro, a network for health and nutrition professionals. The new initiative champions registered dietitians and licensed nutritionists through every stage of their careers, from students to providers with decades of experience. Created by nutrition professionals for nutrition professionals, Swanson Vitamins Nexus Pro offers educational resources, incentives and investments to support practitioners who share Swanson’s commitment to uncompromising integrity.

Swanson Vitamins Nexus Pro offers tailored resources for both practicing professionals and students. For practicing registered dietitians and licensed nutritionists, the program provides CPEU-accredited continuing education, along with profession-wide promotion of the experts who guide consumers’ wellness decisions. For dietetics and nutrition students, Swanson is investing in the next generation of the profession through practicum support and scholarships toward licensing or credentialing exam fees.

As consumers take a more active role in their health, they are increasingly turning to registered dietitians and licensed nutritionists for accurate, science-backed guidance. Through Swanson Vitamins Nexus Pro, Swanson aims to help nutrition professionals strengthen their credentials and build expertise in areas where consumers are seeking trusted nutritional support.

“Since 1969, we have been committed to uncompromising integrity in service of everyone’s journey to real wellness, and we believe real wellness starts with the experts who guide it,” said Erin Del Ponte, EVP Brand Marketing at Swanson Vitamins. “Registered dietitians and licensed nutritionists translate nutrition science into practical, personalized guidance that helps people make informed decisions about their health. With Swanson Vitamins Nexus Pro, we are proud to support these professionals at every stage of their careers, from students preparing for their credentialing exams to seasoned providers building expertise in the areas that matter most to consumers today.”

Swanson Nexus Pro program highlights

CPEU-accredited continuing education for registered dietitians and licensed nutritionistsProfession-wide promotion of registered dietitians and licensed nutritionistsPracticum support for dietetics and nutrition studentsScholarships to help offset licensing or credentialing exam fees

Applications for Swanson Vitamins Nexus Pro are open and can be submitted HERE. Additional details, including scholarship award amounts and practicum support details, will be announced in the coming weeks.

Swanson Vitamins Nexus Pro was introduced at the Food & Nutrition Conference & Expo, the Academy of Nutrition and Dietetics’ annual conference, held Oct. 24-27 in San Antonio. This initiative builds on Swanson’s longstanding commitment to the nutrition and dietetics community and reflects the company’s continued investment in the professionals who help consumers make informed choices on their journey to real wellness.

Media Assets
Photos HERE

About Swanson Vitamins
Since 1969, Swanson Vitamins has offered high-quality, science-backed vitamins and supplements rooted in one simple belief: proof over promise. Nearly six decades before “wellness” became an industry, Swanson was pioneering trustworthy supplement offerings and upholding uncompromising quality standards through intentional sourcing, rigorous in-house and third-party testing and Good Manufacturing Practices (GMP).

Today, Swanson is a Certified GMP Facility recognized by NSF, backed by an in-house team of nutritionists, dietitians, scientists, chemists and pharmacists with a combined 250-plus years of experience. With more than 1,300 products across 36 categories, Swanson doesn’t chase trends. It sets standards for integrity, quality and clarity in the supplement industry.

Swanson products are available at SwansonVitamins.com, Amazon and iHerb.com. Learn more at SwansonVitamins.com or follow @swansonvitamins on Instagram.

MEDIA CONTACT
Lauren Torrez, Crowe PR
ltorrez@crowepr.com 

View original content to download multimedia:https://www.prnewswire.com/news-releases/swanson-vitamins-launches-swanson-vitamins-nexus-pro-to-champion-registered-dietitians-and-licensed-nutritionists-at-every-stage-of-their-careers-302918428.html

SOURCE Swanson Vitamins

Continue Reading

Technology

Technology Drives the Future of Travel: JETOUR Continues to Expand Its “Travel+” Ecosystem

Published

2 hours ago

on

October 24, 2026

By

WUHU, China, Oct. 24, 2026 /PRNewswire/ — Expectations for travel are evolving: vehicles are no longer simply a means of reaching a destination, but travel companions that bring people closer to nature, serving as a “mobile third space.”

JETOUR continues to advance its “Travel+” strategy, integrating technological innovation, product development, and ecosystem building into real travel scenarios. From October 20 to 23, the 2026 JETOUR Global Technology Experience Day, themed “Future Travel Starts Now,” takes place across Wuhu, Anhui and Moganshan, Zhejiang, featuring technology experiences, on-road driving, outdoor living, and conservation activities.

Technological Innovation: Expanding the Possibilities of Travel

Backed by the Group’s expertise in AI, intelligent driving, smart cabins, and AiMOGA Robotics, JETOUR turns cutting-edge technology into experiences users can genuinely feel. The XWD Fully Automatic Intelligent 4WD, with 7+X one-touch modes, tackles mountain roads, gravel, and water crossings, while the GAIA All-Terrain Intelligent Architecture adapts to diverse terrain and C-DM hybrid technology balances performance with efficiency. On October 21, models with these technologies take on mountain-road test drives at Moganshan.

A Diverse Product Lineup: Enriching the Travel Experience

The G700 combines premium comfort with hardcore off-road capability, while the T1 and T2 suit both urban driving and light off-road adventures. Roof tents, onboard refrigerators, and other ecosystem equipment turn the vehicle into an all-round companion. JETOUR also hosts a camping market and a Starry Night Forum, bringing product features into real travel settings.

Ecosystem: Extending the Value of Travel

Travel is about understanding cultures and protecting nature as well as exploration. Participants visit Xiazhu Lake in Zhejiang for a crested ibis conservation initiative. Globally, JETOUR supports cheetah conservation in Africa, turtle conservation in Malaysia, harpy eagle conservation in Panama, and protection of Pakistan’s national animal, the markhor.

JETOUR has also partnered with Chile’s Colo-Colo, FIBA, and the Malaysia Marathon, broadening engagement with local culture, sport, and communities — giving “Travel+” an ever richer meaning.

JETOUR now joins travelers worldwide across city, mountain, and wetland, exploring new possibilities through the deeper integration of technology and travel.

ABOUT JETOUR

Launched in 2018, JETOUR follows the “Travel+” strategy and has entered over 100 countries and regions, with 2,000+ sales and after-sales outlets. Its lineup includes the T Series for light off-road and the G Series for the premium luxury off-road market, covering urban commuting, family road trips, outdoor camping, and long-distance journeys.

View original content to download multimedia:https://www.prnewswire.com/apac/news-releases/technology-drives-the-future-of-travel-jetour-continues-to-expand-its-travel-ecosystem-302918650.html

SOURCE JETOUR

Continue Reading

Trending