Connect with us

Technology

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

Published

on

SAN FRANCISCO, Jan. 23, 2025 /PRNewswire/ — The Center for AI Safety (CAIS) and Scale AI today announced the results of a groundbreaking new AI benchmark that was designed to test the limits of AI knowledge and whether the models are capable of chain-of-thought reasoning. The results demonstrated a significant improvement from the reasoning capabilities of earlier models, but current models still were only able to answer fewer than 10 percent of the expert questions correctly.

CAIS and Scale AI Unveil Results of “Humanity’s Last Exam,” a Groundbreaking New Benchmark

The new benchmark, called “Humanity’s Last Exam,” evaluated whether AI systems have achieved world-class expert-level reasoning and knowledge capabilities across a wide range of fields, including math, humanities, and the natural sciences. Throughout the fall, CAIS and Scale AI crowdsourced questions from experts to assemble the hardest and broadest problems to stump the AI models. The exam was developed to address the challenge of “benchmark saturation”: models that regularly achieve near-perfect scores on existing tests, but may not be able to answer questions outside of those tests. Saturation reduces the utility of a benchmark as a precise measurement of future model progress.

“We wanted problems that would test the capabilities of the models at the frontier of human knowledge and reasoning,”  said Dan Hendrycks, CAIS co-founder and executive director. “We can’t predict how quickly the models will advance. When I released the MATH benchmark—a challenging competition mathematics dataset—in 2021, the best model scored less than 10%; few predicted that scores higher than 90% would be achieved just three years later. Right now, Humanity’s Last Exam shows that there are still some expert closed-ended questions that models are not able to answer.  We will see how long that lasts.”

Testing Methodology

Altogether, CAIS and Scale researchers collected more than 70,000 trial questions. That led to a selection of 13,000 questions for human expert review which, in turn, were finalized to a set of 3,000 questions on the final exam’s public release. The questions were aimed at world-class expert levels and were put to several multi-modal, frontier LLMs including OpenAI GPT-4o, Anthropic Claude 3.5 Sonnet, Google Gemini 1.5 Pro, and OpenAI o1.

“We know the AI revolution is being shaped by human ingenuity, and we’re proud to be at the forefront. To help humans measure AI progress, we engineered what might be the ultimate test, meticulously distilled and designed to challenge the world’s most advanced models at the frontiers of intelligence—requiring precise, multi-step logical reasoning and unambiguous answers at a level that pushes even the most sophisticated AI systems to their limits.” Summer Yue, Director of Research at Scale AI said.

Humanity’s Last Exam was a global collaborative effort involving nearly 1,000 contributors from more than 500 institutions across 50 countries, with most contributors being active researchers or professors. The questions spanned multiple formats, including text-only and multi-modal challenges that integrated images and diagrams.

The questions were designed to deeply test the capability of the models across diverse domains. For example, a question submitted in Ecology asked:
“Hummingbirds within Apodiformes uniquely have a bilaterally paired oval bone, a sesamoid embedded in the caudolateral portion of the expanded, cruciate aponeurosis of insertion of m. depressor caudae. How many paired tendons are supported by this sesamoid bone? Answer with a number.”

Additional sample questions can be found here (lastexam.ai).

In the final round of testing, Yue said they saw some of the models begin to answer a fraction of the questions correctly (less than 10%); however, she said variations frequently happen in model testing and could be the result of randomness. CAIS and Scale AI said they will open up the dataset to the research community, to dig deeper into the variations and to evaluate new AI systems while continuing to explore the limitations of existing models. A small subset of questions will be held back to preserve integrity for future evaluations.

Top Questions

CAIS and Scale AI offered financial awards for the best contributions to Humanity’s Last Exam, with $5,000 USD awarded for each of the top 50 questions and $500 USD for the next 500 best submissions, along with the opportunity for coauthorship of the final paper.

“By identifying the gaps in AI’s reasoning capabilities, Humanity’s Last Exam not only benchmarks current systems but also provides a roadmap for future research and development,” said Yue.

About The Center for AI Safety
The Center for AI Safety (CAIS) is a research organization whose mission is to reduce societal-scale and national security risks from AI. CAIS research focuses on mitigating high-consequence risks in areas like monitoring, alignment, and systemic safety. CAIS works to expand the field of AI safety and security by providing compute resources and technical infrastructure to top researchers and engaging with the global research community. Through its CAIS Action Fund, CAIS advocates for safe and secure AI. CAIS was founded in 2022 and is headquartered in San Francisco.

About Scale AI
Scale AI is the Humanity-first AI Company. Backed by our Data Foundry, we generate high quality data and provide technology solutions that allow our enterprise and public sector customers to build, deploy, and evaluate the smartest AI tools and applications. By making data abundant, rigorous, and high-quality, we are accelerating the progress of AI. Scale AI was founded in 2016 and is headquartered in San Francisco.

Contact:
Richard Crook, richardc@safe.ai
Fiorella Riccobono, fiorella.riccobono@scale.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/cais-and-scale-ai-unveil-results-of-humanitys-last-exam-a-groundbreaking-new-benchmark-302358108.html

SOURCE Center for AI Safety

Continue Reading

Technology

Global Security & Technology Summit Unveils Month-Long Program of Activities Ahead of December Event

Published

on

By

RIYADH, Saudi Arabia, Oct. 24, 2026 /PRNewswire/ — The Organizing Committee of the Global Security & Technology Summit (GSTS) held an introductory session today at the Ministry of Interior’s headquarters in Riyadh, bringing together representatives from the government, private, and nonprofit sectors to introduce the program of activities leading up to the summit. The upcoming summit will be held in Riyadh under the patronage of HRH Prince Mohammed bin Salman bin Abdulaziz Al Saud, Crown Prince and Prime Minister, under the supervision of HRH Prince Abdulaziz bin Saud bin Naif bin Abdulaziz Al Saud, Minister of Interior, and organized by the Ministry of Interior in cooperation with Tuwaiq Academy.

During the session, the Organizing Committee presented the comprehensive GSTS program, comprising three key components: GSTS Month, running from November 1 to 30, 2026; the Global Security & Innovation Fair (SAIF), taking place from November 24 to 26, 2026; and the main Summit, scheduled for December 18 to 20, 2026, in Riyadh. Together, these events form an integrated program designed to advance security and technology innovation, strengthen national capabilities, and foster international cooperation.

GSTS Month will feature working groups, boot camps, training programs, knowledge-sharing sessions, and technical workshops across Saudi Arabia’s 13 administrative regions, delivered both in person and remotely in collaboration with specialized entities. The month-long program aims to develop national capabilities, identify emerging talent, enrich knowledge-sharing opportunities, and equip professionals with the knowledge and skills needed to develop innovative solutions to future security and technology challenges.

The main Summit will bring together global leaders, decision-makers, experts, and innovators to explore the future of security and technology, promote the integration of advanced technologies within the security sector, strengthen national capabilities, support innovation, and foster international cooperation, further positioning the Kingdom as a global hub for security and technology.

Showcasing the latest technological breakthroughs and security solutions, the summit will bring together government entities, private sector organizations, academic institutions, and research centers to facilitate knowledge exchange and collaboration across key fields, including cybersecurity, artificial intelligence (AI), the Internet of Things (IoT), smart security solutions, emerging technologies, and crisis management. The program will also feature main sessions, specialized discussions, and interactive exhibitions. Registration is available at gsts.sa.

Advisor to HRH the Minister of Interior and Chairman of the GSTS Organizing Committee, Ahmed Altowayan, stated that the summit builds on Saudi Arabia’s efforts to establish an advanced security and technology ecosystem focused on knowledge and innovation, keeping pace with rapid developments and future challenges.

Mr. Altowayan noted that the summit is a global platform for strengthening cooperation and exchanging expertise, anticipating future developments in security and technology, and developing strategic partnerships and innovative solutions that enhance the efficiency and readiness of security systems.

Vice Chairman of the GSTS Organizing Committee, Eng. Abdulaziz Alhammadi, said that the summit will offer a range of integrated programs and activities focused on enhancing national skills, encouraging innovation, and supporting international cooperation.

He added that GSTS Month will help build national capabilities, discover talent, and develop skills, with SAIF providing a platform for innovators and researchers from around the world to showcase leading technological solutions, while the main Summit will bring together leaders and experts to discuss the future of security and technology and explore new strategic partnership opportunities.

SAIF will take place at the Riyadh International Convention & Exhibition Center, bringing together innovators, researchers, technology talents, and industry experts from around the world to showcase promising innovations and projects across 14 fields of technology and innovation. The fair will provide opportunities to engage with project owners, including students, graduates, and entrepreneurs, and explore the different stages of innovation development through interactive zones, panel discussions on emerging security and innovation trends, and knowledge-sharing workshops led by specialists. Visitor registration is open to participants from within and outside the Kingdom through saifair.sa.

The introductory session also featured contributions from representatives of government, private, and nonprofit sector entities, alongside members of the media. Discussions focused on developing national capabilities in security and technology, strengthening students’ technical expertise, translating scientific research into practical solutions, and supporting Saudi companies in developing security and technology solutions and advancing digital transformation.

Organized by the Ministry of Interior in cooperation with Tuwaiq Academy, GSTS is produced by Tahaluf, with the Ministry of Education serving as Strategic Scientific Partner, Tahakom as Founding Partner, and Elm as Principal Partner.

Registration for participants from within and outside the Kingdom is available at gsts.sa.

Click here to view the media kit. 

View original content to download multimedia:https://www.prnewswire.co.uk/news-releases/global-security–technology-summit-unveils-month-long-program-of-activities-ahead-of-december-event-302918695.html

Continue Reading

Technology

Axon Announces Body 5: Next-Generation Camera Built for the AI Era

Published

on

By

Axon Body 5 delivers 25x the AI processing power of earlier-generation cameras, with upgraded connectivity, audio and battery life to support real-time situational awareness in the field

SCOTTSDALE, Ariz., Oct. 24, 2026 /PRNewswire/ — Axon (Nasdaq: AXON), the global leader in public safety technology, today announced Axon Body 5, its newest body-worn camera designed to bring more powerful intelligence, connectivity and real-time support directly to officers in the field.

For years, Axon body cameras have helped agencies capture critical evidence and create greater transparency. Body 5 is built to help officers during the call, with information, assistance and backup on the spot.

“Officers shouldn’t have to choose between getting information and watching the scene. With Axon Body 5, they don’t,” said Rick Smith, Axon Founder and CEO. “They capture a license or document with the camera, keep their hands free and eyes up, and get information faster than writing it down and calling it in by radio. An officer fully engaged with the person in front of them, not down at a notepad, is a safer officer and a better-served community.”

Axon Body 5: Built for the AI Era

Built from the ground up for the AI era, Axon Body 5 delivers 25x the AI processing power than earlier generation Axon body cameras, alongside advancements in connectivity, audio, video and battery life. Together, these upgrades give the camera the physical power to run smarter AI features — both today and as new AI tools are developed in the future — while also making it more dependable for officers to use every day. 

For the first time, Axon is also introducing two versions of its latest flagship camera: Axon Body 5 and Axon Body 5 Pro.

Both models feature several key advancements, including:

25x more processing power for AI: A powerful new computing architecture creates the capacity to support current and future AI features directly on the body camera.Enhanced video: Improved video captures clearer evidence across challenging environments, including better low-light performance.Improved connectivity: Seamless connectivity in urban and remote environments – and more precise location capability – helps officers, cameras and remote support teams stay connected when timely information matters most.Longer battery life: 20% more battery life than the previous generation helps keep the camera ready and connected throughout an officer’s shift.

The Axon Body 5 Pro will continue to gain new AI capabilities as they become available, growing along with the AI Era Plan. Additionally, new hardware features include:

A near-focus camera: An additional dedicated camera lens lets officers scan driver’s licenses to check status and search for wants or warrants in seconds, without returning to the patrol vehicle, with relevant information sent to Axon Fusus to support real-time operations.Front-facing speakers: Four additional speakers project even more powerful audio toward the person an officer is speaking with, helping real-time translations from Axon Assistant carry more clearly over heavy traffic or crowd noise. Additional memory: Extra space lets the camera run several AI tools at once, helping officers stay better informed and work faster.

Bringing More of Axon’s AI Era Into the Field

Axon Body 5 helps officers get more out of the Axon AI Era Plan by bringing smart tools right to the scene. Axon’s portfolio already supports public safety professionals across a growing range of tasks. For example, Draft One helps officers turn body-camera audio into high-quality report drafts and Axon Assistant provides voice-based information access and real-time translation.

Increasingly, Axon is also bringing AI into real-time operations.

Axon Guardian is a new category of AI features within the AI Era Plan that was specifically created to work with an officer’s field-based devices – starting with body cameras and in-car cameras – to improve safety. Guardian is designed to flag potential risks as situations unfold and create alerts when additional attention may be needed. Two of the first features include:

Escalation Detection: When an Axon Body 4 or Axon Body 5 camera is activated and recording, Guardian has the ability to detect potential conflicts in real time and create an alert in Axon Fusus. A human reviews the livestream and decides if additional support or action is needed.Approach Alert: When active on Axon Fleet 3, Guardian can detect if the door of a stopped vehicle opens and alert the officer through the in-car display and their body-worn camera.

Combined, Axon Body 5 and the expanding AI Era portfolio demonstrate the importance of AI as a critical resource to assist public safety professionals before, during and after an incident — reducing administrative burden, improving situational awareness and helping protect more lives.

Innovating Responsibly

Axon’s Responsible Innovation framework guides the development of all of its products. Designed with this in mind, Axon Body 5 and Guardian prioritize human oversight and maintain agency control over data. As a key part of the responsible innovation process, Axon’s independent Ethics and Equity Advisory Council was created to help responsibly develop and deploy new technologies with transparency, while aligning with community expectations.

General availability dates for Axon Body 5 and Axon Guardian will be announced soon. Product features and capabilities vary by configuration. For more information on Axon’s current products and services: Axon Product Catalog – Axon.com.

About Axon
Axon (Nasdaq: AXON) is the global leader in public safety technology supporting state, local, federal and international public safety agencies with technology designed to Protect Life. Complementing its mission, Axon’s growing Enterprise market focuses on protecting critical infrastructure and frontline workers across multiple industries including corporate security, hospitality, retail and healthcare. Founder-led since 1993, Axon builds products with transparency and responsibility. From TASER energy devices to today’s connected network of hardware – including cameras, drones, and robotics – cloud software, sensors, and AI-tools, the Axon ecosystem helps seamlessly protect people and places when it matters most. To ensure these technologies align with community expectations, Axon’s independent Ethics & Equity Advisory Council guides the ethical, inclusive, and accountable design of its products and services. Learn more about the EEAC and Axon’s Responsible Innovation framework at Axon Responsibility. 

Non-Axon trademarks are the property of their respective owners. Axon, TASER and the Delta Logo are trademarks of Axon Enterprise, Inc., some of which are registered in the US and other countries. For more information, visit www.axon.com/legal. All rights reserved.

Please visit https://investor.axon.com and https://www.axon.com/newsroom for more information.

Media Contact:
Kate MacKinnon
Vice President, Communications
press@axon.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/axon-announces-body-5-next-generation-camera-built-for-the-ai-era-302918553.html

SOURCE Axon

Continue Reading

Technology

In HelloNation, Custom Fabrication Expert Mark Coyle Explains a Common Mistake in Custom Aluminum Design

Published

on

By

The article explains why smart geometry, not thicker walls, creates stronger, more efficient aluminum components.

ROCHESTER, N.Y., Oct. 24, 2026 /PRNewswire/ — What early design choice causes many custom aluminum projects to become heavier, costlier, or harder to manufacture? That question is addressed in a HelloNation article featuring insights from Custom Fabrication Expert Mark Coyle of American Custom Metals, Inc. in Rochester, New York, that outlines how misunderstanding aluminum behavior leads designers to rely on thick walls instead of stronger geometry.

The article begins by explaining that many people assume thicker walls automatically make aluminum parts stronger. It notes that aluminum does not respond to wall thickness the way steel does. Instead, its performance is shaped by how the metal flows through the extrusion die. The article states that custom aluminum design is more effective when profiles use ribs, chambers, and flanges to create stiffness without adding unnecessary weight. This guidance helps readers understand why adding material often increases cost without improving strength.

The article also highlights that thicker walls change how aluminum moves during extrusion. When heavy areas fill more slowly, the metal cools unevenly and can develop stress that only appears later. The HelloNation piece explains that well-balanced geometry keeps extrusion smooth and predictable. This consistency makes it easier to maintain dimensional accuracy across long production runs. By focusing on geometry, custom aluminum design avoids the problems that come with slow extrusion speeds and uneven cooling.

Another insight in the article centers on how ribs and internal supports influence stability. It describes how a thin wall supported by a properly placed rib often performs better than a thick wall with no reinforcement. This happens because the rib helps distribute load, improve stiffness, and guide the aluminum as it cools. The article explains that this structural approach makes custom aluminum design more efficient and gives designers more control over how the final part behaves under pressure.

The article also shows why early collaboration between designer and fabricator prevents costly changes. It states that a fabricator familiar with extrusion can catch potential issues before a die is built. Small adjustments to corners or transitions can remove weak points or improve metal flow. The article notes that this teamwork keeps the design aligned with real-world production. By working together early, both sides reduce the risk of redesigning the die after the first test run.

Machining is another area where the article explains how wall thickness affects performance. Features such as deep pockets or sharp internal angles may require slow feed rates or special tooling. When walls are thicker than needed, those areas can become difficult to machine cleanly. The article states that thoughtful custom aluminum design makes machining more predictable. Small changes, such as adding radiused edges or sizing features to match standard tools, help shorten cycle times and prevent tool wear.

Thermal behavior receives detailed attention as well. The article explains that aluminum retains heat differently depending on the mass of each section. Thicker walls hold heat longer, which increases the chance of distortion during extrusion, machining, or finishing. When a design uses geometry to create strength, the material cools more evenly. This reduces warping and helps long profiles stay aligned. The article notes that stable cooling is important for components that require a precise fit and consistent shape throughout an entire production run.

Cost is also a key topic in the article. It states that heavier profiles increase material use, extrusion time, and tooling needs. A custom aluminum design that relies on geometry instead of mass lowers material consumption and keeps the fabrication process efficient. The article explains that lighter parts are easier to handle, ship, and assemble. This saves money across multiple stages of production and supports long-term manufacturing efficiency.

The article also notes that smart custom aluminum design creates profiles that behave predictably during extrusion and machining. Smooth transitions, balanced wall dimensions, and structural features help reduce the chance of distortion or dimensional drift. These elements also lower scrap rates and support reliable performance. By using geometry instead of excess material, designers build parts that maintain strength without compromising manufacturability.

As the article concludes, it emphasizes that avoiding thick walls is one of the best ways to improve performance and lower cost. It states that the most dependable custom aluminum components come from designs that use structural features to strengthen the profile. When designers understand how aluminum behaves at each stage of extrusion and machining, they create parts that are strong, efficient, and consistent from batch to batch. This approach turns custom aluminum design into a predictable process rather than a series of uncertain adjustments.

A Common Mistake in Custom Aluminum Design features insights from Mark Coyle, Custom Fabrication Expert of Rochester, NY, in HelloNation.

About HelloNation
HelloNation is America’s Good News Network, a premier media platform built on the idea that good news travels faster when real people tell real stories. Through its community-focused publications and innovative “edvertising” approach, HelloNation delivers content that informs, inspires, and spotlights the leaders making a meaningful impact in their communities.

View original content to download multimedia:https://www.prnewswire.com/news-releases/in-hellonation-custom-fabrication-expert-mark-coyle-explains-a-common-mistake-in-custom-aluminum-design-302918282.html

SOURCE HelloNation

Continue Reading

Trending