Connect with us

Technology

Atomicwork and New Measure Unveil ITSMBench, a New Standard for Evaluating Frontier AI in IT Service Management

Published

3 months ago

on

Open-source benchmark shows that even the best-performing model completes only 50.56% of requests typically encountered by Enterprise IT service teams.

SAN FRANCISCO, Aug. 12, 2026 /PRNewswire/ — Atomicwork, the enterprise ITSM and ESM platform with an AI workforce to run it, and New Measure today announced ITSMBench, the first benchmark designed to evaluate how effectively models from OpenAI, Anthropic, xAI, GLM, and other developers and agent frameworks perform real-world IT Service Management work. By recreating the systems, workflows, and ambiguity that define modern enterprise service desks, ITSMBench gives the industry a realistic way to measure what AI agents can actually accomplish today.

“Frontier models are brilliant at writing code, but they are completely blind to the hidden security landmines inside enterprise workflows,” said Vijay Rayapati, co-founder and CEO of Atomicwork. “ITSMBench proves that blindly trusting an AI agent right now is an invitation for an enterprise security breach.”

A benchmark built around real enterprise IT work

Built jointly by Atomicwork and New Measure, ITSMBench recreates enterprise environments using 42 mocked software systems backed by nearly 1,800 database tables and more than 2,000 REST endpoints. The benchmark evaluates 89 service desk tasks spanning the kinds of L2 and L3 investigations enterprises handle every day, including identity and access management, devices, networking, security operations, infrastructure, and engineering escalations. Every environment, task, and evaluation is open source, allowing researchers and enterprises to reproduce results and build on the benchmark.

No frontier model comes close to completing every task

Initial evaluations show that today’s frontier models exhibit distinct strengths and weaknesses with different harnesses:

Grok 4.5 leads at tool discovery, finding the right APIs 83.0% of the time, but ranks near the bottom on actually finishing the job.Opus 5 performs best on execution, completing 63.5% of tasks once the right tools are in hand, despite having the weakest discovery rate at 70.2%.GPT-5.6 Sol splits the difference, landing between Grok 4.5 and Opus 5 across discovery and execution.GLM-5.2 is far cheaper, costing $0.25 per trial, but trails both Opus 5 and GPT-5.6 Sol on execution.

The benchmark also demonstrates that agent frameworks can materially affect both accuracy and cost, and that models frequently stop investigating after finding a plausible explanation instead of verifying the true root cause. Even when agents identify the correct resolution, they often leave related systems, records, or follow-up actions incomplete. Across the benchmark, 73 of 89 tasks were successfully completed at least once by at least one model, although no single model solved the full set.

“Enterprise service management demands more than reasoning,” said Arushi Gandhi, CEO at New Measure. “One model fits all is seldom the right answer. Enterprises that want an AI-run service desk need to optimize for accuracy, cost, and time to resolution at the same time. Getting this right, thus, takes a constellation of orchestrated models. ITSMBench is our proposed framework for CIOs and IT leaders to evaluate which models/harnesses are best for them for their enterprise IT needs.”

The ITSMBench benchmark, methodology, benchmark results, and open-source environments are available at atomicwork.com/itsm-bench.

About Atomicwork

Atomicwork is an AI-native ITSM and ESM platform that comes with an AI workforce to run it — purpose-built for companies scaling through intelligence, not just headcount. Its governed AI Coworkers run access management, incident response, onboarding, and other enterprise service delivery initiatives end-to-end. From AI-native scaleups to global enterprises, organizations of all shapes and sizes run on Atomicwork. The company is headquartered in Palo Alto, CA, and backed by leading investors including Khosla Ventures, Battery Ventures, Blume Ventures and Z47.

View original content to download multimedia:https://www.prnewswire.com/news-releases/atomicwork-and-new-measure-unveil-itsmbench-a-new-standard-for-evaluating-frontier-ai-in-it-service-management-302849673.html

SOURCE Atomicwork Inc

Related Topics:
Continue Reading

Technology

The First Cartridge-Free Smart Waterless Diffuser Is Here. What Would You Fill It With?

Published

45 minutes ago

on

November 14, 2026

By

Lephrone set out to solve a frustration for customers who want smart control over their home fragrance and the freedom to choose their own oils. The H300 is the first waterless diffuser to combine cartridge-free refills, Wi-Fi app control, smart home integration, and an in-app fragrance oil library with scanning and personal notes. Customers can use their favorite compatible oils, create their own blends, and use the app to set a scenting schedule and track how much oil is left.

NEW YORK, Nov. 14, 2026 /PRNewswire-PRWeb/ — “There are thousands of fragrance oils out there, so why lock yourself into just one brand?” said a Lephrone developer.

“Lephrone took the best of the diffuser world and left the worst behind.”

We wanted to make a device for people who need a ritual to unwind and want more control over their surroundings. There’s a whole world of sensory experiences out there, and our goal was to bring the way you manage scent at home into the digital world.

With the H300 lephrone diffuser, we kept what we liked about smart cartridge-based diffusers: Wi-Fi connectivity, lephrone app, voice control, and the ability to recognize oils and track how much is left. We made sure it supports both 2.4 GHz and 5 GHz Wi-Fi. We also did away with what frustrated us most: never-ending subscriptions, cartridges that run out too quickly, and limits on which oils you can use. With the H300, you get to choose the oils you want and create blends you love.

We also added support for multiple users and multiple diffusers, so everyone in the household can control the devices and set schedules. The H300 can run even when it’s offline.

We’re releasing our own fragrances, too. In the app, you can scan them into your personal fragrance library and write down how a scent made you feel, whether you liked it, and what others at home thought of it. That matters because after trying a few oils, it’s easy to forget which one you loved most or which one everyone else kept asking for.

We’re rolling this out to more Lephrone models next. Stay tuned.

Media Contact

Elina, Lephrone, 1 6463844148, info@lephrone.com, Lephrone

View original content to download multimedia:https://www.prweb.com/releases/the-first-cartridge-free-smart-waterless-diffuser-is-here-what-would-you-fill-it-with-302939367.html

SOURCE Lephrone

Continue Reading

Technology

HONGQI EHS4 Set for Global Debut in Venice: Eastern Elegance Arrives in Europe

Published

2 hours ago

on

November 14, 2026

By

VENICE, Italy, Nov. 15, 2026 /PRNewswire/ — HONGQI, one of China’s leading automotive marques, will introduce its all-new all-electric SUV, HONGQI EHS4, to the European market. Making its global debut in Venice, Italy, on 16 November 2026, the EHS4 marks another milestone in the brand’s international expansion.

68 Years of Heritage: A Distinctive Expression of Modern Luxury
Founded in 1958, HONGQI has spent 68 years building its automotive heritage through independent innovation, engineering excellence, and craftsmanship. Guided by a longstanding commitment to quality and safety, the brand continues to bring its distinctive heritage to a global audience.

With its Munich Advanced Design Centre, HONGQI combines global design perspectives with its rich Eastern heritage. Guided by a European Neoclassical Design Philosophy, the EHS4 brings together Eastern design influences and global aesthetics. Developed around European consumer needs, it represents HONGQI’s first model tailored specifically for Europe.

HONGQI EHS4: A New Choice for All-Electric Mobility
Bringing together Eastern and Western design aesthetics, HONGQI EHS4 balances distinctive styling, driving comfort and everyday practicality. Its Celadon Paint draws inspiration from the refined beauty of traditional Longquan celadon, while the Eyes of Infinite Allure lighting design creates a distinctive visual identity. Inside, the Crystal Control Knob adds an elegant touch to the cabin.

With a driving range of up to 470 kilometres and fast-charging capability of approximately 20 minutes, the EHS4 is designed for convenient everyday electric mobility. Its 87.4% space utilization makes intelligent use of interior space, enhancing passenger comfort and practicality.

Safety and quality remain central to its development. Equipped with seven airbags and intelligent driver-assistance technologies, the EHS4 draws on FAW’s more than 70 years of automotive manufacturing expertise to deliver advanced technology, refined driving quality, and dependable vehicle performance.

Venice: A New Chapter in Europe
On 16 November 2026, HONGQI EHS4 will make its global debut at the Scuola Grande di Santa Maria della Misericordia in Venice. The event will bring together European dealers, media representatives, and industry guests to witness an important milestone in HONGQI’s European journey.

A distinctive expression of Eastern elegance, now coming to Europe.

SOURCE HONGQI

Continue Reading

Technology

EFICYENT to Join Banks and Fintech Companies at Singapore FinTech Festival 2026

Published

8 hours ago

on

November 14, 2026

By

DUBAI, UAE, Nov. 14, 2026 /CNW/ — EFICYENT, a cross-border payment platform, is going to attend the Singapore FinTech Festival (SFF) 2026, which is going to be one of the world’s largest gatherings of the global financial and technology ecosystem.  It will take place between November 18 – 20, 2026, at Singapore. This event will converge policymakers, financial institutions, fintech companies, and investors to discuss the developments that are going to shape the future of fintech.

As financial institutions are desperately discovering new technologies, evolving payment infrastructure, and better ways to move money across borders, SFF 2026 is going to be an ideal platform for industry collaboration and knowledge exchange. The event will explore key forces transforming the financial system, including technology, geoeconomics, capital, talent, and policy, developing opportunities for businesses to engage with global industry leaders and explore emerging possibilities.

By participating in this event, EFICYENT is looking forward to connecting with other fintech companies, banks, financial institutions, and peer industry stakeholders to share their ideas, discover potential collaborations, and hold a conversation on the growing demand for efficient global payment infrastructure. Also, the company’s presence will provide an opportunity to demonstrate how its capabilities can assist businesses navigating increasingly interconnected financial markets.

Ahead of the participation, Aravinth Ramesh, CTO at EFICYENT, said:

“As financial services entered a chapter where businesses expect something beyond the ability to transfer money. They need payment platforms that offer speed, transparency, flexibility, and access to global markets. So I think events like SFF create a better opportunity to know in which direction the industry is moving, to share our perspectives with industry leaders, and explore partnerships that drive meaningful progress.”

Balasubramanyam K, CEO at EFICYENT, added:

“The future of fintech will be shaped by how effectively technology, financial institutions and payment networks work together. And this SFF event is going to remain an excellent opportunity to connect with industry leaders, better understand emerging requirements, and discover new approaches to making cross-border payments more accessible and efficient.”

About EFICYENT

EFICYENT is a global cross-border payments and financial infrastructure platform that concentrates on enabling seamless international money transfers.

They focus on simplifying international transactions and advancing digital finance. EFICYENT is committed to supporting a seamless and interconnected global payments ecosystem.

Media Contact: 
EFICYENT
Dubai, UAE
Website: https://eficyent.com/ 
Email: support@eficyent.com
LinkedIn: https://www.linkedin.com/company/eficyent/

View original content to download multimedia:https://www.prnewswire.com/news-releases/eficyent-to-join-banks-and-fintech-companies-at-singapore-fintech-festival-2026-302939546.html

SOURCE EFICYENT

Continue Reading

Trending