Connect with us

Technology

FuriosaAI Ends 2024 on a High Note: Llama 3.1 Performance, SDK Release, Leadership Expansion

Published

on

SANTA CLARA, Calif., Dec. 19, 2024 /PRNewswire/ — FuriosaAI, an emerging leader in AI semiconductor solutions, is closing out the year with rapid technical and customer progress with its second-generation chip, RNGD (pronounced ‘Renegade’). The recently announced AI solution has achieved compelling performance metrics in real-world enterprise deployments meeting the demand for inference with advanced large language and multimodal models.

The new performance benchmarks showcase RNGD’s ability to meet industry-leading throughput demands for Llama 3.1 models, including the 8B and 70B variants, with additional optimizations already in progress. The company also announced key software features that bring advanced optimization for customers currently sampling RNGD hardware in their production environments. These achievements represent the first phase of Furiosa’s vision for AI infrastructure that overcomes the inherent limitations of GPUs.

RNGD delivers winning throughput metrics with Llama 3.1 8B and 70B:

Building on the AI-native Tensor Contraction Processor (TCP) architecture of RNGD, Furiosa is redefining real-world AI deployments, delivering unmatched performance, programmability, and power efficiency. Furiosa’s RNGD recently achieved a throughput of 3,200–3,300 Tokens per Second (TPS) when running the LLaMA 3.1-8B model. In single-user scenarios, RNGD consistently delivers 40–60 TPS performance.

Additionally, RNGD demonstrates exceptional power efficiency, consuming 181W per card, with further optimization efforts underway. Rather than excessively boosting per-user performance, the company aims to maintain performance levels exceeding typical text-reading speeds (10–20 TPS or higher) while optimizing for multi-user environments and achieving a balanced performance approach.

Furiosa is advancing the performance and efficiency of the LLaMA 3.1-70B model. With just two RNGD cards, LLaMA 3.1-70B can be executed effectively. Currently, a single server supports up to 100 concurrent user queries, with ongoing optimizations aiming to achieve 8,000 TPS per server when equipped with 8 RNGD cards.

With the release of SDK v2024.3.0, Furiosa will expand the range of preloaded models. The SDK will also include support for tensor parallelism, enabling seamless processing across multiple elements without requiring model modifications, and a torch.compile, providing the foundation for executing customized models. Integration with HuggingFace Optimum will further empower customers to leverage a broader variety of models.

Advanced optimization tools delivered to early RNGD customers:

Building on these milestones, domestic and global enterprise customers are conducting tests with Furiosa to find a more efficient solution for scaling the inference of their self-developed models, compared to their existing setup. Their objective is to manage TCO effectively as they prepare for large-scale AI adoption. Furiosa plans to provide a high-quality AI development environment through a powerful and user-friendly SDK optimized for RNGD. The SDK v2024.1.0, currently available through the Early Access Program (EAP), is designed to handle high-performance processing of multiple LLM serving requests. It incorporates optimization techniques such as PagedAttention, Block KV Cache, and Continuous Batching, while also supporting various token sampling methods, including Greedy, Beam Search, and Top-k/p. These features allow developers to seamlessly create AI services customized to meet a wide range of requirements. The SDK and online sample will be available after the release of v2024.3.0.

Furiosa remains committed to delivering the most sustainable AI deployment solutions through rigorous optimization at an unprecedented pace.

“With RNGD now in customers’ hands, we are accelerating the next generation of frontier LLMs to unlock emerging Agentic AI applications—bringing advanced reasoning capabilities to enterprise verticals, all at dramatically lower costs,” said June Paik, Co-Founder and CEO of FuriosaAI.

Furiosa Expands Global Footprint with Strategic Leadership Appointment

Furiosa is scaling production and expanding its leadership team with the appointment of Alex Liu as Senior Vice President of Product and Business. A Technology Emmy Award winner and co-founder of NETINT Technologies, Alex brings over 20 years of expertise in startup management, technology innovation, and strategic leadership. At NETINT, he spearheaded groundbreaking achievements, including the development of the world’s first VPU SoC, setting new industry benchmarks and securing the prestigious 2024 Technology Emmy Award. At Furiosa, Alex will lead global product management, go-to-market strategies, and partnerships to drive innovation and align the company’s AI-native technologies with a vision to empower the development of planet-scale AI infrastructure.

RNGD is currently sampling with customers, and mass production will ramp up in partnership with TSMC for 2025 availability. To learn more about Furiosa, please visit https://furiosa.ai/.

About FuriosaAI

FuriosaAI is a semiconductor company dedicated to creating sustainable AI computing solutions that make powerful AI accessible to all. With its innovative Tensor Contraction Processor architecture, FuriosaAI is revolutionizing the AI hardware landscape, offering unparalleled efficiency and programmability for the most demanding AI workloads. For more information, please visit https://furiosa.ai/.

View original content to download multimedia:https://www.prnewswire.com/news-releases/furiosaai-ends-2024-on-a-high-note-llama-3-1-performance-sdk-release-leadership-expansion-302336756.html

SOURCE FuriosaAI

Continue Reading

Technology

ST Engineering iDirect and MBSat Partner to Build Next-Generation Sovereign Connectivity Services Across Oman and the Middle East

Published

on

By

Intuition ground system selected to support MBSat’s planned 2027 service launch, enabling accelerated deployment, dynamic resource management and scalable service growth

HERNDON, Va., Oct. 25, 2026 /PRNewswire/ — ST Engineering iDirect today announced a strategic partnership with Mohammed Al Barwani Satellite Company (MBSat), part of Mohammed Al Barwani Group, to provide the ground system technology foundation for MBSat’s next-generation satellite gateway and network operations across Oman and the wider Middle East region. Intuition will provide a flexible, software-defined foundation to support sovereign connectivity services, enabling efficient service deployment, dynamic resource management and scalable network operations.

Intuition will deliver a turnkey ground segment solution that accelerates deployment, simplifies operations and gives MBSat the flexibility to scale services as demand grows. The software-defined platform enables dynamic resource management, service automation and seamless integration with existing and future operational systems. The solution also includes Ka-band gateway infrastructure, service provisioning and management capabilities, open API integration frameworks, training and full-lifecycle support. Together, these capabilities will help MBSat launch and operate services efficiently while adapting to evolving market requirements.

The network will leverage capacity from MB Sat-1, a sovereign MicroGEO satellite, with planned service launch in 2027, to support flexible, scalable connectivity services across the region.

The partnership reflects growing investment in sovereign communications infrastructure across the Middle East as operators seek greater control over service delivery, network expansion and long-term technology evolution.

“This partnership represents an important milestone in our efforts to build an advanced satellite communications platform in Oman and the region,” said Ammar Al Rawahi, General Manager, MBSat. “Through our collaboration with ST Engineering iDirect, we are establishing the technical infrastructure required to launch services efficiently, respond to evolving customer needs and expand into new markets, supporting the sustainable long-term growth of our business.”

“We are providing MBSat with a flexible, software-defined ground platform that integrates with its existing operational environment,” said Sridhar Kuppanna, Chief Executive Officer, ST Engineering iDirect. “This enables more efficient service deployment and operations today, with the flexibility to scale, introduce new capabilities and evolve as requirements change.”

About ST Engineering iDirect

ST Engineering iDirect, a subsidiary of ST Engineering, is a global leader in satellite communications, providing technology and solutions that enable its customers to expand their business, differentiate their services and optimize their networks. Through its portfolio of ground infrastructure, intelligent networking and advanced satellite communications solutions, the company supports operators, service providers, governments and enterprises worldwide.

View original content to download multimedia:https://www.prnewswire.com/news-releases/st-engineering-idirect-and-mbsat-partner-to-build-next-generation-sovereign-connectivity-services-across-oman-and-the-middle-east-302918467.html

SOURCE ST Engineering iDirect

Continue Reading

Technology

ST Engineering iDirect and MBSat Partner to Build Next-Generation Sovereign Connectivity Services Across Oman and the Middle East

Published

on

By

Intuition ground system selected to support MBSat’s planned 2027 service launch, enabling accelerated deployment, dynamic resource management and scalable service growth

HERNDON, Va., Oct. 25, 2026 /PRNewswire/ — ST Engineering iDirect today announced a strategic partnership with Mohammed Al Barwani Satellite Company (MBSat), part of Mohammed Al Barwani Group, to provide the ground system technology foundation for MBSat’s next-generation satellite gateway and network operations across Oman and the wider Middle East region. Intuition will provide a flexible, software-defined foundation to support sovereign connectivity services, enabling efficient service deployment, dynamic resource management and scalable network operations.

Intuition will deliver a turnkey ground segment solution that accelerates deployment, simplifies operations and gives MBSat the flexibility to scale services as demand grows. The software-defined platform enables dynamic resource management, service automation and seamless integration with existing and future operational systems. The solution also includes Ka-band gateway infrastructure, service provisioning and management capabilities, open API integration frameworks, training and full-lifecycle support. Together, these capabilities will help MBSat launch and operate services efficiently while adapting to evolving market requirements.

The network will leverage capacity from MB Sat-1, a sovereign MicroGEO satellite, with planned service launch in 2027, to support flexible, scalable connectivity services across the region.

The partnership reflects growing investment in sovereign communications infrastructure across the Middle East as operators seek greater control over service delivery, network expansion and long-term technology evolution.

“This partnership represents an important milestone in our efforts to build an advanced satellite communications platform in Oman and the region,” said Ammar Al Rawahi, General Manager, MBSat. “Through our collaboration with ST Engineering iDirect, we are establishing the technical infrastructure required to launch services efficiently, respond to evolving customer needs and expand into new markets, supporting the sustainable long-term growth of our business.”

“We are providing MBSat with a flexible, software-defined ground platform that integrates with its existing operational environment,” said Sridhar Kuppanna, Chief Executive Officer, ST Engineering iDirect. “This enables more efficient service deployment and operations today, with the flexibility to scale, introduce new capabilities and evolve as requirements change.”

About ST Engineering iDirect

ST Engineering iDirect, a subsidiary of ST Engineering, is a global leader in satellite communications, providing technology and solutions that enable its customers to expand their business, differentiate their services and optimize their networks. Through its portfolio of ground infrastructure, intelligent networking and advanced satellite communications solutions, the company supports operators, service providers, governments and enterprises worldwide.

View original content to download multimedia:https://www.prnewswire.com/news-releases/st-engineering-idirect-and-mbsat-partner-to-build-next-generation-sovereign-connectivity-services-across-oman-and-the-middle-east-302918467.html

SOURCE ST Engineering iDirect

Continue Reading

Technology

Global Security & Technology Summit Unveils Month-Long Program of Activities Ahead of December Event

Published

on

By

RIYADH, Saudi Arabia, Oct. 24, 2026 /PRNewswire/ — The Organizing Committee of the Global Security & Technology Summit (GSTS) held an introductory session today at the Ministry of Interior’s headquarters in Riyadh, bringing together representatives from the government, private, and nonprofit sectors to introduce the program of activities leading up to the summit. The upcoming summit will be held in Riyadh under the patronage of HRH Prince Mohammed bin Salman bin Abdulaziz Al Saud, Crown Prince and Prime Minister, under the supervision of HRH Prince Abdulaziz bin Saud bin Naif bin Abdulaziz Al Saud, Minister of Interior, and organized by the Ministry of Interior in cooperation with Tuwaiq Academy.

During the session, the Organizing Committee presented the comprehensive GSTS program, comprising three key components: GSTS Month, running from November 1 to 30, 2026; the Global Security & Innovation Fair (SAIF), taking place from November 24 to 26, 2026; and the main Summit, scheduled for December 18 to 20, 2026, in Riyadh. Together, these events form an integrated program designed to advance security and technology innovation, strengthen national capabilities, and foster international cooperation.

GSTS Month will feature working groups, boot camps, training programs, knowledge-sharing sessions, and technical workshops across Saudi Arabia’s 13 administrative regions, delivered both in person and remotely in collaboration with specialized entities. The month-long program aims to develop national capabilities, identify emerging talent, enrich knowledge-sharing opportunities, and equip professionals with the knowledge and skills needed to develop innovative solutions to future security and technology challenges.

The main Summit will bring together global leaders, decision-makers, experts, and innovators to explore the future of security and technology, promote the integration of advanced technologies within the security sector, strengthen national capabilities, support innovation, and foster international cooperation, further positioning the Kingdom as a global hub for security and technology.

Showcasing the latest technological breakthroughs and security solutions, the summit will bring together government entities, private sector organizations, academic institutions, and research centers to facilitate knowledge exchange and collaboration across key fields, including cybersecurity, artificial intelligence (AI), the Internet of Things (IoT), smart security solutions, emerging technologies, and crisis management. The program will also feature main sessions, specialized discussions, and interactive exhibitions. Registration is available at gsts.sa.

Advisor to HRH the Minister of Interior and Chairman of the GSTS Organizing Committee, Ahmed Altowayan, stated that the summit builds on Saudi Arabia’s efforts to establish an advanced security and technology ecosystem focused on knowledge and innovation, keeping pace with rapid developments and future challenges.

Mr. Altowayan noted that the summit is a global platform for strengthening cooperation and exchanging expertise, anticipating future developments in security and technology, and developing strategic partnerships and innovative solutions that enhance the efficiency and readiness of security systems.

Vice Chairman of the GSTS Organizing Committee, Eng. Abdulaziz Alhammadi, said that the summit will offer a range of integrated programs and activities focused on enhancing national skills, encouraging innovation, and supporting international cooperation.

He added that GSTS Month will help build national capabilities, discover talent, and develop skills, with SAIF providing a platform for innovators and researchers from around the world to showcase leading technological solutions, while the main Summit will bring together leaders and experts to discuss the future of security and technology and explore new strategic partnership opportunities.

SAIF will take place at the Riyadh International Convention & Exhibition Center, bringing together innovators, researchers, technology talents, and industry experts from around the world to showcase promising innovations and projects across 14 fields of technology and innovation. The fair will provide opportunities to engage with project owners, including students, graduates, and entrepreneurs, and explore the different stages of innovation development through interactive zones, panel discussions on emerging security and innovation trends, and knowledge-sharing workshops led by specialists. Visitor registration is open to participants from within and outside the Kingdom through saifair.sa.

The introductory session also featured contributions from representatives of government, private, and nonprofit sector entities, alongside members of the media. Discussions focused on developing national capabilities in security and technology, strengthening students’ technical expertise, translating scientific research into practical solutions, and supporting Saudi companies in developing security and technology solutions and advancing digital transformation.

Organized by the Ministry of Interior in cooperation with Tuwaiq Academy, GSTS is produced by Tahaluf, with the Ministry of Education serving as Strategic Scientific Partner, Tahakom as Founding Partner, and Elm as Principal Partner.

Registration for participants from within and outside the Kingdom is available at gsts.sa.

Click here to view the media kit. 

View original content to download multimedia:https://www.prnewswire.co.uk/news-releases/global-security–technology-summit-unveils-month-long-program-of-activities-ahead-of-december-event-302918695.html

Continue Reading

Trending