Ai Infrastructure Gaps Deloitte Insights

The AI field needs optical modules

Optical modules convert electrical signals into light to move data quickly and reliably in AI systems, enabling fast and smooth data processing. Understanding their role is key to building efficient, scalable AI systems. This article. High-quality optical modules play a crucial role in this process, providing stable high-bandwidth and low-latency links for training and inference tasks, and effectively reducing data transmission error rates in large-scale clusters. Moreover, inference demand is spreading beyond one training.

China Unicom AI Server Centralized Procurement Bidding Opening

China Unicom's Zhejiang Branch has recently issued a tender for the procurement of domestic GPU servers in 2025. The plan involves acquiring 32 GPU servers and 8 ROCE switches, with an allocated budget of 40. Recently,China Unicom announced the results of the 2024 AI server open procurement,with Kunlun,Baud,Hongxin,and Changjiang. CITIC Securities announced that the centralized procurement bidding for China Unicom's server has been launched, focusing on investment opportunities in the information technology sector. Huawei, ZTE, Ericsson, Shanghai Nokia Bell, and Datang were the five winning bidders. China Mobile's centralized procurement project amounts to over 5 billion yuan, mainly awarded to traditional vendors such as ZTE and H3C.

[PDF Version]

How to use a transformer in an AI server

Deploy Hugging Face Transformers models with FastAPI REST API. Step-by-step tutorial with code examples, performance tips, and production setup. The Transformers library by Hugging Face provides a flexible way to load and run large language models locally or on a server. This guide will walk you through running OpenAI gpt-oss-20b or OpenAI gpt-oss-120b using Transformers, either with a high-level pipeline or via low-level generate calls. Machine learning, particularly Natural Language Processing (NLP), is transforming the way we build software. Whether you're improving search experiences with embedding models for semantic matching, generating content using powerful text-generation models, or optimizing retrieval with specialized. transformers-openai-api is a server for hosting locally running NLP transformers models via the OpenAI Completions API. The good news? You don't need a PhD to start using it.