Ming Liu

Project Overview

As silicon systems evolve from monolithic chips to chiplet-based architectures, communication among chiplets resembles a network. High-bandwidth die-to-die interconnects have become the host’s internal networking fabric, connecting processors, memory, storage, and accelerators. Yet their communication behavior remains poorly understood, and today’s operating systems and runtime software remain largely unaware of this emerging communication substrate.

The ChipletNet (Host Chiplet Networking) project rethinks chiplet interconnects as a new form of intra-host networking. Drawing on layered networking principles, we develop communication abstractions, protocols, and system software that expose end-to-end visibility and enable efficient, predictable, and scalable communication across chiplet-based systems.

Challenges

Chiplet networking reshapes intra-/inter- host communications. Data now flows among processors, accelerators, memory/storage, and networking devices, which are built from interconnected compute chiplets, I/O chiplets, and memory modules. However, today’s hardware and software provide limited support for understanding and managing this communication substrate, leading to several challenges:

Our Approach

Our insight is that efficient chiplet networking can be achieved by applying communication abstractions, principles, and techniques from traditional networks. We ask: How can application data movement semantics be exposed to the underlying chiplet network so that communication can be analyzed, orchestrated, and optimized end-to-end? In this project, we develop communication abstractions, development tools, runtime systems, and operating system support that bridge applications and chiplet networks.

Here are the systems we have built.