Amazon deploys new RNG network topology, claims 45% cost savings

By PulseAugur Editorial · [7 sources] · 2026-07-14 21:00

Amazon has developed and deployed a new network topology called Resilient Network Graphs (RNG), which deviates from traditional fat tree architectures. RNG utilizes a random graph concept, employing shuffle boxes instead of direct connections between Top of Rack (ToR) switches. This approach, supported by Amazon's proprietary routing protocol Spraypoint, claims to offer up to a 45% cost saving compared to fat trees. AI

IMPACT This new network topology could enable more cost-effective and scalable infrastructure for AI workloads.

RANK_REASON This is a significant infrastructure development from a major tech company, detailing a new network topology and its claimed benefits.

Read on X — SemiAnalysis →

AI-generated summary · Google Gemini · from 7 sources. How we write summaries →

Amazon deploys new RNG network topology, claims 45% cost savings

COVERAGE [7]

X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:01

If you want to learn more about RNG, please check our networking model. (7/7)

If you want to learn more about RNG, please check our networking model. (7/7) https://t.co/kqt0IiSiFi
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:01

Overall, with the reduction in layers, Amazon is claiming up to 45% cost saving compared to fat trees on a similar oversubscription ratio. As of now, RNG is the

Overall, with the reduction in layers, Amazon is claiming up to 45% cost saving compared to fat trees on a similar oversubscription ratio. As of now, RNG is the first network based on random graphs concept deployed at scale. Amazon has currently deployed only 2 version of RNG:
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:01

In RNG, the ToRs are not directly connected to each other, but via shuffle boxes, which are passive optical components. On the standard design, the datacenter i

In RNG, the ToRs are not directly connected to each other, but via shuffle boxes, which are passive optical components. On the standard design, the datacenter is composed of 10 rooms, with 96 ToRs and 192 shuffle boxes per room, and 64 servers per ToR (6,144 total). (5/7) https:/…
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:01

This implies major changes on the software stack as the infrastructure is fundamentally different from traditional networks. For RNG, Amazon introduced Spraypoi

This implies major changes on the software stack as the infrastructure is fundamentally different from traditional networks. For RNG, Amazon introduced Spraypoint, their own routing protocol that maps all the routes from a source to a destination. Spraypoint also split packets ht…
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:01

As its name suggests, random graphs networks are based on random cabling. This allows for a flat topology where the Top of Rack (ToR) switches are used as waypo

As its name suggests, random graphs networks are based on random cabling. This allows for a flat topology where the Top of Rack (ToR) switches are used as waypoints to route packets within the network. (3/7)
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:00

Fat trees are hierarchy-like network topologies and various cabling strategies are applied (full mesh, rail-based or planar) depending on the network design to

Fat trees are hierarchy-like network topologies and various cabling strategies are applied (full mesh, rail-based or planar) depending on the network design to balance between cost, radix and latency. (2/7) https://t.co/glvC29Kbzh
X — SemiAnalysis TIER_1 English(EN) · SemiAnalysis_ · 2026-07-14 21:00

In May, Amazon unveiled its latest network topology called RNG for Resilient Network Graphs. Unlike traditional fat trees, RNG relies on random graphs concept.

In May, Amazon unveiled its latest network topology called RNG for Resilient Network Graphs. Unlike traditional fat trees, RNG relies on random graphs concept. (1/7)🧵 https://t.co/q44sc2ukhl

COVERAGE [7]

If you want to learn more about RNG, please check our networking model. (7/7)

Overall, with the reduction in layers, Amazon is claiming up to 45% cost saving compared to fat trees on a similar oversubscription ratio. As of now, RNG is the

In RNG, the ToRs are not directly connected to each other, but via shuffle boxes, which are passive optical components. On the standard design, the datacenter i

This implies major changes on the software stack as the infrastructure is fundamentally different from traditional networks. For RNG, Amazon introduced Spraypoi

As its name suggests, random graphs networks are based on random cabling. This allows for a flat topology where the Top of Rack (ToR) switches are used as waypo

Fat trees are hierarchy-like network topologies and various cabling strategies are applied (full mesh, rail-based or planar) depending on the network design to

In May, Amazon unveiled its latest network topology called RNG for Resilient Network Graphs. Unlike traditional fat trees, RNG relies on random graphs concept.

RELATED ENTITIES

RELATED TOPICS