envoy
PulseAugur coverage of envoy — every cluster mentioning envoy across labs, papers, and developer communities, ranked by signal.
6 day(s) with sentiment data
-
9 AI Agent Gateways Reviewed for Centralized Control and Security
An agent gateway serves as a crucial infrastructure layer for managing the interactions between AI agents and the resources they access, such as APIs, databases, and other agents. These gateways provide centralized cont…
-
Model Context Protocol needs gateway layer for HTTP API integration
The Model Context Protocol (MCP) has become a standard for AI agents to describe and invoke tools, with major agents like Claude, Cursor, and Codex now supporting it. However, a crucial gateway layer is missing for agen…
-
Team LLM API Key Management: Best Practices for Security and Budget Control
Managing Large Language Model (LLM) API keys for a team requires a robust system to prevent budget overruns and security breaches. Best practices include assigning individual keys to each developer, segmenting keys by e…
-
PayPal details Cosmos LLM Gateway for managing enterprise AI traffic
A research paper details the design and operation of the Cosmos LLM Gateway, a system developed at PayPal to manage enterprise-wide access to multiple large language models. The gateway, built on Envoy, separates contro…
-
PayPal deploys Cosmos LLM Gateway for multi-vendor AI traffic management
PayPal has developed and deployed the Cosmos LLM Gateway, a policy-driven system designed to manage large-scale enterprise AI traffic across multiple vendors. This gateway, built on Envoy and Rust WebAssembly, handles t…
-
Top 5 Open Source LLM Gateways for Managing AI Model Traffic
Several open-source LLM gateways are available to help applications manage requests to multiple AI models, including Bifrost, LiteLLM, Kong, Apache APISIX, and Agent Router. These gateways provide a unified API, model r…
-
Critical Brotli vulnerability Node2Shell impacts Node.js, Python, and HTTP apps
A critical vulnerability, dubbed Node2Shell (CVE-2026-111497), has been discovered in the Brotli compression library, affecting multiple programming languages and applications. The flaw allows for memory leakage or arbi…
-
Agent control planes are re-skinned API gateways, author argues
The author argues that the concept of an "agent control plane" is essentially a re-skin of existing infrastructure, rather than a new category of software. They break down the four core features of such a plane—cost met…
-
Load Balancers Struggle with LLM Serving Demands, 'llm-d' Offers Solution
This article delves into the challenges of using load balancers for serving Large Language Models (LLMs), particularly within containerized environments like Kubernetes. It highlights how traditional load balancing solu…
-
Stdio transport outperforms SSE for AI agent tool invocation latency
A recent benchmark evaluated the performance of two transport protocols, Standard Input Output (Stdio) and Server-Sent Events (SSE), within the Model Context Protocol (MCP). The study found that Stdio is superior for de…
-
Kubernetes and Envoy AI Gateway streamline AI workload management
The articles discuss the implementation and architecture of MLOps, focusing on running AI workloads at scale using Kubernetes. Key topics include using KServe for model serving on Kubernetes and the development of Envoy…
-
Google's HTTP/2 codec performance compared to Nghttp2; Plat-Painter tool introduced
A technical blog post compares the performance of Google's HTTP/2 codec against Nghttp2, finding that Google's implementation leads to slower performance in the Envoy proxy. Separately, a post introduces Plat-Painter, a…
-
eBPF socket steering scales QUIC ingress for HTTP/3 connection migration
This article details how to scale QUIC ingress for HTTP/3 connection migration, a challenge that arises when clients change IP addresses. Traditional UDP proxies, which rely on hashing the client's IP and port, fail whe…
-
Modal launches ultra-low-latency servers for high-performance applications
Modal has introduced a new feature called Modal Servers, designed to provide ultra-low-latency server hosting for applications requiring high performance, such as LLM inference for interactive agents. This new offering …
-
AI applications in molecular design and traffic management showcased at KCD Washington DC
Two speakers, Lin Sun and Erica Hughberg, presented on AI-related topics at KCD Washington DC. Lin Sun demonstrated the application of artificial intelligence in designing molecular nano-magnets and qubits, engaging the…
-
Envoy deploys self-driving wheelchairs at Miami Airport
Envoy has deployed self-driving wheelchairs at Miami International Airport to assist passengers. These autonomous wheelchairs are designed to navigate the airport independently, offering a new level of mobility assistan…
-
OpenAI Codex aids discovery of HTTP/2 server memory exploit
Security researchers have leveraged OpenAI's Codex to uncover a vulnerability known as the HTTP/2 Bomb. This attack method exploits server memory, and while fixes are available for some popular web servers like Nginx, A…
-
Starlette Host Header Flaw Exposes AI Agents to Remote Control
A critical security vulnerability exists in Starlette applications that use the Host header for authentication or routing, potentially exposing AI agents to remote control. Attackers can exploit this "BadHost" flaw to i…
-
May 2026 Digest: API Gateway Security and Performance Advances
This collection of articles from May 2026 details advancements in API gateway architecture, focusing on performance, multi-cloud deployment, and security. It covers implementing rate limiting with Bucket4j and Infinispa…
-
ArchGW launches open-source intelligent proxy for AI agent orchestration
ArchGW, an open-source intelligent proxy server, aims to simplify the development of agentic AI applications. It centralizes essential middleware functions such as agent routing, orchestration, safety guardrails, and mo…