Modal Servers
PulseAugur coverage of Modal Servers — every cluster mentioning Modal Servers across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Modal launches Spindle open-source training server
Modal has launched Spindle, an open-source training server designed to be compatible with the Tinker API. Spindle aims to address the cost and customization limitations of per-token pricing models by allowing users to r…
-
Modal launches Sticky Sessions for stateful serverless applications
Modal has introduced a new feature called Sticky Sessions, designed to enhance its serverless compute capabilities for stateful applications. This feature ensures that all requests within a single user session are route…
-
New speculative decoding methods boost LLM inference speed and safety
Researchers are developing advanced speculative decoding techniques to accelerate large language model inference. HyperDFlash optimizes decoding for DeepSeek-V4's multi-hyper-connection architecture, improving draft acc…