Srikanta Datta Tumkur
PulseAugur coverage of Srikanta Datta Tumkur — every cluster mentioning Srikanta Datta Tumkur across labs, papers, and developer communities, ranked by signal.
-
KV Cache Placement Strategies Explored for LLM Memory Efficiency
A new research paper explores optimal placement strategies for KV caches across different memory tiers (GPU HBM, CPU DRAM, SSD) to manage scarce GPU memory. The study, conducted using a discrete event simulator, found t…
-
LLM inference optimization research details cost-quality-latency trade-offs · 2 sources tracked
Two new research papers explore the trade-offs between inference optimization techniques for large language models (LLMs), focusing on cost, quality, and latency. The first paper, "The Inference Engineering Pareto Atlas…
-
KV compression cheaper than more GPUs for LLM serving, study finds
A new research paper compares two strategies for optimizing Large Language Model (LLM) serving: tensor parallelism and KV cache compression. The study, which simulated performance on A100, A40, and H100 hardware, found …