Joon Ha Kim

Dooly tool streamlines LLM inference simulation by reducing profiling costs

Researchers have developed Dooly, a new profiling tool designed to make LLM inference simulation more efficient. Traditional simulators require extensive re-profiling for each configuration, which is time-consuming. Doo…