Jeremy Howard of Answer.ai discussed his company's approach to practical AI research and development on the Latent Space podcast. Answer.ai focuses on techniques like fine-tuning and optimized inference, catering to those with limited GPU resources. The company has released several tools, including FSDP QDoRA for efficient model training and Cold Compress for KV cache compression, alongside FastHTML for web app development. Howard also teased a new system he's developing called 'AI Magic,' which he describes as 'dialogue engineering' aimed at increasing productivity. AI
Summary written by None from 1 source. How we write summaries →
RANK_REASON Podcast discussing practical AI R&D, new tools, and a new approach to dialogue engineering.
