Offline evaluation options for recommender systems

ML systems fail in production due to infrastructure, not models

A recent article highlights the critical difference between testing an ML model in isolation and testing the entire production system. It details a scenario where a recommendation model, performing well in offline evalu…