Notes from Netflix RecSysOps on operating recommender systems: issue detection, issue prediction, diagnosis, and resolution when a recommendation system goes into production.