Python with a Dash of C++: Optimizing Recommendation Serving

Thu, 30 Jun 2022 16:54:09 +0530

Serving recommendation to 200+ millions of users for thousands of candidates with less than 100ms is hard but doing that in Python is harder. Why not add some compiled spice to it to make it faster? Using Cython you can add C++ components to your Python code. Isn’t all machine learning and statistics libraries already written in C and Cython to make them super fast? Yes. But there’s still some optimizations left on the table. I’ll go through how I optimized some of our sampling methods in the recommendation system using C++.

c++ on AI Logs

Python with a Dash of C++: Optimizing Recommendation Serving