Introduction to Recommendation Engines

Pascual Vila
AI & Machine Learning Instructor
"In the age of information overload, finding what we want is not the problem. Being presented with exactly what we need, before we even know we need it, is the true power of Recommendation Systems."
What is a Recommendation Engine?
A recommendation engine is a subclass of information filtering systems that seeks to predict the "rating" or "preference" a user would give to an item. They are primarily used in commercial applications (like Amazon, Netflix, and Spotify) to boost engagement, click-through rates, and ultimately, revenue.
The Data Collection Phase
Before algorithms can do their magic, they need data. Recommender systems generally rely on two types of user feedback:
- Explicit Feedback: Direct input from users regarding their interest in an item. Examples include 5-star ratings, "thumbs up / thumbs down", or written reviews. It is highly accurate but scarce.
- Implicit Feedback: Indirect tracking of user behavior. Examples include clicks, search history, page view duration, and purchase records. It is abundant but can be noisy (e.g., clicking by accident).
Types of Recommender Systems
While modern systems are complex and hybrid, they are generally built upon a few foundational architectures:
- Content-Based Filtering: Recommends items similar to those a user liked in the past. It focuses on item properties (e.g., genre, director, keywords).
- Collaborative Filtering (CF): Relies solely on past user behavior without requiring metadata about the items themselves. It assumes that if users agreed in the past, they will agree in the future.
- Hybrid Systems: Combines multiple approaches to overcome individual weaknesses (like the Cold Start problem).
What is the Cold Start Problem?+
The Cold Start problem occurs when the system cannot draw any inferences for users or items about which it has not yet gathered sufficient information. If a new movie is added to Netflix, no one has watched it yet, so Collaborative Filtering cannot recommend it until it gets initial views.