Architecture Design

Data Preparation

Model Serving

Model Training

Requirement Gathering

Pay Range on Glassdoor

Predict Trip ETA on Uber

ML System Design

Two-Tower Model



The &#8220;two-tower&#8221; model is a type of neural network model often used in recommender systems to predict the relevance or preference of items for a user based on some sort of context. The name comes from the model&#8217;s structure, which is typically visualized as two separate towers (subnetworks) that handle two different types of inputs.



<figure class="wp-block-image"><img decoding="async" src="https://files.cdn.thinkific.com/file_uploads/481328/images/465/e93/a0a/Screen_Shot_2023-06-29_at_3.06.03_PM.png" alt=""/></figure>



Here&#8217;s a high-level breakdown of how a typical two-tower model is structured:



<ol class="wp-block-list">
<li>Query Tower: This component of the model handles user-related input. It could include information about a user&#8217;s past behavior, demographic information, user&#8217;s past purchases, browsing history, etc. The user tower processes this information and generates a representation (often a vector) that encapsulates the user&#8217;s preferences.</li>



<li>Product Tower: This component of the model handles product-related input. It might process information about a product&#8217;s features, historical data about how users have interacted with the item, item&#8217;s category, price, and more. Similar to the user tower, the item tower generates a representation (again, often a vector) that encapsulates the item&#8217;s characteristics.</li>
</ol>



The two vectors generated by the user and product towers are then combined in using dot product to predict that a user will buy an item. This score is used to recommend items to the user.



In essence, the tower aims to bring a user in close distance with products they may have a preference for. And, the corresponding user and product embeddings would be in close proximity to each other in the user-product vector space. We will discuss how the embeddings are used in model serving that involves the approximate nearest neighbor Index (ANN Index).



Retrieval



The retrieval model needs to be efficient in identifying a set of candidates relevant to a user given the query and history. In essence, the retrieval model needs to be “light” in the complexity of parameters and features required. This may mean that the model’s precision may decrease, but you gain the advantage of efficient serving time which is a requirement for this problem.



In terms of the choice of model, you could use a lighter version of the two-tower model which only incorporates user ID, a handful of user features (e.g. location) and search query.



<figure class="wp-block-image"><img decoding="async" src="https://files.cdn.thinkific.com/file_uploads/481328/images/27f/6a1/b2d/Screen_Shot_2023-06-29_at_3.27.45_PM.png" alt=""/></figure>



Ranking



The ranker model needs to be optimized for precision. Among the ~500 product candidates retrieved, you want to order the products based on the likelihood that the user will purchase one from the list. If the most relevant product is far down in the list, there’s less chance that the user will find the product in the result.



<figure class="wp-block-image"><img decoding="async" src="https://files.cdn.thinkific.com/file_uploads/481328/images/7b4/7e0/d66/Screen_Shot_2023-06-29_at_3.33.15_PM.png" alt=""/></figure>



To train such a model, you can use more complex model architecture that incorporates more signals and also includes deeper layers of neural networks.



Offline Evaluation



When evaluating the recommender system model offline, the following set of metrics you want to observe are:



<ul class="wp-block-list">
<li>Log-Loss</li>



<li>AUC</li>



<li>Precision@k</li>



<li>Recall@k</li>



<li>Mean Average Precision@k (MAP)</li>



<li>Normalized Discounted Cumulative Gain (NDCG)</li>
</ul>



Online Evaluation



The offline metrics alone are not sufficient in informing whether the recommender system is reliable or not. You need offline metrics. To do so, you can observe the following online metrics in the form of AB testing.



<ul class="wp-block-list">
<li>Impression Rate</li>



<li>Order Count</li>



<li>Revenue</li>
</ul>

Model Training

Join now to continue learning