Title: P1: P2: Negative sampling in NLP [2024-11-03 Sun]
- log(sigmoid(v_w * v_c)) - positive term with dot product
or cosine simularity.
- sum(log(sigmoid(-v_w * v_neg_i))) for i in range(k) -
negative term - minimize the similarity between the #dailyreport #negativesampleing #sampling #llm #recsys