Mastodawn

The 90-year-old idea behind JEPA models: Canonical Correlation Analysis

https://shonczinner.github.io/posts/embedding-prediction/

#HackerNews #JEPA #models #Canonical #Correlation #Analysis #data #science #machine #learning #research

The 90-year-old idea behind JEPA models: Canonical Correlation Analysis (CCA) – Shon Czinner’s Blog

Harold Hotelling’s 1936 Canonical Correlation Analysis (CCA) forms the theoretical and intuitive foundation for modern embedding prediction techniques, including JEPA models.

Shon Czinner’s Blog