\[
\operatorname{PMI}(\boldsymbol{y}) = \log p(\boldsymbol{y}) - \log \prod_{j=1}^q p(y_j)
\]

#information_theory