When Dimensionality Hurts: The Role of #LLM Embedding Compression for Noisy Regression Tasks https://d.repec.org/n?u=RePEc:arx:papers:2502.02199&r=&r=cmp
"… suggest that the optimal dimensionality is dependent on the signal-to-noise ratio, exposing the necessity of feature compression in high noise environments. The implication of the result is that researchers should consider the #noise of a task when making decisions about the dimensionality of text.

… findings indicate that sentiment and emotion-based representations do not provide inherent advantages over learned latent features, implying that their previous success in similar tasks may be attributed to #regularisation effects rather than intrinsic informativeness."
#ML #autoencoders #Overfitting

'Manifold Learning by Mixture Models of VAEs for Inverse Problems', by Giovanni S. Alberti, Johannes Hertrich, Matteo Santacesaria, Silvia Sciutto.

http://jmlr.org/papers/v25/23-0396.html

#autoencoders #manifold #manifolds

'The Power of Contrast for Feature Learning: A Theoretical Analysis', by Wenlong Ji, Zhun Deng, Ryumei Nakada, James Zou, Linjun Zhang.

http://jmlr.org/papers/v24/21-1501.html

#autoencoders #supervised #generative

'Be More Active! Understanding the Differences Between Mean and Sampled Representations of Variational Autoencoders', by Lisa Bonheme, Marek Grzes.

http://jmlr.org/papers/v24/21-1145.html

#autoencoders #disentangled #representations

New preprint from our group ! 🧠 💻

*Whole-brain modelling of low-dimensional manifold modes reveals organising principle of brain dynamics*
https://www.biorxiv.org/content/10.1101/2023.11.20.567824v1

#brain #modeling #autoEncoders #variationalAutoEncoder #restingStateNetworks #manifold

real-time #anomaly detection
#python #algorithm
#autoencoders #machinelarning TensorFlow User Group (TFUG) Keras scikit-learn #neuralnetwork
#NAB #dataset ambient #temperature from a system that experienced a failure.
#risk #monitoring #maintenance

http://newdigitals.org/2023/10/23/real-time-anomaly-detection-of-nab-ambient-temperature-readings-using-the-tensorflow-keras-autoencoder/

'Lifted Bregman Training of Neural Networks', by Xiaoyu Wang, Martin Benning.

http://jmlr.org/papers/v24/22-0934.html

#autoencoders #classifiers #denoising

Conditional Sampling of Variational Autoencoders via Iterated Approximate Ancestral Sampling

https://openreview.net/forum?id=I5sJ6PU6JN

#autoencoders #sampling #sampler

A simple, efficient and scalable contrastive masked autoencoder for learning visual representations

https://openreview.net/forum?id=pjdxPts6er

#autoencoders #autoencoder #imagenet