I like that someone did a followup to 3blue1brown video on near-orthogonality:

Beyond Orthogonality: How Language Models Pack Billions of Concepts into 12,000 Dimensions

https://nickyoder.com/johnson-lindenstrauss/

> This research suggests that current embedding dimensions (1,000-20,000) provide more than adequate capacity for representing human knowledge and reasoning. The challenge lies not in the capacity of these spaces but in learning the optimal arrangement of concepts within them.

#highdimensional #math

Beyond Orthogonality: How Language Models Pack Billions of Concepts into 12,000 Dimensions

In a recent 3Blue1Brown video series on transformer models, Grant Sanderson posed a fascinating question: How can a relatively modest embedding space of 12,288 dimensions (GPT-3) accommodate millions of distinct real-world concepts? The answer lies at the intersection of high-dimensional geometry and a remarkable mathematical result known as the

Nick Yoder

🧠 New comprehensive review on #LowDimensional #embeddings of #HighDimensional data. Discusses how #dimensionalityreduction helps visualizing, exploring, and #modeling #ComplexSystems. From #PCA to #tSNE, #UMAP & #NeuralNetworks: Excellent overview paper👌

🌍 https://arxiv.org/abs/2508.15929

#CompNeuro #MachineLearning #DataVisualization

Let's start designing a new course for applied mathematics students in #UCLouvain, #EPL on high dimensional data analysis with 3 wonderful reference books #inverseproblem #highDimensional #statistics #optimization #Sparsity #teaching

I am looking for a new position in computational biology/bioinformatics preferably in #academia in the #USA.

I am an experienced Computational Biologist with eight years of post-PhD experience in applying computational methods across diverse domains, from molecular modeling to #highdimensional and #machinelearning based single-cell flow/mass cytometry and serum proteomics data analysis.

Any leads would be helpful.

#computationalbiology #bioinformatics #jobsearch #lookingforwork

Single cell omics #singlecellomics from bench to bedside: conference and workshop at KU Leuven in Belgium. Two days of technology and application in October give a deep insight in the nuts-and-bolts of the current state of the art. Meet Abhishek Garg, Yvan Saeyes, Sabine Tejpar, Baki Topal, Jessica Roelands, Steven de Vleeschouwer and more @cyrilpedia @chfloudas #biology #transcriptomics #proteomics #multiplexing #tissue #clinics #standardization #data #highDimensional
https://gbiomed.kuleuven.be/english/research/50000622/single-cell-course

Looks like advances in neural computing theory might have analog computing back with a vengueance. 🤯

#reservoircomputing #analog #computing #highdimensional #computingspace

https://www.nature.com/articles/srep22381

Fully analogue photonic reservoir computer - Scientific Reports

Introduced a decade ago, reservoir computing is an efficient approach for signal processing. State of the art capabilities have already been demonstrated with both computer simulations and physical implementations. If photonic reservoir computing appears to be promising a solution for ultrafast nontrivial computing, all the implementations presented up to now require digital pre or post processing, which prevents them from exploiting their full potential, in particular in terms of processing speed. We address here the possibility to get rid simultaneously of both digital pre and post processing. The standalone fully analogue reservoir computer resulting from our endeavour is compared to previous experiments and only exhibits rather limited degradation of performances. Our experiment constitutes a proof of concept for standalone physical reservoir computers.

Nature
@TedUnderwood "intuition about #highDimensional space" *grin*

Does anyone know of a research project which explored structuring oppositions in #highdimensional spaces constructed from fictional narratives? #digitalhumanities

I have come across this only from an approach in art history, where the artworks represented in the vector space were distributed in clusters, and therefore represented oppositions such as naturalism vs. impressionism.

See
https://digital-narratives.versae.es/#

Barr X Inception CNN

Can someone with better intuition about #highDimensional space tell me if this is right?