Picking up on some of the BIG IDEAS in brain research, which was wonderfully chaotic when we last discussed in December under the hashtag #BrainIdeasCountdown, e.g. https://neuromatch.social/@NicoleCRust/109557289393362842

Here's an attempt to fill in some blanks, and let's flip the hashtag: #BigBrainIdeas. I'll focus on the notion that there are facts, ideas and then there are "Big Ideas" and I'll focus on the last one. Please join in!

I'd argue that one of the most influential Big Ideas about the brain in the latter half of the 20th century is the is the notion that:

The neocortex of the brain is made up of a generic functional element that is repeated again and again and from this repetition, all of cortical function emerges

I'm talking about the cortical column, first described by Vernon Mountcastle in 1957. The unit contains ~10K neurons and humans have ~25 million of them. The rapid evolution of humans is proposed to have followed from a rapid expansion of cortex that happened because of this repetitive crystalline structure. The gist behind the "functional" bit is that each unit always does the same generic computation, and the different functions of different brain areas result from the different inputs that these units receive. @TrackingActions very nicely summarizes the ideas here: https://www.nature.com/articles/s41583-022-00658-6

So what does this generic functional unit do? Proposals vary. One idea, also reflected in deep convolutional neural networks, is that it does two(ish) things: selectivity and invariance, stacked repetitively to support things like recognizing objects. Other proposals suggest that the brain is a prediction machine and each unit contributes a little bit to those predictions in a manner that relies not just on feedforward connectivity, but also feedback. Some proposals suggest that the function of the unit varies along a gradient as a consequence of biophysical properties like receptor expression: https://www.nature.com/articles/s41583-020-0262-x.

Among brain researchers, this Big Idea is polarizing - obvious to some and misguided to others. Where are you in terms of your 'buy in' with this big idea?

#neuroscience #psychology #neuroAI #cognition @cogneurophys #BigBrainIdeas

Nicole Rust (@[email protected])

Here's a slightly more provocative way to pose the question: In The Idea of the Brain, Matthew Cobb argues, "In reality, no major conceptual innovation has been made in our overall understanding of how the brain works for over half a century ... we still think about brains in the way our scientific grandparents did." Setting aside semantic debates about what constitutes a "major conceptual innovation", brain researchers are clearly working on a large number of ideas that their grandparents had not thought of. But what are those, exactly?

Neuromatch Social
@NicoleCRust @TrackingActions @cogneurophys I am not sure that this idea has actually been very influential on the grand scale of neurocog theories. The modern theoretical approach seems to revolve around understanding how brain areas connect in networks to solve problems, and I can't see how generic computation would inspire/drive this perspective.
@bwyble @TrackingActions @cogneurophys
The idea spawned maps like this, which have been highly influential for neurocog theories, no?
@NicoleCRust @TrackingActions @cogneurophys I thought that diagram was the result of neuroanatomy studies. Why would a generalized function theory lead to a highly specific wiring diagram like this?
@bwyble
Yes, but ... Felleman & Van Essen defined the hierarchical levels of this diagram according to the cannonical microcircuit rule: L4 receives input; L2/3=feedforward output; L4/5=feedback output.

@NicoleCRust @bwyble

That rule was derived from anatomy too.

@DrYohanJohn @NicoleCRust I agree with Yohan, I don't think the microcircuit is crucial there, rather it's observing that there are laminar patterns that are more or less ubiquitous.
@bwyble @DrYohanJohn
Interesting! To me, those ideas could not be more connected.

@NicoleCRust @bwyble @DrYohanJohn

shameless plug, read my CONB on this topic with Adam K, for my more edited, fleshed out opinion!
https://www.sciencedirect.com/science/article/pii/S0959438822001246

(just insert "microcircuit motif" whereever you read cell-type, Adam K. and I disagree about which phrase is the better one :p)

I get the argument about confusing implementation and computation, but I agree with with @NicoleCRust that the idea of canonical cortical computations has been super influential, especially / at least in vision (which is all of computational neuro anyway, amiright?)

I think the idea of simple, repeated computation is kind of necessary / permissive for a certain types of "grand unified theory" that are very intuitively appealing exactly because they squash together computation and implementation into one little thing that is intuitively understandable in words. The fact that these "theories" are conceptually "small" down to implementation mean that people understand them, they catch on, they drive research.

Now whether this is positive or not, is an open debate. But I think there's no way we can say that ideas like predictive processing, backprop, divisive normalization, and maybe even convolution havent been wildly influential in the field.

To state this in a slightly more aggressive way than I feel: I do think the idea of a canonical microcircuit is very useful, because it's studiable! If we just start off by assuming everything is brain soup it's very easy to just give up and assume we'll never understand implementation. I rather start off with the assumption that there exist architectural motifs that matter, and try to take that as a hypothesis from which to start, than just admit defeat.

So maybe the answer is, it depends on the level of explanation you are lookign for. If you dont care baout multilevel understanding then "how brain regions connect in networks" black box type of understanding is enough. I personally think it's only step 1, and then understanding more details of implementation is step 2. Furthermore, I've come to think that the implementation detaiuls will probably constrain and help us understand the higher level.

@achristensen56

I agree completely! In fact this aligns very nicely with what I said about normative arguments. It would definitely be nice if we could think of each cortical area/column as processing its inputs in a generic manner. But it's an empirical question whether the idealization is true.

And it may well be that a second term in the infinite series (which I am considering in part because of my anatomist colleagues) may add functional flexibility.

@NicoleCRust @bwyble

@achristensen56 @NicoleCRust @bwyble

In other words, there is a whole continuum between "columns are interchangeable" and "each cortical column is a unique snowflake". Systematic architectonic variation has been observed: the challenge now is for a few computational neuroscientists to imagine a few functional/computational stories for why it's there.

This is why I used the term "cortical spectrum": it's not giving up, any more than the EM spectrum requires giving up.

@DrYohanJohn @achristensen56 @bwyble
I like this idea, a lot.

@NicoleCRust @DrYohanJohn @achristensen56 @bwyble

This discussion makes me think that if the cortical columns are elementary circuits for computations that are compounded to form the cortical surface, does this imply that these computations necessarily involve topographical maps?

I find it hard to imagine that the same computations could be performed if the microcircuits were randomly placed on the cortical surface. The total length of the wiring would not allow it, while minimizing the length of the wiring would produce topographic maps (retinotopy, orientation maps, somatosensory maps, ...).

@laurentperrinet @NicoleCRust @DrYohanJohn @achristensen56 I think there are several reasons for using topographic representations. One of them is reducing intracolumnar wiring costs as you say.

But also, topography is a way to innately encode information about the environment. In the physical world, sampled light from nearby locations is more likely to be from the same object/surface/location, and so it makes sense to cluster the processing of light according to its location on the retina. This makes it easier for attentional modulation to select the cortical areas processing a given object/boundary. The same argument can be made for the auditory, somatosensory, motor domains, and this can be extended to higher order cognitive aspects as well, like language, etc.

@bwyble @laurentperrinet @NicoleCRust @achristensen56

Yup. Topography is a great way to group signals in a way that preserves spatial relations (including in abstract spaces).

What sorts of topographic map have been found in higher cognitive areas? Even place cells show no topography, given remapping etc.

@DrYohanJohn @bwyble @laurentperrinet @NicoleCRust @achristensen56 Topographic maps have been shown for numerosity and timing, illustrating that the computational benefits of topography extend to -at least some- cognitive functions in association cortex

@dumoulin @DrYohanJohn @bwyble @laurentperrinet @NicoleCRust @achristensen56

Traveling waves also imply topography as a ubiqitous theme (not just for spatial representations). Organized waves of activity suggest that there is something underneath that is organized and being organized.

@dumoulin @DrYohanJohn @bwyble @laurentperrinet @NicoleCRust @achristensen56

You see traveling waves in places without very much spatial topography, like the prefrontal cortex. They behave in ways that suggest function like change direction with cognitive demands.
https://doi.org/10.1371/journal.pcbi.1009827

Is network topography a cortical motif? Or am I stretching the definition?

Traveling waves in the prefrontal cortex during working memory

Author summary We found that oscillations in the prefrontal cortex form “traveling waves”. Traveling waves are spatially extended patterns in which aligned peaks of activity move sequentially across the cortical surface. Some traveling waves were planar but most rotated. The prefrontal cortex is important for working memory. The traveling waves changed when monkeys performed a working memory task. There was an increase in waves in one direction over the other, especially in the beta band. Traveling waves can serve specific functions. For example, they help maintain network status and help control timing relationships between spikes. Given their functional advantages, a greater understanding of traveling waves should lead to a greater understanding of cortical function.

@ekmiller

In models it's easy to get traveling waves with stereotyped connectivity (such as on-center off-surround connections), but it's an open question as to how much structural variability one can admit while still getting waves.

An interesting question is how such global phenomena can simultaneously convey detailed information. My pet theory is that traveling waves help explore low-dimensional projections of information.

@dumoulin @bwyble @laurentperrinet @NicoleCRust @achristensen56

@DrYohanJohn @dumoulin @bwyble @laurentperrinet @NicoleCRust @achristensen56

Traveling waves also buffer recent local network activity and elapsed time. An analogy: You can tell from a still photo where and how long ago some pebbles were dropped.

@ekmiller @DrYohanJohn @dumoulin @bwyble @laurentperrinet @NicoleCRust @achristensen56 what's interesting about traveling waves in the brain is that the topology is tangled! it's not the euclidean topology of the 3d space that the brain occupies, but the manifold space of the projections: so neurons are "next to" one another in manifold space if they're connected even if they're not spatially next to one another in the brain.

So then traveling waves can have multiple spatial and temporal scales! waves can travel in local neural-topological space, but then can also travel in larger scales which get closer to resembling euclidean space and are the ones we measure with EEG and whatnot.

@ekmiller @DrYohanJohn @dumoulin @bwyble @laurentperrinet @NicoleCRust @achristensen56
so the suspicion I have from this is that traveling waves and other wavelike phenomena like scroll and spiral waves that you see in other excitable dynamical systems are actually way way way more common and way way way more determinative of function that we typically appreciate, but because we can't "untangle" the connectomic topology it plays out on we don't notice them as such and it ends up looking like the quasi-independent salt and pepper activity we usually describe it as. Everyone should read Art Winfree's geometry of biological time for how these dynamical regimes are almost unavoidable in excitable dynamical systems!

But again with the "multiple dynamical regimes at different scales" thing - wavelike phenomena also should happen with much less but still nonzero effect in a quasi-euclidean way via #EphapticCoupling - extracellular space is obvs tightly packed full of resistive tissue and everything so it's not strictly euclidean either, but moreso than the connectomic dynamical manifold.

This is the kinda thing that makes me wish I stayed doing neuroscience, bc I feel like these are sort of inescapable truths of how the brain works - that should be super important for understanding it! - but I have seen almost no work that really takes them seriously (but would love to because I'm sure it's out there)

#Topology #NeuralTopology #DynamicalSystems

@jonny
I have the same suspicion!

I like to sometimes play around with 2D grids of neurons. There are so many intriguing patterns. For the most part I have no idea what function they could serve... but it seems really easy to get patterns like these. And in 3D you'd presumably get all kinds of convection cells.

Here each pixel represents a model neuron's activity.

@ekmiller @dumoulin @bwyble @laurentperrinet @NicoleCRust @achristensen56

#Neuroscience

Perhaps we should have a hashtag for 'recreational' simulations? :)

#Neuroscience

@DrYohanJohn Nice! Is there a code repo somewhere? 😀