Gianni Gastaldi

55 Followers
87 Following
22 Posts
Philosopher of (formal) sciences and CS/NLP researcher at ETH. Vice-President of HaPoC. Formerly Professor at MO.CO.ESBA, Philosophy at ENS Paris.

New paper!
We have been interested in R-enriched adjunctions, motivated to understand structures arising from statistical data over textual corpora. This first paper delves into the geometric structure. A companion paper devoted to the logical structure induced by concatenation is being finalised. Stay tuned!

https://www.seiller.org/documents/articles/GeoNucleus.pdf

This is a joint work with @giannigastaldi, Samantha Jarvis (CUNY), and John Terilla (CUNY).

If you’re in NYC, come tomorrow and Friday to discuss Venarcular AI at the Digital Theory Lab NYU. @leifweatherby has put up a fantastique program, including David Chalmers, Wendy Chun, Tal Linzen, and other brillant colleagues. And if you’re not in NYC, you can also register to attend online. #AI #vernacularAI #criticalAI https://as.nyu.edu/research-centers/remarque/events/Spring-2025/vernacular-ai--2-day-symposium.html
Voici le prototype des bêtises qu'on peut dire sur les "LLM": https://static1.squarespace.com/static/6593e7097565990e65c886fd/t/6751eb240ed3821a0161b45b/1733421863119/in_context_scheming_reasoning_paper.pdf Confusion entre LLMs et applications, entre "intention" et manipulation de la langue, entre prise de décisions et production de texte, entre "entraînement" et réponse à un prompt... Mais c'est le discours pseudoscientifique à la mode aujourd'hui. Relisons les articles de @giannigastaldi qui met en garde contre la confusion entre la modélisation de la langue et la modélisation de l"'intelligence générale".

Yesterday, I gave a talk entitled “Does language have a logical structure?”.

I discussed a very recent collaboration with S. Jarvis and John Terilla (CUNY), G. Gastaldi @giannigastaldi, and L. Pellissier @lucpellissier.

I am quite excited about this work which relates categorical structures (nuclei of an adjunction), models of linear logic, and some approaches in natural language processing, with hints of projective tropical geometry.

Slides are here: https://www.seiller.org/Normes24.pdf

"Understanding the recent success of DNN models in NLP requires less to understand the specific technological achievements than to critically reconstruct the image of language that features the properties technological devices
mobilize and encourage." Magnifique article de @giannigastaldi et Luc Pellissier qui fait un point clair et brillant sur les présupposés théoriques derrière les approches TAL - hypothèse distributionnelle etc. https://hal.science/hal-03064480
The Logic of Language: from the Distributional to the Structuralist Hypothesis through Types and Interaction

The recent success of new AI techniques in natural language processing rely heavily on the so-called distributional hypothesis. We first show that the latter can be understood as a simplified version of the classic structuralist hypothesis, at the core of a program aiming at reconstructing grammatical structures from first principles and analysis of corpora. Then, we propose to reinterpret the structuralist program with insights from proof theory, especially associating paradigmatic relations and units with formal types defined through an appropriate notion of interaction. In this way, we intend to build original conceptual bridges between linear logic and classic structuralism, which can contribute to understanding the recent advances in NLP. In particular, our approach provides the means to articulate two aspects that tend to be treated separately in the literature: classification and dependency. More generally, we suggest a way to overcome the alternative between count based or predictive (statistical) methods and logical (symbolic) approaches.

In NYC from Aug 19th. DM me if you’re around!

I'm thrilled to see this paper finally out at the Notices of the AMS @amermathsoc! Fantastic experience as a philosopher to work hand in hand with the talented mathematicians John Terilla and Tai-Danae Bradley (@math3ma) on what a formal structuralist theory of language could look like in our days. And a modest proof that when it come to language models philosophy doesn’t have to be confined to ethics

https://www.ams.org/journals/notices/202402/rnoti-p174.pdf

The 17th CLMPST (https://clmpst2023.dc.uba.ar) has now started :-) Lots of great talks planned (13 parallel tracks 😅). And I will be talking about the formalisation of algorithms tomorrow morning! #clmpst2023
CLMPST 2023 | 17th International Congress on Logic, Methodology and Philosophy of Science and Technology

Website of the 17th International Congress on Logic, Methodology and Philosophy of Science and Technology.

Island of Vis, Croatia - A new school is emerging on the top of a hill overlooking the stunning Adriatic Sea. Founded by a group of visionary thinkers, artists, actors, builders and philosophers, the school aims to inspire and educate in response to the urgent need for transformative solutions to the crises of our time.

With the climate crisis worsening by the day, education systems failing to address the needs of young people, while addiction to social media and overspread violence fueling fear and division, this new school aims to slow down, experiment with building different ways of thinking, living and co-living, promising to create a sort of "concrete utopia" in times of extinction.

In ancient times, around 2,400 years ago, Vis was home to the first polis in this part of the Mediterranean, known as Issa. In the 20th century the island gained notoriety for the cave where Tito was hiding and operating the resistance movement in WWII that played a key role in defeating Hitler. Today, Vis is famous for its stunning beaches and crystal-clear waters. This could change soon.

Together w/ philosophers Srećko Horvat and Franco "Bifo" Berardi, the actors Goran Bogdan, Pamela Anderson and Gael García Bernal artists !Mediengruppe Bitnik, Hito Steyerl and Bobby Gillespie, writers, painters, sociologists including Predrag Kolaković, Saša Savanović, Dora Held, Marko Pogačar, Valerio Baćak, Jelena Ostojić.

"ISSA’s unique location on remote island in the middle of the Mediterranean creates a distance to reflect on and recalibrate our relationships with technologies and infrastructures. ISSA is a special, utopian space for radical artistic experimentation. We are looking forward to inviting artists, hackers & passionate dilletantes to join us in carrying stones, developing the school’s low-tech infrastructure while thinking about novel and better versions of the Internets.”

<3 !Mediengruppe Bitnik

In NYC until Saturday Feb 4. Anyone around for a drink?