Leon FurzeApr 23, 2024

Making meaning with multimodal GenAI

As much as Generative Artificial intelligence has caused waves in education, the focus in research and publications on the impact of GenAI is still squarely on text-based models and in particular ChatGPT. That's understandable considering the impact OpenAI's chatbot had almost immediately from its launch November 2022. But by focusing attention on large language models like GPT, we neglect the opportunities and the challenges presented by multimodal generative artificial intelligence. The […]

https://leonfurze.com/2024/04/23/making-meaning-with-multimodal-genai/

Habr5d ago

SLAY-ASR, или как я перестал волноваться и полюбил тренировать модели

Как добавить аудио-модальность в LLMку максимально экономно? Рассказываю про серию попыток добиться совместимости эмбеддингов разной природы Погрузиться

https://habr.com/ru/articles/1009614/

#representation_learning #multimodality #multimodal_llm #machine_learning #audiomodality #regularization #contrastive_learning #whisper #gemma3

SLAY-ASR, или как я перестал волноваться и полюбил тренировать модели

Как добавить аудио-модальность в LLMку максимально экономно? Рассказываю про серию попыток добиться совместимости эмбеддингов разной природы. ...Зачем? Изначально этот проект был лишь одной задачкой в...

Хабр
APSAPMar 2

Thrilled to share that Hayk Azizbekyan delivered a compelling presentation on 3D Mixed and Augmented Reality (MR/AR) with AI in Archaeological Fieldwork at the Hong Kong Association for Digital Humanities 2026 Conference!
Taking the stage in the #Image Synthesis, #Immersion & #Multimodality session, Hayk explored how cutting-edge AI-powered 3D MR/AR technologies are revolutionizing archaeological field research—blending digital innovation with cultural heritage exploration and pushing the boundaries of how we study and preserve our past.

This 3-day conference (23-25 Jan) at @cuhkofficial brought together global scholars to explore AI, multimodality, and digital humanities across diverse fields, offering an ideal platform for this groundbreaking research share.

Kudos to Hayk for his excellent work in bridging tech and archaeology!

Details of the conference: https://2026.hkadh.org/

Show threadUKP LabDec 2

Yue’s research interests lie in natural language processing and information retrieval. Her recent work focuses on LLM-powered AI agents, on advancing the factualness, faithfulness, and trustworthiness of large language models, and on developing and analysing multimodal foundation models.

🔗 Yue’s Webpage: https://fengyue-leah.github.io/

#UKPLab #NLP #InformationRetrieval #LargeLanguageModels #AIResearch #Multimodality #PeerReview #AISafety #TrustworthyAI

Yue Feng - Homepage

Index of Yue Feng's homepage

HabrNov 28

Kandinsky 5.0: линейка open-source моделей генерации изображений и видео нового поколения

В сентябре мы открыли доступ к Kandinsky 5.0 Video Lite, лёгкой модели с 2 млрд параметров для создания видео по тексту или на основе изображения. Теперь мы выкладываем в open source и все остальные модели линейки Kandinsky 5.0: Video Pro и Image Lite!

https://habr.com/ru/companies/sberbank/articles/971154/

#генерация_видео #kandinsky #multimodality #sberai #sberdevices #generative_models #kandinsky_5 #airi #texttoimage #texttovideo

Kandinsky 5.0: линейка open-source моделей генерации изображений и видео нового поколения

В сентябре мы открыли доступ к Kandinsky 5.0 Video Lite , лёгкой модели с 2 млрд параметров для создания видео по тексту или на основе изображения. Модель получила множество позитивных отзывов, а мы —...

Хабр
NFDI4CultureOct 31

👻 Probiert es mal aus, egal ob gruselig oder heilig, der „Geist” erwartet euch (es funktionieren auch andere Suchbegriffe, Notizen oder Bilder 😊 )

🧠 P.S. Für alle #CultureKnowledgeGraph- und #SPARQL-Kenner unter euch, bitte hier entlang 👉 https://nfdi4culture.de/resources/knowledge-graph.html

#NFDIrocks #CultureKnowledgeGraph #CultureDataSearch #Multimodality #CulturalHeritage @fiz_karlsruhe
Tabea Tietz @tabea Etienne Posthumus @epoz Harald Sack @lysander07
Linnaea Söhn @linnaea
Torsten Schrade

^ks (^zs)

3/3

SPARQL Endpoint - NFDI4Culture

eicker.news ᳇ tech newsOct 18
#AndrejKarpathy believes #AGI is still a decade away, citing the need for advancements in #continuallearning, #multimodality, and #computeruse. He argues that while the problems are solvable, they remain challenging. Karpathy also reflects on the history of AI, highlighting the impact of #deeplearning, #reinforcementlearning, and #largelanguagemodels on the field. https://www.dwarkesh.com/p/andrej-karpathy?eicker.news #tech #media #news
Andrej Karpathy — AGI is still a decade away

"The problems are tractable, but they're still difficult”

Dwarkesh Podcast
Trufi AssociationOct 14

Online arguments over one woman’s bicycle on the Mumbai Metro miss the real opportunity: An app could show rack availability before anyone boards. Problem solved.

Multimodal travel depends on good data and cooperation across systems. Open data from metros and local mapping could help planners, developers, and commuters.

https://www.indiatoday.in/trending-news/story/viral-video-of-woman-carrying-bicycle-inside-mumbai-metro-coach-sparks-debate-2802219-2025-10-13

#India #Cycling #mobileapp #multimodal #Multimodality #TransportationJustice #Gender #TrufiAssociation

Viral video of woman carrying bicycle inside Mumbai Metro coach sparks debate

A now-viral video of a woman carrying her bicycle inside a Mumbai Metro coach has sparked debate over the practicality of the facility.

India Today
Trufi AssociationAug 11, 2025

If fire risk is the standard, shouldn't fossil-fuel vehicles be the first to be banned? Not e-bikes on trains?

Lithium battery fires are rare. Victoria’s proposed e-bike and e-scooter train ban punishes clean mobility, ignoring the far greater fire and safety hazards of petrol-powered transport.

via xitter @theage @pwhatch
https://www.theage.com.au/national/victoria/ban-on-e-bikes-on-trains-a-response-over-the-top-cycling-advocates-say-20250808-p5mlg1.html

#Australia #publictransport #ActiveTransport #ElectricVehicles #EV #EVs #mobility #multimodal #Multimodality #publictransit #TrufiAssociation

Ban on e-bikes on trains a response over the top, cycling advocates say

Cycling advocates say fires on trains are a rare occurrence and the risk could be managed by enforcing quality standards on imported batteries and devices.

The Age
Trufi AssociationJul 22, 2025

Chennai's transport overhaul tackles buses, trains, and cycling. The integration challenges mentioned highlight why digital coordination matters as much as infrastructure investment.

https://jfwonline.com/article/is-chennai-shifting-to-a-new-dawn-of-transport/

#India #Chennai #cityplanning #urbanism #urbanplanner #urbanplanning #inclusiveplanning #SDG11 #Cycling #informaltransport #populartransport #multimodal #Multimodality #TransportationJustice #Gender #TrufiAssociation

Is Chennai shifting to a new dawn of transport?

Is Chennai shifting to a new dawn of transport?

JFW Just for women