🎓 𝗚𝘂𝗲𝘀𝘁 𝗧𝗮𝗹𝗸 𝗮𝘁 𝘁𝗵𝗲 𝗨𝗞𝗣 𝗟𝗮𝗯
👋 We were pleased to welcome Yova Kementchedjhieva, Assistant Professor at the MBZUAI (Mohamed bin Zayed University of Artificial Intelligence), for a guest talk at the UKP Lab in Darmstadt.
🧠 In her talk “𝘞𝘩𝘦𝘯 𝘝𝘪𝘴𝘪𝘰𝘯 𝘔𝘦𝘦𝘵𝘴 𝘓𝘢𝘯𝘨𝘶𝘢𝘨𝘦: 𝘈𝘭𝘪𝘨𝘯𝘮𝘦𝘯𝘵 𝘢𝘯𝘥 𝘐𝘯𝘵𝘦𝘳𝘧𝘦𝘳𝘦𝘯𝘤𝘦 𝘪𝘯 𝘝𝘓𝘔𝘴”, she explored architectural developments in modern vision-language models (VLMs) and their implications for multimodal learning.
🖼️💬 A central focus was the shift from cross-attention mechanisms to unified self-attention over image and text tokens, allowing visual and linguistic representations to co-evolve across model layers.
⚙️ The talk examined both the benefits and trade-offs of this design choice, including improved multimodal integration but also increased reliance on the language model backbone and potential language-only forgetting.
🔍 Prof. Kementchedjhieva also discussed alternative approaches to improve vision-to-language alignment while maintaining strong language capabilities.
💬 We thank Prof. Kementchedjhieva for the insightful talk and the discussion with UKP members on multimodal modeling and the future of vision-language systems.
#UKPLab #MultimodalAI #VisionLanguageModels #NLP #GuestTalk #NLProc #MBZUAI #TUDa
UKP Lab