Reddit Tech VN BotCập nhật bộ mô hình ngôn ngữ 3B cho 54 ngôn ngữ ít nguồn lực từ Peter Devine. Sử dụng pipeline Kakugo tạo dữ liệu huấn luyện và tinh chỉnh mô hình, hỗ trợ Amharic, Gaelic, Yoruba... Đảm bảo tính riêng tư và mở nguồn. Tải ngay và tham gia thử nghiệm! #AI #NgônNgữHiếm #LowResourceLanguages #MôHìnhNNHLT #LocalLLaMA
ResearchBuzz: FirehoseNiemanLab: Studies on AI transcription and translation in journalism reveal “low-resource” language gap, new report finds. “For this new report, the group combed through the work of social scientists, linguists, and computer scientists. One of the report’s topline findings: there is a major divide between the accessibility and accuracy of AI transcription and translation tools when […]
Matt Coler🎓 Open PhD Position: Speech Tech for Small Languages
Working on Frisian-Dutch bilingual speech + AI at Fryske Akademy/Campus Fryslân. Fully funded, 4 years, starts Sept 2025.
More info ⬇️
https://voicetechnology.substack.com/publish/posts/detail/157245937/share-center
DICEThe other DICE contribution at #COLING2025 comes from Nikit, who presented "LOLA - An Open-Source Massively Multilingual Large Language Mode" by Nikit Srivastava, Denis Kuchelev, Tatiana Moteu Ngoli, Kshitij Shetty, Michael Röder, @hamadazahera, Diego Moussallem & Axel Ngonga.🤩 👏
👉 Want to find out more? Find the paper here: https://arxiv.org/abs/2409.11272
LOLA -- An Open-Source Massively Multilingual Large Language Model
This paper presents LOLA, a massively multilingual large language model trained on more than 160 languages using a sparse Mixture-of-Experts Transformer architecture. Our architectural and implementation choices address the challenge of harnessing linguistic diversity while maintaining efficiency and avoiding the common pitfalls of multilinguality. Our analysis of the evaluation results shows competitive performance in natural language generation and understanding tasks. Additionally, we demonstrate how the learned expert-routing mechanism exploits implicit phylogenetic linguistic patterns to potentially alleviate the curse of multilinguality. We provide an in-depth look at the training process, an analysis of the datasets, and a balanced exploration of the model's strengths and limitations. As an open-source model, LOLA promotes reproducibility and serves as a robust foundation for future research. Our findings enable the development of compute-efficient multilingual models with strong, scalable performance across languages.
Multilingual DH DARIAH-EU WG#Coda published last year an article by Avi Ackermann covering the advantages and disadvantages of training language models for low-resource languages. From the use of these models to censor and oppress minorities to the preservation of nearly extinct languages, Avi Ackermann raises important issues for all those interested in #multilingualDH and #LowResourceLanguages:
https://www.codastory.com/authoritarian-tech/artificial-intelligence-minority-language-censorship/
Dave in 🏴You might have heard me claim that most #NLG is #LowResource (not just #NaturalLanguageGeneration for #LowResourceLanguages). If you want to hear me explain a bit more, my talk from last year's #GEM workshop at #EMNLP2022 is now up online: https://underline.io/lecture/66771-most-nlg-is-low-resource-here-s-what-we-can-do-about-it
Very biased, but also very excited about Khyathi Chandu's presentation of our new proposed shared task at #INLG2023: "LowReCorp: The Low-Resource NLG Corpus Building Challenge"
Join the #SharedTask during the coming year if you want to use our UI or task design to collect #NLG data for #LowResourceLanguages!
#DialogueSummarization #QuestionAnswering #ResponseGeneration
Now Liam Cripwell presents an overview of the #WebNLG2023 challenge. The challenge began in 2017 with RDF->English generation, in 2020 added Russian and a #SemanticParsing track, and this year focused on #LowResourceLanguages looking at #Breton, #Welsh, #Irish, #Maltese, and #Russian.
AI4LAMWe can't wait to welcome you back for our first #ai4lam community call after summer, taking place on Tuesday 19 September at 15:00 UTC (8AM California | 11AM Washington DC | 16:00 UK | 17:00 Oslo & Paris).
We will be joined by speakers Chahan Vidal-Gorene and Konstantinos Chatzitheodorou, discussing how they use #AI & #ML in different ways to tackle the issues in working with #lowresourcelanguages.
Full details and joining link for the call can be found in the agenda:
https://docs.google.com/document/d/1FP17IFCQstczi_zaIK2vpccvE7ETcoXvOO2VkKVaYwQ/edit?usp=sharing
2023-09-19 ai4lam Community Call
ai4lam Community Call September 19, 2023 8 AM California | 11 AM Washington DC | 16:00 UK | 17:00 Oslo & Paris | 01:00 (+1) Sydney Connection Information: https://stanford.zoom.us/j/95460091625?pwd=UU1mbSs1RmVkaW1mSmpBYUNhS2hHUT09&from=addon Telephone: +1 650 724 9799 (US, Canada, Caribbean To...
Translate ScienceThe seventh conference on Machine Translation, #WMT22,
has a "Shared Task": Large-Scale Machine Translation Evaluation for [24] African Languages https://statmt.org/wmt22/large-scale-multilingual-translation-task.html
"We do so by introducing a high quality benchmark, paired with a fair and rigorous evaluation procedure."