🔍 Nghiên cứu phân tích 23+ mô hình từ 7 phòng thí nghiệm cho thấy đặc tính “thermodynamic” của mô hình phụ thuộc nhiều hơn vào nhà phát triển hơn là số tham số. Các mô hình EleutherAI (Pythia, GPT‑NeoX) có xu hướng giảm tín hiệu (G<1), trong khi Meta/OpenAI (LLaMA, OPT, GPT‑2) mở rộng (G>1). Fine‑tuning chỉ thay đổi độ lớn, hiếm khi đảo ngược dấu, nên việc chọn base model quan trọng. #AI #NLP #LLM #MachineLearning #Mô_hình #DeepLearning #Research #EleutherAI #Meta #LLaMA #Finetuning

https://ww

TechCrunch: EleutherAI releases massive AI training dataset of licensed and open domain text. “The dataset, called the Common Pile v0.1, took around two years to complete in collaboration with AI startups Poolside, Hugging Face, and others, along with several academic institutions. Weighing in at 8 terabytes in size, the Common Pile v0.1 was used to train two new AI models from EleutherAI, […]

https://rbfirehose.com/2025/06/07/techcrunch-eleutherai-releases-massive-ai-training-dataset-of-licensed-and-open-domain-text/

YouTube creators surprised to find Apple and others trained AI on their videos

AI models at Apple, Salesforce, Anthropic, and other major technology players were trained on tens of thousands of YouTube videos without the creators' consent and potentially in violation of YouTube's terms

#Apple #Salesforce #Anthropic #EleutherAI #YouTube #data #BigData #TrainingData #ArtificialIntelligence #AI #technology #tech

https://arstechnica.com/ai/2024/07/apple-was-among-the-companies-that-trained-its-ai-on-youtube-videos/

This is a sentence and a half: “Proof News' article also mentions that it was trained on videos of a parrot, so AI models are parroting a parrot, parroting human speech, as well as parroting other AIs, parroting humans.” #EleutherAI

https://arstechnica.com/ai/2024/07/apple-was-among-the-companies-that-trained-its-ai-on-youtube-videos/?utm_brand=arstechnica&utm_social-type=owned&utm_source=mastodon&utm_medium=social

@arstechnica @arstechnica

AI companies used YouTube videos without permission to train models

https://stackdiary.com/ai-companies-used-youtube-videos-without-permission-to-train-models/

#AI #Jobs #Technology #Innovation #Future #Automation #Creativity #Economy #FairUse #Regulation #JobLoss #TechIndustry #Data #Ethics #Disruption #AIImpact #Workforce #Change #Equality #Productivity #UBI #JobMarket #AIResearch #EconomicValue #AIDevelopment #Society #YouTube #ContentCreation #AITraining #Apple #Nvidia #Anthropic #Salesforce #EleutherAI #BigTech #LLM #Privacy