Modern #Androids pack 45+ #TOPS of #NPU compute. Instead of draining battery, a native app using #ExecuTorch and #NNAPI runs 4-bit quantized #LLMs natively, turning smartphones into a massive, parallelized compute swarm. 🧠🔋 #EdgeAI #MachineLearning #AndroidDev

Turning Android Phones Into An...
Turning Android Phones Into An AI Supercomputer.mp3

Google Docs
TIL #executorch for embedded inference 😍
Introducing Executorch: the revolutionary breakthrough that lets your #toaster run #PyTorch 🤖🔥, because who wouldn’t want #AI on their bread? 🍞 Meanwhile, developers everywhere are thrilled about "embedding" AI into devices that definitely needed it, like that smart fridge that judges your leftovers. 🍕🚫
https://github.com/pytorch/executorch #Executorch #SmartDevices #FoodTech #HackerNews #ngated
GitHub - pytorch/executorch: On-device AI across mobile, embedded and edge for PyTorch

On-device AI across mobile, embedded and edge for PyTorch - pytorch/executorch

GitHub

Executorch: On-device AI across mobile, embedded and edge for PyTorch

https://github.com/pytorch/executorch

#HackerNews #Executorch #OnDeviceAI #PyTorch #Mobile #Edge #Computing #EmbeddedAI

GitHub - pytorch/executorch: On-device AI across mobile, embedded and edge for PyTorch

On-device AI across mobile, embedded and edge for PyTorch - pytorch/executorch

GitHub
🌗 PyTorch Edge: 使用 ExecuTorch 在移動和邊緣設備上實現設備內推理
➤ ExecuTorch:實現移動和邊緣設備上的設備內推理
https://pytorch.org/blog/pytorch-edge/
PyTorch Edge團隊宣佈推出ExecuTorch,這是一個全新的解決方案,可在移動和邊緣設備上實現設備內推理能力。ExecuTorch通過與Arm、Apple和Qualcomm Innovation Center等行業領導者合作,解決了設備內AI生態系統的碎片化問題。它提供了設計,以便無縫集成第三方擴展點,以加速在專用硬件上的機器學習模型推理執行。ExecuTorch還提供了廣泛的文檔,詳細介紹了其架構、高級組件、在ExecuTorch上運行的示例機器學習模型,以及在各種硬件設備上導出和運行模型的端到端教程。
+ 這對於在移動和邊緣設備上進行機器學習推理的開發者來說是一個很好的消息。
+ 我期待著看到ExecuTorch在移動和邊緣設備上的應用案例。
#PyTorch Edge #ExecuTorch #移動設備 #邊緣設備 #AI
PyTorch

An open source machine learning framework that accelerates the path from research prototyping to production deployment.