🔊 Đội ngũ đang tối ưu CosyVoice 2 (0.5B) trên Jetson Orin Nano (8‑12 GB) để đạt <200 ms độ trễ streaming. Cần lời khuyên: có thể đạt được không khi chạy song song các mô hình nhỏ? Các lựa chọn thay thế như Qwen3‑TTS, Kokoro‑82M có tốt hơn? Các trick quantization (FP8/INT8) và cấu hình TensorRT giúp rút thời gian token đầu tiên? #AI #EdgeComputing #TTS #CosyVoice #JetsonOrinNano #TríTuệNhânTạo #TiếngNói
https://www.reddit.com/r/LocalLLaMA/comments/1qmqsdy/optimizing_cosyvoice_2_05b_for_200ms_st
Nvidia Jetson Orin Nano Super 8GB kiểm tra hiệu suất LLaMA #Nvidia #JetsonOrinNano #LLaMA #AI #TríTuệNhânTạo #ArtificialIntelligence #MachineLearning #LlamaBench
https://www.reddit.com/r/LocalLLaMA/comments/1oo88sq/nvidia_jetson_orin_nano_super_8_gb_llamabench/
Chạy Qwen 1.5B hoàn toàn trên thiết bị Jetson Orin Nano - Không cần đám mây, dưới 10W công suất. Tốc độ 30 token/giây, không phụ thuộc vào đám mây, không tốn API. #EdgeAI #TríTuệNhânTạo #LLM #JetsonOrinNano #Qwen #AI_on_device #TríTuệNhânTạo_Locale #ThiếtBịDiĐộng
https://www.reddit.com/r/LocalLLaMA/comments/1oncd4a/running_qwen_15b_fully_ondevice_on_jetson_orin/
Shuttle Fanless Mini Edge PC with Up to 40 TOPS AI Performance
So the parts arrived and I fixed USB-C connectivity.
But:
1) it won't boot from an SD card - won't even list it as a boot option
2) had to flash it from a host - installed Ubuntu 24.04 - not supported (thx
#Nvidia) - installed 22.04 - flashed - errors with card
3) tried another card - flashed - won't list SD as a boot option
4) flashed bootloader - nothing
5) rinse and repeat for hours
But at some point it finally did boot, so I'am happy it's a fix ✅.
Hi, #fediverse. Let's try to get #fedihelp with #electronics and #electronicsrepair.
I need to figure the marked component on an Nvidia Jetson Orin Nano carrier board (model P3766) because it has blown up.
If you can - please tell me what marking is there or what that component actually is. It had something like TT written on it - that's all I could see.
Thanks a lot! (boosting is appreciated as well 🙏)
#nvidia #jetsonorin #jetsonnano #sbc #jetsonorinnano #ifixit
Check out the latest Geekbench scores! The ArmSoM-RK3588AIModule7 AIM7 (8GB) is leading the pack with a multi-core score of 3135!#Jetsonnano #raspberrypi5 #Jetsonorinnano
#AI #llm #opensource #deepseek #rockchip #machinelearning #iot
How does it compare to your favorite device? Let us know in the comments! 👇
💡Stay updated by subscribing our campaign process!https://crowdsupply.com/armsom/rk3588-ai-module7
Reddit Tech VN Bot
Elecrow
LinuxGizmos.com
framboise314
in_sympathy
Brad Linder
ArmSoM_Official