I'm writing a C# app with ONNX for facial detection and in part of it doing `tensor[0, 2, y, x] = r`. After running the app for a day it used almost 8 GB memory. I coudldn't really find any obvious memory leaks, but found that the indexer actually created a temporary `int[]`. I refactored the indexer to `tensor[2 * width * height + y * width + x] = r`, and did some other (unrelated changes). And now a day later it's at 0.4 GB. Is that how this works?

To pharaphrase the Haskell saying:
> The [garbage collector] should have protected me from this!

#csharp #onnx #optimisation

Трансформер в on-premise AppSec: как мы встроили ML-модель для классификации секретов в продукт без GPU

Рассказываем, как мы интегрировали CodeBERT-based модель классификации секретов в production-продукт с жёсткими ограничениями по железу, сократив время инференса с 320 до 90 секунд и размер модели с ~600 до ~130 МБ — без дискретных ускорителей и тяжёлых зависимостей.

https://habr.com/ru/companies/codescoring/articles/1040968/

#appsec #onnx #mlops #opensource #оптимизация #codescoring #ml

أطلق تطبيق PhotoPrism تحديثاً جديداً ينقل ميزة التعرف على الوجوه بالكامل إلى نظام يعتمد على ONNX، مما يتيح مرونة أكبر في استخدام نماذج الذكاء الاصطناعي. كما تم إعادة تصميم شريط المعلومات الجانبي لتسهيل إدارة البيانات الوصفية، وإضافة دعم لتسريع ترميز الفيديو عبر تقنية Vulkan وقراءة صور HEIC وAVIF وملفات PSD. يتضمن التحديث أيضاً تحسينات في تصفية الملصقات، ودعم ميزة السحب والإفلات لرفع الملفات، وترجمات جديدة للواجهة بالاستعانة بأدوات الترجمة الآلية.

#PhotoPrism #ONNX

RT @sharbel: The 10 fastest growing GitHub repos this week: 1. codegraph (+14.1K stars) Pre-indexed code knowledge graph for Claude Code, Codex, Cursor, OpenCode, and Hermes Agent — fewer tokens, fewer tool calls, 100% local https://github.com/colbymchenry/codegraph 2. openhuman (+17.1K stars) Your Personal AI super intelligence. Private, Simple and extremely powerful. https://github.com/tinyhumansai/openhuman 3. academic-research-skills (+11.6K stars) Academic Research Skills for Claude Code: research → write → review → revise → finalize https://github.com/Imbad0202/academic-research-skills 4. RuView (+6.8K stars) π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video. https://github.com/ruvnet/RuView 5. agentmemory (+6.9K stars) #1 Persistent memory for AI coding agents based on real-world benchmarks https://github.com/rohitg00/agentmemory 6. supertonic (+3.6K stars) Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX. https://github.com/supertone-inc/supertonic 7. CloakBrowser (+7.0K stars) Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed. https://github.com/CloakHQ/CloakBrowser 8. ViMax (+2.7K stars) "ViMax: Agentic Video Generation (Director, Screenwriter, Producer, and Video Generator All-in-One)" https://github.com/HKUDS/ViMax 9. 12-factor-agents (+1.9K stars) What are the principles we can use to build LLM-powered software that is actually good enough to…

mehr auf Arint.info

#Agent #agent #Claude #ClaudeCode #Codex #Cursor #GitHub #github #JavaScript #ONNX #arint_info

https://x.com/sharbel/status/2058129659963843071#m

My current #DotNetMAUI and #NeuralNetworks project: Design and train NNs in #GoogleColab and transfer them to a #CrossPlatform app using #ONNX. Basic principle established. Next I have to think of a genuinely useful and (the hard part) original trained NN to go in a mobile app.

https://philotalk.com/mobile-neural-network