Lex Sokolin | Generative Ventures (@LexSokolin)
로컬 추론 장비가 400W 수준으로도 강력해졌다는 관찰입니다. 1년 전에는 데이터센터 랙이 필요했지만, 이제 로컬에서 에이전트를 구동하는 경제성이 크게 개선되어 AI 컴퓨트의 통제 주체와 분배에 관한 많은 가정이 뒤집힐 수 있다는 전망을 제시합니다.
Lex Sokolin | Generative Ventures (@LexSokolin)
로컬 추론 장비가 400W 수준으로도 강력해졌다는 관찰입니다. 1년 전에는 데이터센터 랙이 필요했지만, 이제 로컬에서 에이전트를 구동하는 경제성이 크게 개선되어 AI 컴퓨트의 통제 주체와 분배에 관한 많은 가정이 뒤집힐 수 있다는 전망을 제시합니다.
Privacy-preserving tech is accelerating — and OHTTP is quickly becoming core infrastructure.
Our partners at Confident (@confidentsecurity) shared an excellent overview of how OHTTP enables anonymous requests across the internet, with adoption from Apple, Google, Mozilla, Meta, and others.
Fastly is proud to be one of the primary OHTTP relay providers, handling tens of millions of requests with low latency and privacy at scale.
The Mixtile Blade 3 from CrowdSupply looks like a nice option for a 2.5" (Pico ITX form factor) SBC (Single Board Computer) for your edge compute AI / graphics project or a ridiculously powerful cluster in a 19" box if you put 600 of them together. Designed to run Android 12.
https://www.crowdsupply.com/mixtile-limited/mixtile-blade-3
#mixtileblade3 #crowdsupply #picoitx #ai #edgecompute #hpc #cluster #graphics #linux
I've been working with #LLM to explore patterns that allows for running on #EdgeCompute or #Azure #OpenAI
I've found using a combination of #Langchain & #llamacpp allows me to do this.
I've created a small example repo, that shows how to quickly get up and running with GPU support.
Being an #LFEdge member means you are part of a community that unifies and provides #EdgeCompute projects, IoT frameworks, and blueprints to serve the needs of various edge markets.
By joining us, your organization can access cutting-edge technologies and collaborate with industry leaders to drive innovation and shape the future of edge computing. Learn more about LF Edge membership benefits: https://www.lfedge.org/members/join/?utm_content=242637133&utm_medium=social&utm_source=linkedin&hss_channel=lcp-85626375
The Fly platform is a revolutionary approach to computing that focuses on edge compute - the ability for a computer to process data without relying on cloud resources. This technology has the potential to revolutionize the way businesses operate and provide improved services for customers. At its core, Fly offers edge computing solutions that are faster, more reliable and cost-effective than traditional cloud-based solutions. However, while this technology is powerful, it may not be what customers are currently looking for in the market.
learning more about using Intel NUC for #EdgeCompute https://www.intel.com/content/www/us/en/products/docs/boards-kits/nuc/edge-compute.html
This is sure to stir up some controversy: In my latest Op-Ed for The Register, I make the case for retiring "edge" from our collective #IT vocabularies. The term has become so nebulous as to be irrelevant.
https://www.theregister.com/2022/12/22/retire-edge-now/
✅ Give this post a boost and a favorite if you agree.
❌ Toot me if you think I'm wrong.
#Datacenter #Cloud #Edge #EdgeCompute #servers #HotTake #opinion #editorial