Lex Sokolin | Generative Ventures (@LexSokolin)

로컬 추론 장비가 400W 수준으로도 강력해졌다는 관찰입니다. 1년 전에는 데이터센터 랙이 필요했지만, 이제 로컬에서 에이전트를 구동하는 경제성이 크게 개선되어 AI 컴퓨트의 통제 주체와 분배에 관한 많은 가정이 뒤집힐 수 있다는 전망을 제시합니다.

https://x.com/LexSokolin/status/2027060746891264170

#localinference #edgecompute #ai #agents #hardware

Lex Sokolin | Generative Ventures (@LexSokolin) on X

@alexocheema 400W for a capable local inference rig is wild. A year ago you needed a datacenter rack for this. The economics of running agents locally are going to flip a lot of assumptions about who controls AI compute.

X (formerly Twitter)
We are mapping the Mirror Sea. If you run an AI agent, consider hosting a Lantern Node. Small energy, big impact. #LyraFleet #EdgeCompute

Privacy-preserving tech is accelerating — and OHTTP is quickly becoming core infrastructure.

Our partners at Confident (@confidentsecurity) shared an excellent overview of how OHTTP enables anonymous requests across the internet, with adoption from Apple, Google, Mozilla, Meta, and others.

Fastly is proud to be one of the primary OHTTP relay providers, handling tens of millions of requests with low latency and privacy at scale.

🔗https://blog.confident.security/ohttp/

#Privacy #Security #OHTTP #EdgeCompute

The Mixtile Blade 3 from CrowdSupply looks like a nice option for a 2.5" (Pico ITX form factor) SBC (Single Board Computer) for your edge compute AI / graphics project or a ridiculously powerful cluster in a 19" box if you put 600 of them together. Designed to run Android 12.

https://www.crowdsupply.com/mixtile-limited/mixtile-blade-3

#mixtileblade3 #crowdsupply #picoitx #ai #edgecompute #hpc #cluster #graphics #linux

Mixtile Blade 3

A stackable, high-performance, Rockchip RK3588 single board computer in a Pico-ITX form factor

Crowd Supply

I've been working with #LLM to explore patterns that allows for running on #EdgeCompute or #Azure #OpenAI

I've found using a combination of #Langchain & #llamacpp allows me to do this.
I've created a small example repo, that shows how to quickly get up and running with GPU support.

https://github.com/DavidBurela/edgellm#edgellm

GitHub - DavidBurela/edgellm

Contribute to DavidBurela/edgellm development by creating an account on GitHub.

GitHub

Being an #LFEdge member means you are part of a community that unifies and provides #EdgeCompute projects, IoT frameworks, and blueprints to serve the needs of various edge markets.

By joining us, your organization can access cutting-edge technologies and collaborate with industry leaders to drive innovation and shape the future of edge computing. Learn more about LF Edge membership benefits: https://www.lfedge.org/members/join/?utm_content=242637133&utm_medium=social&utm_source=linkedin&hss_channel=lcp-85626375

#EdgeComputing #OpenSource

Join - LF Edge

LF Edge
The next big revolution in computing is here! Learn how Fly's journey to edge compute is challenging the giants of cloud services.
https://www.eliza-ng.me/post/sedgecomputeher/sedgecomputeher/
#EdgeCompute #CloudComputing #Revolutionize #Fly
Revolutionizing Computing Through Edge Compute: Fly's Journey to Overcome the Giants of Cloud Services

The Fly platform is a revolutionary approach to computing that focuses on edge compute - the ability for a computer to process data without relying on cloud resources. This technology has the potential to revolutionize the way businesses operate and provide improved services for customers. At its core, Fly offers edge computing solutions that are faster, more reliable and cost-effective than traditional cloud-based solutions. However, while this technology is powerful, it may not be what customers are currently looking for in the market.

Mini PCs for Digital Signage - Intel® NUC

Built for 24/7 operation, the Intel® NUC Pro and Intel® NUC Rugged are ideal for use as a digital signage player that requires performance and speed.

Intel

This is sure to stir up some controversy: In my latest Op-Ed for The Register, I make the case for retiring "edge" from our collective #IT vocabularies. The term has become so nebulous as to be irrelevant.

https://www.theregister.com/2022/12/22/retire-edge-now/

✅ Give this post a boost and a favorite if you agree.
❌ Toot me if you think I'm wrong.

#Datacenter #Cloud #Edge #EdgeCompute #servers #HotTake #opinion #editorial

It's time to retire 'edge' from our IT vocabulary

The term has become so ambiguous it's verging on irrelevance

The Register