Mastodawn

My first time at #SCAsia/#HPCAsia this week. I don’t have a crazy preset agenda as I would at SC/ISC, so looking forward to having time to explore new experiences, hopes, and perspectives on #HPC and #AIinfra, meet people, etc.

sayzard Jan 7

FutureLivingLab (@FutureLab2025)

LLM에서 가장 어려운 부분은 모델 자체가 아니라 인프라라는 관점의 글. Andrej Karpathy가 언급한 'vibe coding'처럼 빠르게 개발하는 방식은 초기 속도에는 도움이 되지만 AI 인프라에서는 확장성이 떨어져 '빨리 배포 → 더 빨리 리팩터'하는 문제로 이어진다는 교훈과 대규모 시스템에서 먼저 깨지는 부분들에 대한 논의를 시작한다.

https://x.com/FutureLab2025/status/2008866617787343206

#aiinfra #llms #engineering #devops

FutureLivingLab (@FutureLab2025) on X

The hardest part of LLMs isn’t the model — it’s the infra. As @karpathy has discussed, “vibe coding” can be a great way to move fast. Our lesson from AI infra: vibes alone don’t scale — they turn into “ship fast → refactor faster”. What breaks first in large systems: ①

X (formerly Twitter)

Sinclair Ta Dec 29

Neocloud Economics: CoreWeave vs Nebius – Vertical AI Infra Crushes Hyperscalers (60-70% Margins) ⚡

Neoclouds own stack (chips→racks), dodge AWS debt/leasing. Nebius edges CoreWeave on costs; $10B+ ARR potential. AI training explodes demand

Why vertical? 2-3x cheaper GPUs vs cloud giants.

VCs: Next hyperscalers? Founders: Build atop. GPU wars incoming. 📈

#Neocloud #CoreWeave #Nebius #AIInfra #GPUEconomics

https://buff.ly/XJsjWqp

Dr. Thompson Dec 19

⚡ Cut GPU costs by 68% without slowing inference.
No hype. Just real infra lessons from shipping AI in production.

👉 Read the full story:
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

#GenAI #AIInfra #MLOps
https://medium.com/@rogt.x1997/why-my-ai-startup-cut-gpu-costs-by-68-without-slowing-down-with-runpod-58f71733e86f

Why My AI Startup Cut GPU Costs by 68% …without Slowing Down with RunPod

What millisecond-scale infrastructure changes really did…

Medium

GlitchMentalMX Dec 18

La IA tiene hambre de energía y la solución es nuclear. ⚛️🤖 Analizamos el proyecto de Last Energy para crear mini reactores. ¿Sostenibilidad real o un riesgo necesario para el progreso tech? https://www.glitchmental.com/2025/12/reactores-nucleares-last-energy-ia-infraestructura.html #Nuclear #AIInfra #MastodonTech #CleanEnergy

Arbiter Dec 4

ARBITER: what it is / what it isn’t

semantic scoring
geometric fit
negative answers
offline 26MB

ISN’T

LLM
vector DB
embeddings
retrieval

getarbiter.dev
#AI #NLP #RAG #AIInfra #SemanticSearch

AI Daily Post Nov 20

ScaleOps' new AI Infra slashes GPU costs by half for self‑hosted LLMs while giving full visibility into pods, model behavior, and even a helm flag for easy tuning. Curious how you can cut spend and keep control? Read the full breakdown. #ScaleOps #AIInfra #GPUcosts #SelfHostedLLMs

🔗 https://aidailypost.com/news/scaleops-ai-infra-cuts-gpu-costs-50-selfhosted-llms-adds-full

Dr. Thompson Aug 30

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

Pods, Endpoints and a Smoother Future: The Hidden Simplicity of RunPod

…Why infra finally feels boring (in the best possible way)

Medium

Dr. Thompson Aug 30

🚀 Tired of burning weekends fixing infra? RunPod 2025 makes GPU deploys boring (in the best way). Pods, endpoints & MCP turn ideas into live projects faster than ever. ⚡

👉 Read the full guide:
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c

#RunPod #AIInfra #AIBuilders
https://medium.com/@rogt.x1997/pods-endpoints-and-a-smoother-future-the-hidden-simplicity-of-runpod-f9bace9e1a8c