Oz

@oz7z
0 Followers
2 Following
27 Posts
Engineering Leader, ex-AWS, consultant with over 25 years of experience in technology and leadership.
Bloghttps://luminary.blog
Ever wonder how ChatGPT gets so smart? It all starts with loss. Dive in👇 #AI https://luminary.blog/techs/llm-loss-function/
Which Loss Function Do LLMs use?

Exploring Cross-Entropy Loss in Large Language Models.

luminary.blog
This AI trick packs multiple brains into one—meet Matryoshka learning 💡 #MachineLearning https://luminary.blog/techs/matryoshka-representation-learning/
What is Matryoshka Representation Learning (MRL)?

Nesting Power and Flexibility into ML Embeddings

luminary.blog
Forget big numbers—UE8M0 FP8 is small, fast & mighty. AI will never train the same. #AI https://luminary.blog/techs/deep-seek-ue8m0-fp8/
UE8M0 FP8 Number Format

Training LLMs without H100 using UE8M0 FP8 number format.

luminary.blog
Unlock ML secrets hidden in your numbers—precision matters more than you think! #MachineLearning https://luminary.blog/techs/numbers-in-machine-learning/
Understanding ML Numerical Formats

Understanding INT4, INT8, FP16, BF16, and TF32 formats in machine learning - their precision, speed, and memory trade-offs for training and inference.

luminary.blog
Ever wonder how AI knows word order? It’s all thanks to positional embeddings. #DeepLearning https://luminary.blog/techs/positional-embeddings/
What are Positional Embeddings?

The mathematical technique that teaches AI models where each word sits in a sequence.

luminary.blog

CUDA, through NVIDIA GPUs, powers many, if not all, LLMs. I was curious about it for a while. Finally, I had a chance to experiment with and write about it.

https://luminary.blog/techs/01-cuda-intro/

CUDA Programming: An Introduction

Getting started with CUDA programming: Hello Threads

luminary.blog

Is your code silently decaying? Here's why DRY might save your sanity.

A fictional story on a real problem.

#CleanCode #dry #story https://luminary.blog/techs/programming-dry-story/

A Tale of Software Rot

A fictional story about systematically eliminating duplication to prevent software rot in a growing engineering organization.

luminary.blog
Claude Desktop is giving "Error executing code: Cannot convert undefined or null to object" when calling the local MCP server I have. It seems to happen when Claude calls the MCP server in a row for a series of inputs. #claude #anthropic
Struggle with messy code? Master SOLID and clean it up for good. #CleanCode https://luminary.blog/techs/solid-with-examples/
Agentic AI sounds flashy—but is it really the future, or just hype? #AgenticAI https://luminary.blog/techs/06-agentic-ai/
The Agentic AI Hype

The Overhyped Buzzword That’s Just AI With To-Do Lists.

luminary.blog