| Home | https://leverstone.me |
We had a Python service using FastAPI and OpenAI that was fast in development but slowed down a lot under load 🤔
We used load testing to find the bottleneck, then profilers and call graph visualization to understand the issue. My new blog post describes the debugging process, the tools and techniques we used, and how we ended up making the service twice as fast 🎉
Check it out if you're into Python performance and debugging.
Just published a new blog post exploring automating groundedness evaluation in RAG applications.
Ensuring that GenAI applications produce reliable outputs is a critical aspect in building applications that users can trust. My latest post dives into our exploration of this problem in the context of RAG.
https://leverstone.me/blog/automating-groundedness-evaluation-in-rag-applications
GenAI applications usually stream their responses. We got used to this behaviour from ChatGPT and the like. It made a lot of sense a year ago, but these days LLMs are much faster. Does streaming still required? What are the downsides? I wrote about this in a new blog post. https://leverstone.me/blog/genai-app-to-stream-or-not-to-stream
Merry everything! For anyone who's low on technical readings this festive season I have a new blog post with an idea about personalising a RAG system: https://leverstone.me/blog/thoughts-on-personalising-retrieval-augmented-generation
I recently completed my first year mentoring two junior software engineers, a journey filled with learning and personal growth. While I didn't get everything perfect, some strategies seems to work - from building trust to exploring career goals without pressure. My latest blog post shares the pragmatic tactics I learned about creating genuine mentoring relationships.
Everyone on the internet is expected to have some thoughts about AGI, right? Here are mine. The TL;DR is that I think it's not a very useful term, because the question of whether or not AI can replace people's intellectual work is more about social readiness than about technological advancement. https://leverstone.me/blog/thoughts-about-agi
Welcome to Tom's technical book club (for lack of a better name). This group is for software engineers who want to improve their technical skills by reading and discussing what they read with a small, friendly, and easy to navigate community. We will focus on one book at a time, and try to go through it over a few months. When we start a new book the agenda for the next few months will be published, aiming to cover a chapter or so every week. Each week we will have a new thread to kickstart the discussion. Planned books are still TBC. I might just choose something, or figure a way to decide together. Again, TBC. Looking forwards to learning with you :-)
Welcome to Tom's technical book club (for lack of a better name). This group is for software engineers who want to improve their technical skills by reading and discussing what they read with a small, friendly, and easy to navigate community. We will focus on one book at a time, and try to go through it over a few months. When we start a new book the agenda for the next few months will be published, aiming to cover a chapter or so every week. Each week we will have a new thread to kickstart the discussion. Planned books are still TBC. I might just choose something, or figure a way to decide together. Again, TBC. Looking forwards to learning with you :-)
