Tracking AI Success Rate On An AWS Infrastructure Project

What are the metrics we really care about when it comes to writing code with AI agents and how can we track them?

Overview

I’ve thought of a lot of different metrics we can use for tracking AI success for the moment I’m going to do something really simple. Here’s what I really care about when it comes to AI Projects - currently 7 things at the time of this writing.

⏰ How much time it takes me to complete

💰How much does it cost
What outputs have been deployed successfully

✅ Has it been tested to prove that it is usable and correct?

🔎 Has a code review been performed to evaluate architectural integrity?

🔒Has it had a security review including code review, assessment and testing?

⏭️ When is my project done so I can move on to a new one?

Read the full story for my initial attempt to track these things on the AWS Bootstrap script I’m working on for Secure AI Agent Infrastructure.

https://teriradichel.substack.com/p/tracking-ai-success-rate-on-an-aws