This is also an area where Clojure really shines. It’s not the easiest to get started with, but once you’re up and running it is miles easier to test, version, deploy, package, scale, and repeatedly run your pipelines or models reliably than anything else I’ve tried so far. Paying the startup cost is well worth it if your goal is a robust production system that works.
First keynote was amazing. I love hearing from other successful women in my field. Also super validating to hear from a real industry veteran that the time has come to bring robust engineering best practices to data science. A lot of companies do this well but there is a long way to go.
In software we’ve been working on “best practices” and processes for a couple of decades. So much of it is generic enough to be useful for data science too. We can help!
Next comes @njr workshop on Test-Driven Data Analysis! Check out https://github.com/tdda/tdda (reminds me a bit of pandera or great-expectations)
#python #pydata #PyDataLondon #PyDataLondon2024 #dataanalysis
Just delivered alongside my colleague Deepyaman a workshop on Ibis + Kedro 🔥
Materials here: https://github.com/ibis-project/kedro-ibis-tutorial
Also follow @kedro on Mastodon 🔶
#python #PyData #PyDataLondon #PyDataLondon2024 #kedro #ibis #duckdb
@marcogorelli "Came for the speed, stayed for the syntax"
And now attending @marcogorelli's workshop on creating Polars plugins cc @ritchie46
Kira Howe (McLean)
Juan Luis
