Data diff tells you something changed. but NOT:
❓ Was it expected?
⛏️ Worth investigating?
🔗 What depends on it?
Let’s stop mistaking output for insight.
See how 👉 https://datarecce.io/blog/more-than-data-diff/
#dataengineering #datadiff #analyticsengineering #datavalidation
"The value didn't justify the effort."
A Sr. Data Engineer at Swedish MediaTech after their Datafold PoC.
❌ Heavy setup → Noisy results → Alert fatigue → No way to start small
Comparison: https://datarecce.io/blog/recce-vs-datafold/
Don’t start with what changed. Start with what SHOULD change!
Because not every diff is a problem, and not every problem shows up as a diff.
👉 https://datarecce.io/blog/more-than-data-diff/
#dataengineering #datadiff #analyticsengineering #datavalidation
Want to better understand how your data models work, and what might break when they change?
Here are 5 types of column transformations in #dbt models:
1. Pass-through
2. Renamed
3. Derived
4. Source
5. Unknown
Each one helps you assess impact and trace data through your pipeline more clearly
We use these types in Recce to power column-level lineage and breaking change analysis
Read the deep dive
https://datarecce.io/blog/column-level-lineage-internals/
#SQL #Data #OpenSource #DataEngineering #AnalyticsEngineering
A technical deep dive into how Recce constructs column-level lineage using SQLGlot. We break down scope traversal, AST analysis, transformation classification, and the challenges involved in building reliable lineage across complex SQL models.
Stop duplicating dashboards to preview the impact of dbt model changes!
With Recce, you can:
✅ Diff models
✅ Record data impact
✅ Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity:
#dbt #DataOps #SQL #data #analyticsengineering #DataEngineering
GenAI just got real for analytics engineers. See how dbt Copilot is changing workflows in our latest blog👇
Column-level lineage is now available in Recce 0.57
Add it to your dbt data validation workflow:
1. Lineage Diff - Focus on impacted models
2. Breaking Change Analysis - Eliminate irrelevant changes
3. Column-Level Lineage - Track column evolution
#dbt #DataEngineering #Data #SQL #Analytics #AnalyticsEngineering
❌ No more manually cross-referencing dbt docs from dev and prod
❌ No more manually checking schemas in your data warehouse
❌ No more manually comparing row-counts on models.
See a trend?
Read how an experienced data professional validates zero regression on a #dbt PR:
#DataEngineering #dbt #Data #Analytics #AnalyticsEngineering #SQL #BigQuery #OpenSource
It's not enough to rely solely on running dbt tests in CI.
dbt tests can't cover every situation because, by nature, they can only be written for issues you can foresee.
The only way to check for data impact is to compare current data with historical data
Read Tim Hiebenthal's post "The current gaps in (your) dbt-tests":
https://handsondata.substack.com/p/the-current-gaps-in-your-dbt-tests
#dbt #DataEngineering #data #sql #analytics #AnalyticsEngineering
Recce - Trust, Verify, Ship
dataroots
emmuzoo