Just finished Analytics Engineering with dbt in @DataTalksClub's free course – a deep dive into building data pipelines for analytics. 🚀

Key learnings:
✅️ Built transformation models with dbt from raw CSV/Parquet files in Google Cloud Storage
✅️ Designed dimensional data warehouse schema (staging, intermediate tables) implemented in BigQuery
✅️ Implemented comprehensive data quality checks using dbt tests to ensure reliable analytics
✅️ Mapped dependencies & lineage with dbt visualization tools for optimized performance
✅️ Analyzed NYC taxi revenue patterns across zones using SQL window functions

Really enjoying transforming raw data into actionable insights! Check out my project:
https://github.com/ammartin8/data_engineering_zoom_camp/blob/main/modules/module_4/project_04/README.md

#dataengineering #dbt #analyticalengineering #analytics #datanalytics #datawarehousing #fedihire #ai #tech #linux #data #dev #sql #code #mastodon #learning

Junior Systems Engineer (Retail) (JB5399)
Remote / Hybrid (Johannesburg based only)
R20 000 to R23 000 a month CTC

#WindowsServer #SQLSupport #ITIL #DataWarehousing #EcommerceSystems #PointOfSale #IntegrationSupport

Apply: https://bit.ly/SysEngineerJB5399
@KontakRecruitment

📢Know someone? Retweet & Tag

IBM InfoSphere Warehouse: A Comprehensive Data Warehousing Solution for Advanced Analytics
Power your business with IBM InfoSphere Warehouse! This data warehousing solution, seamlessly integrated with IBM DB2, helps you transform data into actionable insights. Get real-time analytics and unlock the full potential of your data. #IBMInfoSphereWarehouse #DataWarehousing #BigData #BusinessIntelligence #DataAnalytics #IBMDB2

https://tech-champion.com/corporate-world/ibm-infosphere-warehouse-a-...

There is no need to move data. Data latency is minimised. Data can be transformed and analysed within a single platform.

Let me know what you know about Zero-ETL  

Why ETL-Zero? Understanding the shift in Data Integration“ by Sarah Lea on Medium: https://medium.com/towards-data-science/why-etl-zero-understanding-the-shift-in-data-integration-as-a-beginner-d0cefa244154

#python #datalake #cloudcomputing #etl #zeroetl #salesforce #data #tech #technology #datawarehousing #datalakehouse

ADOMD.NET: Beyond Rows and Columns – The Multidimensional Evolution of ADO.NET

https://www.jocheojeda.com/2025/01/20/adomd-net-beyond-rows-and-columns-the-multidimensional-evolution-of-ado-net/

#DataAnalytics #ADOMDNET #BusinessIntelligence #SQLServer #ReportingTools #DataMigration #VisualBasic6 #dotNET #MDX #MultidimensionalExpressions #PerformanceOptimization #DatabaseReporting #CrystalReports #TransactionalDatabases #DataWarehousing #AnalyticalQueries #MicrosoftAnalysisServices #PowerBI #SalesAnalysis #LegacySystemsMigration

The Hadoop ecosystem comprises various tools and frameworks designed to handle large-scale data processing and analytics. Let's discuss the core components, namely Hadoop, HBase, and Hive, along with other significant tools such as Pig, Sqoop, Flume, Oozie, and Zookeeper.

https://linuxexpert.org/so-you-wanna-do-big-data/

#Hadoop #HBase #Hive #BigData #HadoopEcosystem #HDFS #MapReduce #YARN #Pig #Sqoop #Flume #Oozie #Zookeeper #DataProcessing #DataAnalytics #DataWarehousing #ETL #DataIngestion #Security

Implementing a snowflake-schema may require additional storage space due to its normalized structure but can result in optimized query performance by reducing redundant data.

Read more 👉 https://lttr.ai/AGqOD

#VastRealm #DataWarehousing #JourneyBegins #DesignPrinciples #SchemaChoices #CurtainsDrawClose #IngestLargeVolumes #FrequentlyQueriedColumns #ConstellationsGuideSailors #MinimizingComputationalOverhead

Comparative Analysis of Snowflake-Schema Versus Star-Schema: An Examination of Modern Data…
▸ https://lttr.ai/AGpvt

#VastRealm #DataWarehousing #JourneyBegins #DesignPrinciples #SchemaChoices #CurtainsDrawClose #IngestLargeVolumes #FrequentlyQueriedColumns #ConstellationsGuideSailors #MinimizingComputationalOverhead