Expliquer un pipeline de données ? Comparez-le à une chaîne de montage : données brutes -> transformation -> produit fini. Pour RH : un bon engineer anticipe et documente. #DataEngineering #DataPipeline #DataWorkflow #DataEngineer #IngénierieDeLaDonnée

https://www.linkedin.com/posts/gabriel-chandesris_dataengineering-datapipeline-dataworkflow-activity-7434584660539719682-V61C

Run Notebooks in Pipelines with Service Principal or Workspace Identity | Microsoft Fabric Blog | Microsoft Fabric

Update: Support for using Workspace Identity (WI) with the Notebook activity in Pipelines is currently rolling out. There was a deployment delay in this feature, but we expect this to be fully available by the end of February. The setup guidance below will apply once support is enabled in your environment. Notebook activity in Microsoft &hellip; <p class="link-more"><a href="https://blog.fabric.microsoft.com/en-us/blog/run-notebooks-in-pipelines-with-service-principal-or-workspace-identity/" class="more-link">Continue reading<span class="screen-reader-text"> &#8220;Run Notebooks in Pipelines with Service Principal or Workspace Identity&#8221;</span></a>

Oh, look! Another magical Python-based data lakehouse 🏠🐍 that promises to solve all your problems by adopting #Bauplan and #marimo. Because clearly, the solution to data workflow woes is yet another tool even fewer people will bother to use, all wrapped up in a blog post dripping with empty jargon. 🎉 Good luck getting those models past the sandbox, nerds! 🚀
https://www.bauplanlabs.com/blog/everything-as-python #Python #DataLakehouse #DataWorkflow #TechJargon #HackerNews #ngated
Everything-as-Python — bauplan

Run AI models, data transformation pipelines, and real-time analytics on your data lake with a self-optimizing, serverless runtime. No infrastructure overhead—just Python.

#Suicide #bullying are tips of large #behavioralhealth icebergs, cultural #frozenlogic: Thaw with #hotscience #DataWorkFlow
Bluesky

Bluesky Social

🚀 🚀 Congratulations, SangGyu (David) An, on merging your work to the JupySQL project! SangGyu contributed a fix to the %sqlrender magic - this allows users to see their saved queries. He also ensured our compatibility page is up to date.

JupySQL's now supports

🌟 DuckDB
⚡ Pandas
🌟 Polars
⚡ MySQL
🌟 Microsoft SQL Server
⚡ MariaDB
🌟 Snowflake
⚡ Clickhouse
🌟 Mindsdb
⚡ PostgreSQL
🌟 Compatibility
⚡ QuestDB
🌟 Oracle Database
⚡ Trino
#DB #Engine #Connectivity #DataWorkflow

Principal Research Fellow Dr Attila Lazar kicks off our three-day #Building Footprints Workshop with guests from
@ciesin
#GRID3 #DataWorkflow #DataPreparation #Modelling hidden #Settlements