Mastodawn

Built an end-to-end data pipeline using GCP, Airflow, PySpark, and BigQuery to analyze thermal anomaly data (India 🇮🇳 vs USA 🇺🇸).
Uncovered patterns in fire frequency, intensity, and seasonality through interactive dashboards.
#DataEngineering #GCP #Airflow #BigQuery #PySpark

코덱스 라이브러리 1d ago

배치 RAG를 도입해 본 분들, Airflow DAG 설계에서 가장 큰 함정은 무엇이었나요? 저는 재시도 전략과 인덱스 병합 시 일관성 문제에서 시간 많이 잡혔습니다. 핵심 포인트: 주기·파티셔닝·모니터링이 관건입니다. 의견 공유해 주세요. #RAG #LangChain #Airflow

https://aipages.net/langchain-airflow-%eb%b0%b0%ec%b9%98-rag-%ec%97%b0%eb%8f%99/

LangChain Airflow 배치 RAG 연동 - 인공지능 인사이트

Airflow 스케줄러로 LangChain 기반 RAG를 배치화해 대량 문서 검색과 비용·응답 품질을 균형 있게 최적화하는 실무 로드맵.

인공지능 인사이트

Zagorath 2d ago

How important is ventillation for a small makeshift homelab?

https://quokk.au/c/homelab/p/788275/how-important-is-ventillation-for-a-small-makeshift-homelab

How important is ventillation for a small makeshift homelab?

At the moment all I have is a Synology and a Raspberry Pi, but I'll probably use a repurposed laptop or a cheap mini-PC (or similar) in the near fu…

blub 2d ago

#ApacheHOP auf der #FOSSGIS2026 kennengelernt ... eine FLOSS #FME Alternative

https://hop.apache.org

#kettle #airflow #ETL #java

Apache Hop

Apache Hop - The Hop Orchestration Platform aims to facilitate all aspects of data and metadata orchestration.

The whale 3d ago

𝗔𝗶𝗿𝗳𝗹𝗼𝘄:

#Workflow #Orchestration #Airflow

https://thewhale.cc/posts/airflow

Apache Airflow is a **flexible and powerful platform for workflow orchestration**, which uses Python, offers an intuitive user interface, and has numerous integrations, all within a scalable and open-source framework.

Habr 5d ago

TCO или Полная Стоимость Владение современных подходов в ETL для DB MPP

О чем эта статья : В данной статье я хочу сравнить TCO старых добрых ETL как например Informatica, ODI, MarkitEDM и подобных им vs DBT + AirFlow и подобных им Очень легко проанализировать стоимость лицензий или вычислений и хранения в случае облачной БД, но очень сложно — TCO. Стоимость разработки одной фичи, стоимость поддержки, стоимость сопровождения, стоимость изменений. Очень заманчиво учитывать только расходы на лицензии и вычисления и предполагать, что все остальные расходы одинаковы, хотя это не так. По умолчанию облачные MPP-базы обычно дешевле по хранению и вычислениям и не имеют лицензионной платы, и возникает соблазн использовать такой же безлицензионный подход в ETL, но есть недостатки :

https://habr.com/ru/articles/1014362/

#mppбазы #informatica #dbt #etl #airflow #oracle #bigquery

TCO или Полная Стоимость Владение современных подходов в ETL для DB MPP

Хабр

Tarps Now®Mar 19

Spring brings warmer days and more outdoor activity. Mesh Tarps (https://zurl.co/PoGP3 ) provide shade while allowing airflow, helping reduce heat buildup while keeping spaces covered and comfortable. A practical solution for patios, fencing, and outdoor work areas during the season.

#TarpsNow #MeshTarps #OutdoorShade #SpringSeason #Airflow

Mesh Tarps | WindScreens | Shade Tarps

Find Mesh Tarps, Shade Tarps, Windscreens and Privacy Screens that provide privacy, security, and protection for residences, businesses, ball fields, and job sites. Shop now!

Tarps Now

코덱스 라이브러리 Mar 18

Unlock cost savings in data processing with Airflow and S3! 🚀💰 #DataOptimization #Airflow #S3 https://aipages.net/airflows3%eb%a1%9c-%eb%b9%84%ec%9a%a9-%ec%b5%9c%ec%a0%81%ed%99%94-%ec%8b%a4%eb%ac%b4/

Airflow·S3로 비용 최적화 실무 - 인공지능 인사이트

대규모 문서 임베딩을 Airflow DAG과 S3로 배치 처리할 때 비용과 처리속도를 동시에 줄이는 실무 가이드.

인공지능 인사이트

AbracaData Feb 13

✨ #AI in #BI is like a self-driving car: that still needs you at the wheel.

Maxime Beauchemin, creator of Apache #Superset and Apache #Airflow, explains why #analytics aren't ready to go full autopilot and how we can embrace smart assistance instead. Because 90% isn’t good enough.

🎥 Watch now! https://abracadata.space/sessions/2025/ai-in-bi/