Mastodawn

mucio Jul 29, 2023

Charlie Stross Jul 29, 2023

Welp.

mucio Apr 13, 2023

Darth Putin Apr 13, 2023

OTD in 1990 Soviet Union admitted that Soviet Union carried out Katyn massacre. These are Soviet documents with Stalin personally approving the murder of 22,000 Poles.

We blame(d) it on the Nazis. We lie(d).

Imagine us committing attrocities today & blaming it on Nazis...

mucio Apr 9, 2023

How much material/issues do you need before starting a substack newsletter?

mucio Apr 8, 2023

Neil Gaiman Apr 8, 2023

Back when I was working on the board of the CBLDF I got very used to the idea of material for adults being challenged by people who thought comics were for children. The idea of books aimed at children being challenged just because they had positive black characters was unimaginable. The world's changed.

https://www.washingtonpost.com/comics/2023/04/08/jerry-craft-new-kid-school-trip-book-ban/

Jerry Craft drew a positive Black story. Then the calls for a ban began.

The celebrated author of “New Kid,” a graphic novel aimed at young readers, was caught off guard when his books started showing up on lists of inappropriate material.

The Washington Post

Show thread

mucio Mar 24, 2023

The 10k dags remembered me of when a colleague tried to convert data from json to delta, at real time, for thousand of tables.

Airflow couldn't make it. Looking at the problem, they didn't need a scheduler, they needed to react when a new json file was written in S3.

Their solution? S3 notification to SQS and a streaming job processing the new data. It worked like a charm.

Now, it is even easier if you are on Databricks (that was our case) using Live Tables (and before the autoloader)

mucio Mar 24, 2023

Il reading the Shopify article about Airflow. I know I'm slow (kids, life).

While I learned a few things, I am still wrapping my head about having 10K dags on the same instance: just loading the web UI should take forever.

Few suggestions from my side:
- run airflow on kubernetes (use the helm chart)
- data processing is done outside Airflow
- if you generate thousand of dags with the same code, probably there is a better solution
- read dags from git, actually put everything on git

mucio Mar 9, 2023

I need an app to schedule lunches/coffees/calls with friends and family

mucio Feb 24, 2023

I love that Grandad Pig gives his own names to Granny Pig's chickens

mucio Feb 12, 2023

I needed chatgpt to sort out the birthday party for my daughter: a trampoline park convinced her :D

mucio Feb 6, 2023

I have only one tab open in Chrome on this computer, but I try to stay humble