When does #Iceberg beat #Parquet+projection on #AWSGlue, and when doesn't ?
An end-to-end #ETL PoC on #AWS to find out: producer, #Kinesis, two #Firehose paths, two #Glue jobs, #Athena.
🔮 Spoiler: how the data is read is the key to the choice.
In the article: every choice with its why, plus a few gems from some Glue experience 😄
Поиск программеров для устройств на процессорах Qualcomm
Представим ситуацию. У нас на руках есть устройство на базе SoC (чипсет) от Qualcomm в аварийном режиме – emergency download, edl, USB\VID_05C6&PID_9008. Для доступа к памяти устройства, чтобы провести его восстановление, требуется программер. В сети их много и большинство называется просто «prog_firehose_ddr.elf» без указания модели устройства, для которого их разрабатывали. Можно пробовать загружать по одному и проверять подходит или нет, но это очень долго. Куда быстрее и проще проанализировать список из нескольких программеров и проверить на соответствие только несколько, наиболее подходящих из них.
So, looking into this a bit more, it seems that it's because the language-filter settings only apply to public timelines - not your home/personal timeline.
Which sucks. I don't use public timelines; my personal timeline is enough of a firehose already, thank you very much. Which is why I wanted to filter out posts in languages I don't understand. These posts get into my timeline because lots of hashtags are used by posters in many different languages, even if the words they're based on are English (or whatever) words.
Looking in the #Mastodon repository, there are lots of bug reports / issues / feature requests for exactly what I was hoping for here. Some date back five years or more.
Given how badly this lack of filtering impacts a busy personal timeline, I'm kind of surprised there's been no action on any of these reports.
#MastoBug #bug #feature #timeline #language #filter #firehose
When you interact with Bedrock services, your logs get put into a cloudwatch log group. That sounds great, right? Except ALL bot interactions get put into the SAME log group, making differentiating all those logs a pain.
That's where FireHose comes in, and I wrote some custom lambda to achieve this. All shared at the link in the image :D
CloudWatchログをS3に転送、Athenaでクエリしたかっただけなのに、ちょっと複雑だった話
https://qiita.com/yutaka_kozuka/items/f752c382f8cd5b65ceb9?utm_campaign=popular_items&utm_medium=feed&utm_source=popular_items
The Colorado Sound Playlist
Alessandra Bilardi
gary
Miss Kitty 🌈🌈🌈
Elshara Silverheart
Habr
C.
Kyler Middleton
Qiita - 人気の記事