Девять испытаний роста нагрузки: от стартапа к приложению для 25 миллионов пользователей

Эта статья совсем не технический анализ, а увлекательный рассказ о том, как маленький, но очень перспективный стартап стал топовым приложением, а также о том, какие сложности встали на пути команды разработки, DevOps и тестирования X5 Tech. Мы сразу заложили основные принципы нагруженного приложения: микросервисы как основа всего, полное покрытие метриками, асинхронность, кэширование на максималках. Какую-то функциональность разрабатывали сами, где-то задействовали сервисы других техкоманд из X5, а где-то и сторонние решения с рынка. Весь код писали на Python, использовали FastAPI и другие популярные на тот момент фреймворки и технологии.

https://habr.com/ru/companies/X5Tech/articles/1029410/

#highload #микросервисы #latency #postgresql #elasticsearch #kubernetes #hpa #балансировка_нагрузки #нагрузочное_тестирование #observability

🔍 Spark + Elasticsearch Debugging 🧵

Building a cybersecurity analytics platform. Hit 2 blockers:

❌ JAR path mismatch → Fixed absolute path
❌ No data nodes (single-node Docker ES) → Added es.nodes.wan.only=true

✅ Result: 89 records loaded. Working pipeline!

Lesson: Verify JAR paths + disable node discovery for single-node ES.

#PySpark #Elasticsearch #DataEngineering #CyberSecurity #Debugging

Sous le capot d’une base de données analytique

https://video.ut0pia.org/w/bHLpE8jpEpebdGRHcdRhCC

Audius is hiring Software Engineer - Full Stack

🔧 #javascript #python #rust #solidity #typescript #electron #react #reactnative #redux #blockchain #css #docker #elasticsearch #html #postgresql #redis
🌎 Remote
⏰ Full-time
🏢 Audius

Job details https://jobsfordevelopers.com/jobs/software-engineer-full-stack-at-audius-co-may-31-2022-da9984?utm_source=mastodon.world&utm_medium=social&utm_campaign=posting
#jobalert #jobsearch #hiring

How to Install #Zammad on #AlmaLinux #VPS (10-Minute Quick-Start Guide) This article provides a guide on how to install Zammad on #AlmaLinux VPS.

If you're looking to run a robust open-source #helpdesk on your AlmaLinux VPS, Zammad is a great pick. It's modern, feature-packed, and supports everything from ticketing to chat and reporting. This guide ...
Continued 👉 https://blog.radwebhosting.com/how-to-install-zammad-on-almalinux-vps/?utm_source=mastodon&utm_medium=social&utm_campaign=mastodon.raddemo.host #elasticsearch #selfhosted #certbot #ticket #selfhosting #customersupportplatform #opensource #letsencrypt

How to Install #Zammad on #AlmaLinux #VPS (10-Minute Quick-Start Guide) This article provides a guide on how to install Zammad on #AlmaLinux VPS.

If you're looking to run a robust open-source #helpdesk on your AlmaLinux VPS, Zammad is a great pick. It's modern, feature-packed, and supports everything from ticketing to chat and reporting. This guide ...
Continued 👉 https://blog.radwebhosting.com/how-to-install-zammad-on-almalinux-vps/?utm_source=mastodon&utm_medium=social&utm_campaign=mastodon.social #selfhosting #selfhosted #elasticsearch #ticket #letsencrypt #opensource #certbot #customersupportplatform

Lies, damned lies, and Elastic's benchmarks

Elastic이 발표한 Prometheus 대비 30배 빠르다는 TSDS 시계열 엔진 벤치마크가 신뢰성이 떨어진다는 지적이 나왔다. 벤치마크 코드와 환경 정보가 공개되지 않아 재현이 불가능하며, Elastic 쪽은 높은 샘플링 속도에서 데이터 적재에 어려움을 겪었다. 작성자는 직접 벤치마크 하네스를 만들어 테스트했으나 Elastic의 성능은 기대에 미치지 못했고, 벤치마크 결과를 신중히 해석할 필요가 있다고 강조했다. 또한, 관측성 메트릭용 표준 벤치마크 도구 개발의 필요성을 제기했다.

https://www.gouthamve.dev/lies-damned-lies-and-elastics-benchmarks/

#benchmarking #timeseries #prometheus #elasticsearch #observability

Mastodon Incident Report / Root cause analysis:

Earlier today, users experienced timeouts with Search, Hashtags, and Autocomplete.

Root Cause: Our setup separates the Mastodon frontend VPS (Hetzner) from backend services (for example Elasticsearch) via an OPNSense firewall. Suricata (our IPS) triggered a false-positive on internal traffic and aggressively blocked the VPS IP, severing the connection to the search database.

Resolution: We identified the false-positive, added the frontend IP to the whitelist, and traffic immediately normalized. Everything is back to green!

#mastodon #mastoadmin #burningboard #elasticsearch #firewall #opnsense #suricata #oopsie