Just started to use Databricks. I have to say it has achieved one of the long term visions of BotMaker: running messy native Python scripts in isolated clusters.
Honglin Zhang
- 120 Followers
- 134 Following
- 56 Posts
dad, husband, Emacs user, Moonlander keyboard, cooking; formerly worked on the Bootmaker platform at the bird factory
I can partially understand why Twitter chose Scala back then. When latency was key to the business and the company needed to recruit a lot of new hires, immutability at the language level can help enable multi-thread safe code.
As someone who spent nearly a decade on distributed systems, reading Android Kotlin and Swift code is quite fun.
I am so glad that I don’t need to deal with Objective-C anymore.
Trying to explain Dtab to others, the best documentation outside of the Twitter stack is Linkerd. Is there any other alternative? Is there a paper or something on this?
The Bootmaker lang change reduced compilation time from hours to seconds.
Aha. I made a change to the Bootmaker language back then in a similar flavor. Only create frames when throwing exceptions but don’t create frames in the happy path.
Trying to understand Python/frozen.c. Is it a hardcoded list of built-in modules? If I want to statically link custom modules, do I need to update the c code and recompile CPython…?
An amazing change but I thought it was more than a hardcoded list.
another day at work
them: a backend service that instructs what stage the frontend should go to next. frontend can stay stateless and can be iOS, Android and Web.
me: yep in my previous job there is an exact same service known as bouncer.
them: data scientists are analyzing user metrics at each phase.
me: yep same as my previous job.
them: hmm we sometimes have infinite loop bugs.
me: same.
them: no one fully understands the stack. ownership is unclear.
me: yep the same.
All software complexity problems lead to a self-selving rules engine. All rules engines will have its Ghostbusters day.