Armin RonacherI'm investigating the choices we have for making Sentry's processing pipeline externally scriptable (eg: running code in our pipeline). WASM is an obvious choice, but I'm quite surprised about the lack of good programming languages choices for data processing. What am I missing?
Cetra@mitsuhiko lua might be worth a consideration as well
@cetra3 lua is surprisingly uncomfortable for working with the type of data I'm throwing at it :(
r4vi@mitsuhiko @cetra3 this might be a wild suggestion but what about Kotlin? https://blog.jdriven.com/2021/04/running-kotlin-in-the-browser-with-wasm/
noisyglitch@mitsuhiko @cetra3 what type of data are you throwing at it if it is not confidential ?
@noisyglitch @cetra3 all open source thankfully. The goal is to throw Sentry's crash, transaction and other data at it during processing.
@noisyglitch @cetra3 the majority of it is JSON but depending on the scope this might also include attachments and binary data such as minidumps. At the moment it's mostly a research project of what's possible at scale.
@mitsuhiko @cetra3
If i understand correctly, you need a versatile language with a minimal runtime footprint given your constraints (scale, no shared libraries ?). I would have suggested Lua too but i guess that manipulating binary data is a bit awkward. Maybe https://www.assemblyscript.org/ ?
If i understand correctly, you need a versatile language with a minimal runtime footprint given your constraints (scale, no shared libraries ?). I would have suggested Lua too but i guess that manipulating binary data is a bit awkward. Maybe https://www.assemblyscript.org/ ?