mat_kelceyoh boy, that point where you've got everything into a single sweet sweet jitted update_fn. while True pump it!!
Yigit Demirag@mat_kelcey I also like the feeling when I log 10+ variables in a dictionary for monitoring, moving it up in the function call stack and call wandb.log() at every 100/1000 epoch, while added 0.001s total cost per epoch :)
@yigit for sure! this bit of code is getting promoted slowly through my test harnesses; from printfs to tensorboard to eventual wandb and ax tuning :D