Mastodawn

Kyle Taylor Jun 28, 2024

Howdy Data Folks - Benchmarking R/Python workflows on #FreeBSD 14.1 and #Debian Stable (12.5) on an 8-core Intel machine. Performance in R is comparable (R is faster on FreeBSD, but it isn't statistically significant). But latency for Python 3.9.18 on FreeBSD is terrible compared to Debian. It gets worse the more CPU cores you use. This was unexpected (for me). Is this a known issue with Python 3.9 on FreeBSD?

Show thread

AJCxZ0 Jun 29, 2024

@kta In addition to the Python version, look into the configuration options for all the applicable ports. Defaults on FreeBSD tend to prefer stability and compatibility over performance, whereas Linux platforms often lean the other way. If you install binary packages, then you are implicitly choosing those defaults.

Performance decreasing with increasing number of processors is often indicative of threading limitations.

There may also be platform tuning options with a similar impact.

Show thread

Kyle Taylor

@AJCxZ0 Thanks. Scikit is the heaviest dependency for the portion of the application that is performing poorly on FreeBSD. I'll build it from ports to try and make sure any tunables applied by Debian are also applied to BSD.