Yesterday I learned at the #EuroScipy2023 #IbisData tutorial that Ibis now offers an implementation of the across function first introduced in #dplyr to conveniently and concisely apply transformations on a set of columns defined by selectors (e.g. based on column data types or name patterns).

This is especially convenient to implement scalable, in-DB feature engineering for machine learning models.

More examples in these blog post:

https://ibis-project.org/blog/selectors/

Congratulations to the Ibis Project, which hit 280K downloads in October 2022!

Looking forward to the new features coming with Ibis 4.0 early next year - "Version 4.0 will also bring the read function, allowing users to read files using the default backend (currently DuckDB) without spinning up a connection."

https://voltrondata.com/resources/update/2022/11/17/ibis-explained-code-portability-and-performance-gains

#ibis #ibisdata #ibisproject #duckdb