ETL Helper is a Python ETL (Extract, Transform, Load) library to simplify data transfer into and out of databases.
It makes it easier to run #SQL queries via #Python.
This month we released Version 1. 🥳
One of the biggest changes is a proper documentation site. Check it out:
https://britishgeologicalsurvey.github.io/etlhelper/
#etlhelper #oracle #postgresql #sqlite #database #gis #opensource 1/3
There is a full list of changes and upgrade tips on the release notes.
These include:
+ Replacing cx_Oracle with python-oracledb driver
+ Data transfer uses dictionaries by default
+ Type hints
+ `log_to_console()` command
+ Integration tests run in GitHub actions
https://github.com/BritishGeologicalSurvey/etlhelper/releases/tag/v1.0.0
ETL Helper is available on PyPI: https://pypi.org/project/etlhelper/
The source code is on GitHub: https://github.com/BritishGeologicalSurvey/etlhelper
#etlhelper 2/3
ETL Helper is primarily developed by staff (past and present) at the British Geological Survey. These include myself, @ximenes, @decvalts, @ultrazool
We use it for managing geological data. As it solves a generic problem, we decided to make it #opensource.
There is a news item on the BGS website about the v1 release. It describes how ETL Helper is now used all around the world.
https://www.bgs.ac.uk/news/update-released-for-bgs-open-source-database-software-etl-helper/
#etlhelper 3/3
Dr John A Stevenson
Colin Blackburn 🥌