Dr John A StevensonJul 10, 2024

ETL Helper is a Python ETL (Extract, Transform, Load) library to simplify data transfer into and out of databases.
It makes it easier to run #SQL queries via #Python.

This month we released Version 1. 🥳

One of the biggest changes is a proper documentation site. Check it out:

https://britishgeologicalsurvey.github.io/etlhelper/

#etlhelper #oracle #postgresql #sqlite #database #gis #opensource 1/3

Welcome to ETL Helper’s documentation! — ETL Helper 1.0.0 documentation

Show threadJohn LaytJul 11, 2024
@volcan01010 Nice! Like most I've built my own ad-hoc etl library over the years, I'll have a look at replacing it with this.
Show threadDr John A Stevenson

@jlayt Good luck! Send any questions here or via GitHub.

From your bio, it seems like your work has a lot in common with the data management that we do in BGS Informatics group e.g. https://www.bgs.ac.uk/geological-data/data-search/

Data search - British Geological Survey

BGS is a data-rich organisation with over 400 datasets in its care

British Geological Survey
Jul 11, 2024 at 8:29amWeb
Show threadJohn LaytJul 17, 2024

@volcan01010 Thanks, will look at it shortly.

We do indeed make use of BGS data, especially the borehole service which we pull into our GIS when assessing sites. We should look again to see what else you have we could use!