Weird feeling, watching videos to catch up with a project descended from my own creation. So much amazing work maturing #jupysql - thanks @ploomber!

๐Ÿš€ New feature: with JupySQL you can now set up a local Spark instance seamlessly to interact with your data.

In this guide, walk you through:

๐ŸŒŸ Setting up a Spark Connect thin client
๐ŸŒŸ Setting up a database with Docker
๐ŸŒŸ Parameterizing your queries
๐ŸŒŸ Perform data profiling, data cleanup and visualization

Link to tutorial: https://jupysql.ploomber.io/en/latest/integrations/spark.html?utm_content=bufferd7b6a&utm_medium=social&utm_source=linkedin.com&utm_campaign=buffer

#DataScience #Python #JupySQL #Spark #Docker #BigData

Spark โ€” Python documentation

Query using Spark SQL from Jupyter via JupySQL

๐ŸŽ‰#JupySQL v0.9.0 is out!๐Ÿš€
Load config from pyproject.toml, resolve CTEs with new 'with_' feature & enjoy more control over scripts with parameterized queries.
Plus, many more features & bug fixes!

Learn more: https://jupysql.ploomber.io/en/latest/api/configuration.html๐ŸŒŸ
Out GitHub: https://github.com/ploomber/jupysql

#SQL #Jupyter #DataEngineering

Using #MarkdownSQLPro Tools ๐Ÿ› ๏ธ with new #SQLBookmarks ๐Ÿ”–, #SQLite & our #DuckDBPro #SQLTools in #VSCode IDE on @ploomber's #JupySQL #JupyText / #MyST #JupyterBook ๐Ÿ““ markdown docs ๐Ÿ˜Ž

#SQL #DuckDB #Markdown #ProDataTools ๐Ÿง™โ€โ™‚๏ธ ...

Same #JupySQL Intro #JupyterBook ๐Ÿ““ markdown document in #VSCode IDE with the added top level Execute All, Select All, Extract All SQL code lenses, and Execute, Select, Copy and Create SQL code lenses in the code cells with %%sql #SQLMagics:

#MarkdownSQLProTools ๐Ÿง™โ€โ™‚๏ธ ...

Quick demo of the new Extract All SQL and Execute SQL code lenses in the upcoming #MarkdownSQL Pro Tools v1.2.0 with #JupyterBook markdown support and #JupySQL / #SQLMagics SQL code extraction and execution in action:

This example uses VS Code #SQLTools and #DuckDBPro Tools to execute SQL queries directly from the Jupy SQL Jupyter Book markdown document (https://github.com/ploomber/jupysql/blob/master/doc/quick-start.md).

#VSCode #ProDataTools ๐Ÿง™โ€โ™‚๏ธ ...

jupysql/doc/quick-start.md at master ยท ploomber/jupysql

Better SQL in Jupyter. ๐Ÿ“Š. Contribute to ploomber/jupysql development by creating an account on GitHub.

GitHub

Check out this #MyST markdown #VSCode extension with syntax highlighting, hovers and autocomplete of directives, and extended .md preview rendering.

๐Ÿ“ฅ https://marketplace.visualstudio.com/items?itemName=ExecutableBookProject.myst-highlight

Viewing #JupySQL intro markdown:

#MarkdownTools ๐Ÿ› ๏ธ ...

MyST-Markdown - Visual Studio Marketplace

Extension for Visual Studio Code - The official Markdown syntax extension for MyST (Markedly Structured Text)

Looking to up your data handling game with with Oracle?

Oracle is a database commonly used for running online transaction processing, data warehousing and mixed database workloads.

Get started today!

https://tinyurl.com/oracle-jupysql

#DataScience #JupySQL #Oracle #Python #SQL

Our latest blog post explains how to integrate deepset's #Haystack, an open-source framework for building NLP systems, with #JupySQL and #JupyterNotebooks.

Discover how the JupySQL Agent leverages the power of GPT-4 to convert natural language queries into #SQL queries for seamless database access. The secret ingredient: the JupySQLQuery subclass, enabling SQL queries in Haystack pipelines within your Jupyter notebook environment.

Read more here: https://tinyurl.com/haystack-jupysql

#ML #AI #NLP

Noticias sobre Python y Datos de la semana, episodio 73 ๐Ÿโš™๏ธ

En resumen: Versiones nuevas de JupySQL, Modin, Prefect y mรกs, machine learning "doble", detecciรณn de comunidades en grafos, ojo a la chi2 de scikit-learn, y noticias del viejo Spyder

https://astrojuanlu.substack.com/p/episodio-73

Apoya el noticiero suscribiรฉndote por correo ๐Ÿ“ฌ

#python #pydata #jupysql #ploomber #modin #prefect #doubleml #networkx #sklearn #spyder

Episodio 73 ๐Ÿโš™๏ธ

Versiones nuevas de JupySQL, Modin, Prefect y mรกs, machine learning "doble", detecciรณn de comunidades en grafos, ojo a la chi2 de scikit-learn, y noticias del viejo Spyder

Noticiero Python y Datos