Weird feeling, watching videos to catch up with a project descended from my own creation. So much amazing work maturing #jupysql - thanks @ploomber!

🚀 New feature: with JupySQL you can now set up a local Spark instance seamlessly to interact with your data.

In this guide, walk you through:

🌟 Setting up a Spark Connect thin client
🌟 Setting up a database with Docker
🌟 Parameterizing your queries
🌟 Perform data profiling, data cleanup and visualization

Link to tutorial: https://jupysql.ploomber.io/en/latest/integrations/spark.html?utm_content=bufferd7b6a&utm_medium=social&utm_source=linkedin.com&utm_campaign=buffer

#DataScience #Python #JupySQL #Spark #Docker #BigData

Spark — Python documentation

Query using Spark SQL from Jupyter via JupySQL

🎉#JupySQL v0.9.0 is out!🚀
Load config from pyproject.toml, resolve CTEs with new 'with_' feature & enjoy more control over scripts with parameterized queries.
Plus, many more features & bug fixes!

Learn more: https://jupysql.ploomber.io/en/latest/api/configuration.html🌟
Out GitHub: https://github.com/ploomber/jupysql

#SQL #Jupyter #DataEngineering

Using #MarkdownSQLPro Tools 🛠️ with new #SQLBookmarks 🔖, #SQLite & our #DuckDBPro #SQLTools in #VSCode IDE on @ploomber's #JupySQL #JupyText / #MyST #JupyterBook 📓 markdown docs 😎

#SQL #DuckDB #Markdown #ProDataTools 🧙‍♂️ ...

Same #JupySQL Intro #JupyterBook 📓 markdown document in #VSCode IDE with the added top level Execute All, Select All, Extract All SQL code lenses, and Execute, Select, Copy and Create SQL code lenses in the code cells with %%sql #SQLMagics:

#MarkdownSQLProTools 🧙‍♂️ ...

Quick demo of the new Extract All SQL and Execute SQL code lenses in the upcoming #MarkdownSQL Pro Tools v1.2.0 with #JupyterBook markdown support and #JupySQL / #SQLMagics SQL code extraction and execution in action:

This example uses VS Code #SQLTools and #DuckDBPro Tools to execute SQL queries directly from the Jupy SQL Jupyter Book markdown document (https://github.com/ploomber/jupysql/blob/master/doc/quick-start.md).

#VSCode #ProDataTools 🧙‍♂️ ...

jupysql/doc/quick-start.md at master · ploomber/jupysql

Better SQL in Jupyter. 📊. Contribute to ploomber/jupysql development by creating an account on GitHub.

GitHub

Check out this #MyST markdown #VSCode extension with syntax highlighting, hovers and autocomplete of directives, and extended .md preview rendering.

📥 https://marketplace.visualstudio.com/items?itemName=ExecutableBookProject.myst-highlight

Viewing #JupySQL intro markdown:

#MarkdownTools 🛠️ ...

MyST-Markdown - Visual Studio Marketplace

Extension for Visual Studio Code - The official Markdown syntax extension for MyST (Markedly Structured Text)

Looking to up your data handling game with with Oracle?

Oracle is a database commonly used for running online transaction processing, data warehousing and mixed database workloads.

Get started today!

https://tinyurl.com/oracle-jupysql

#DataScience #JupySQL #Oracle #Python #SQL

Our latest blog post explains how to integrate deepset's #Haystack, an open-source framework for building NLP systems, with #JupySQL and #JupyterNotebooks.

Discover how the JupySQL Agent leverages the power of GPT-4 to convert natural language queries into #SQL queries for seamless database access. The secret ingredient: the JupySQLQuery subclass, enabling SQL queries in Haystack pipelines within your Jupyter notebook environment.

Read more here: https://tinyurl.com/haystack-jupysql

#ML #AI #NLP

Noticias sobre Python y Datos de la semana, episodio 73 🐍⚙️

En resumen: Versiones nuevas de JupySQL, Modin, Prefect y más, machine learning "doble", detección de comunidades en grafos, ojo a la chi2 de scikit-learn, y noticias del viejo Spyder

https://astrojuanlu.substack.com/p/episodio-73

Apoya el noticiero suscribiéndote por correo 📬

#python #pydata #jupysql #ploomber #modin #prefect #doubleml #networkx #sklearn #spyder

Episodio 73 🐍⚙️

Versiones nuevas de JupySQL, Modin, Prefect y más, machine learning "doble", detección de comunidades en grafos, ojo a la chi2 de scikit-learn, y noticias del viejo Spyder

Noticiero Python y Datos