Mastodawn

Taras Novak 🇺🇦Feb 24, 2023

Devs and data scientists really like our #ChicagoCrimes EDA public scripts, notebooks 📚 and data snapshots repository we created last October. That sample data/demo repository covers many different tools, libraries and notebooks to parse #LargeData:

⭐️ ⤑ https://github.com/RandomFractals/chicago-crimes

📜 ⤑ https://twitter.com/search?q=(%23ChicagoCrimes)%20(from%3ATarasNovak)&src=typed_query

#DataTools 🛠️ ...

GitHub - RandomFractals/chicago-crimes: Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools.

Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools. - GitHub - RandomFractals/chicago-crimes: Exploring Chicago crimes dataset w...

GitHub

Taras Novak 🇺🇦Jan 29, 2023

Quick demo of our new #DuckDBSqlTools vscode extension loading and querying 7,687,725 #ChicagoCrimes recorded in 2001 through the end of November 2022 from a large 1.68 GB CSV data file in seconds ... See demo gif at:

📰 https://github.com/RandomFractals/chicago-crimes#with-duckdb-sql-tools

#DuckDB #SqlTools #VSCode #DataTools 💎💎💎

GitHub - RandomFractals/chicago-crimes: Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools.

GitHub

Taras Novak 🇺🇦Jan 23, 2023

Our new #DuckDBSQLTools VSCode extension is almost ready for prime time.

You'll be able to load remote CSV and #parquet data files via httpfs extension and create in-memory #DuckDB instances too.

See demo gif of loading #ChicagoCrimes parquet data from a GitHub repository into memory, creating a CrimeReports table, and querying it on twitter:

https://twitter.com/TarasNovak/status/1617542770184577024

#VSCode #SQLTools / #DataTools 🔬💎💎💎...

Taras 🇺🇦 on Twitter

“Our #DuckDBSQLTools ext. is almost ready for prime time. You'll be able to load remote CSV & #parquet data files & create in-memory #DuckDB instances too. Demo of loading #ChicagoCrimes parquet data into memory, creating a table, and querying it: #VSCode #SQLTools/#DataTools 🔬💎”

Twitter

Taras Novak 🇺🇦Dec 13, 2022

📢 New 2022 #ChicagoCrimes #MalloyData #Fiddle app you can run in a browser to learn Malloy model and query semantics, nesting, and simple charting 📊📈 options:

📰 https://randomfractals.github.io/chicago-crimes/apps/malloy-fiddle

📓 https://github.com/RandomFractals/chicago-crimes#with-malloy-fiddle

🧐 https://github.com/RandomFractals/chicago-crimes/blob/main/docs/images/chicago-crime-reports-malloy-fiddle-app.gif

#DAX #dataApps #dataTools 🔬 ...

2022 Chicago Crime Reports Malloy Fiddle App

Taras Novak 🇺🇦Dec 11, 2022

Updated #ChicagoCrimes #PyScript #dataApp with gzipped CSV (~3.25MB). The app now loads 215,551 crime reports with #pyodide in a browser in about 8 seconds total for the #Python runtime, data transformation with #pandas 🐼 & charting with #Altair 📊📈

https://randomfractals.github.io/chicago-crimes/apps/pyscript/

Chicago Crimes PyScript App

Taras Novak 🇺🇦Dec 10, 2022

Running some quick data summary queries with #Malloy on a 2001-2022 #ChicagoCrimes parquet data file that is 533MB, created form a larger 1.66GB CSV data, without any compression. Very responsive and fast query execution thanks to #DuckDB and Malloy #VSCode extension.

View those queries in action in this GIF: https://twitter.com/TarasNovak/status/1601650935402725376

#dataTools 🛠️ ...

Taras 🇺🇦 ... on Twitter

“Running some quick data summary queries with #Malloy on a 2001-2022 #ChicagoCrimes parquet data file that is 533MB, created form a larger 1.66GB CSV data, without any compression. I'd say this is fairly responsive and fast query execution thanks to #DuckDB and Malloy VSCode ext.”

Twitter

Taras Novak 🇺🇦Dec 7, 2022

Our #DataPreview 🈸 for #vscode now has over 350,000 installs. You can load large CSV files, sort & graph results with aggregate functions, and much more.

See an example of loading 48MB of #ChicagoCrimes CSV data: https://twitter.com/TarasNovak/status/1600439658810585088

Note: change data.preview.theme to light. See: https://github.com/RandomFractals/vscode-data-preview#configuration

📥 https://marketplace.visualstudio.com/items?itemName=RandomFractalsInc.vscode-data-preview

#dataViz 📊📈 #dataTools 🛠️ for #dataScientists ...

Taras 🇺🇦 ... on Twitter

“Our #DataPreview 🈸 for @code has over 350,000 installs. You can load large CSV files, sort & graph results with aggregate functions. Bellow is loading 48MB of CSV data. Note: change preview.theme to light. See: https://t.co/okrOjTZpsX 📥 https://t.co/X511HcdaxW #dataTools 🛠️ ...”

Twitter

Taras Novak 🇺🇦Dec 2, 2022

📢 New 2022 #ChicagoCrimes #dataApp with #Malloy #Composer is out. See:

gif -> https://github.com/RandomFractals/chicago-crimes/blob/main/docs/images/chicago-crimes-malloy-composer.gif

code -> https://github.com/RandomFractals/chicago-crimes/tree/main/apps/malloy-composer

app -> https://randomfractals.github.io/chicago-crimes/apps/malloy-composer

Try it in your browser. Have fun!

#dataTools/#dataApps 🔬 ...

chicago-crimes/chicago-crimes-malloy-composer.gif at main · RandomFractals/chicago-crimes

Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools. - chicago-crimes/chicago-crimes-malloy-composer.gif at main · RandomFractals...

GitHub

♡ mariana meireles ♡Nov 30, 2022

so cool! :)
---
RT @TarasNovak
Created a web page with #PyScript loading 2022 #ChicagoCrimes CSV data with #pandas and visualizing that data with #Altair charting lib:
https://github.com/RandomFractals/chicago-crimes/blob/main/apps/pyscript/index.html
#dataApps ...
https://twitter.com/TarasNovak/status/1597379498756173824

chicago-crimes/index.html at main · RandomFractals/chicago-crimes

Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools. - chicago-crimes/index.html at main · RandomFractals/chicago-crimes

GitHub

Taras Novak 🇺🇦Nov 29, 2022

2001-2022 #ChicagoCrimes data loaded from a #parquet file and summarized with #pandas #dataFrames and simple #Altair charts 📊📈 in a #JupyterNotebook:

👀 https://github.com/RandomFractals/chicago-crimes/blob/main/docs/images/chicago-crimes-altair-charts-ipynb.gif

📓 https://github.com/RandomFractals/chicago-crimes/blob/main/notebooks/chicago-crimes-altair.ipynb

#dataNotebooks 📚 ...

chicago-crimes/chicago-crimes-altair-charts-ipynb.gif at main · RandomFractals/chicago-crimes

Exploring Chicago crimes dataset with Jupyter notebooks, DuckDB, Malloy and new Panel/PyScript data and dashboard tools. - chicago-crimes/chicago-crimes-altair-charts-ipynb.gif at main · RandomFrac...

GitHub