John U. Balis

@johnubalis
65 Followers
350 Following
63 Posts

Open source AI enthusiast.

Maintainer of several generative AI open source projects on Github.

I post about AI and open source.

Bloghttps://balisujohn.github.io/
Githubhttps://github.com/balisujohn

I'm pleased to announce localwriter, a libreoffice writer extension that allows local-inference language model editing using text-generation-webui as a backend.

Repository:
https://github.com/balisujohn/localwriter
Demo:
https://www.youtube.com/watch?v=rassvcjpTA0

#opensource #libreoffice #LibreOfficeWriter #localllama #generativeAI

GitHub - balisujohn/localwriter: A LibreOffice Writer extension that adds local-inference generative AI features.

A LibreOffice Writer extension that adds local-inference generative AI features. - balisujohn/localwriter

GitHub

If anyone is interested in converting PyTorch models to GGML, I have a new blog post on the subject, complete with example code.

https://balisujohn.github.io/converting-pytorch-to-ggml/

#PyTorch #ggml #opensource

How to convert PyTorch Models to GGML for Backend Agnostic Local Inference

Guide for converting PyTorch models to GGML

jbalis webpage

If you want to get GGML and C++ experience and work on a (hopefully) impactful FOSS project, feel free to join the tortoise.cpp discord. I have tasks to work on for all skill levels. If you see this after the link is expired you can also DM for an invite.

https://discord.gg/YtCfVu5r

Join the tortoise-tts reverse engineering Discord Server!

Check out the tortoise-tts reverse engineering community on Discord - hang out with 4 other members and enjoy free voice and text chat.

Discord
@lana Very basic math textbooks seem like they would be incredibly valuable for this purpose. I'm confident you could could fully decipher an alien language if there were some math textbooks in the corpus.

tortoise.cpp (tortoise-tts ggml rewrite) is looking for open source contributors! Feel free to DM if you are interested. All C++ skill levels welcome.

https://github.com/balisujohn/tortoise.cpp

GitHub - balisujohn/tortoise.cpp: A ggml (C++) re-implementation of tortoise-tts. Under construction and seeking contributors.

A ggml (C++) re-implementation of tortoise-tts. Under construction and seeking contributors. - balisujohn/tortoise.cpp

GitHub

If anyone is looking to work on an #opensource #AI (text to speech) project and have some C++ experience, here is a great first task to work on!

https://github.com/balisujohn/tortoise.cpp/issues/2

Make the tokenizer match the tortoise-tts Tokenizer exactly · Issue #2 · balisujohn/tortoise.cpp

If people are interested in contributing to tortoise.cpp, a great first task would be getting the tokenizer to always match the tokenization tortoise-tts uses. The tokenizer I'm using in tortoise.c...

GitHub

Does anyone know of a Linux app that will let me create forms in non-form PDFs? Because occasionally I get PDFs that definitely should be form-fillable but aren't

I am specifically talking about forms, not freeform editing/annotations.

@brainblasted I don't think Firefox supports this now, but this would be a great feature to add to it.

I keep being pleasantly surprised by how frequently just reporting an open source software bug or packaging issue with specific examples -- often not much more than I needed to do to figure out that it wasn't *me* causing the problem -- results in the thing being fixed.

Honestly, given how effective it is (and how good it feels!) I'm kind of shocked that more people don't report issues. Like how am I the first one to report this when the package has 1,000,000+ downloads?

Turns out you on a #Librem5 you can install android in a container and it runs at native speed. The android window shows as an app, so I can just use an android app if I find a native version lacking, neat!