Au taff, on vient de recycler un vieux coucou avec 6 cartes GTX 1070 Ti, des trucs de 2017 dits "désuets" par #Nvidia.
#llamacpp démarre un #Mixtral8x7b réparti sur les cartes... Et ça va plus vite que ChatGPT.
Une interface codée en #gradio de 30 lignes.
Si ça c'est pas rentabiliser !

PS: on va virer CUDA et utiliser #Vulkan d'ici peu

Izrādās, ka šis rīks #mixtral8x7b neatbalsta :/
Just discovered that DDG search offers an AI chat feature! You can choose between GPT 3.5, Mixtral 8x7B, and more. It's incredibly useful and awesome, definitely worth a try! #DDG #AI #GPT3.5 #Mixtral8x7B #chatbot
@catguy Sure. For image generation #sdxl based models, and my favourite #llm is #mixtral8x7b. These two are great choices. I would really like to host mixtral on my server using #ollama #docker.
Due to #dhl, my #hp #elitedesk arrives way later than expected. I'm already so excited to upgrade it. Bought it nearly #barebones and i'm planning to equip it with a 2TB nvme for main storage, 2TB 2.5" hdd for backups, an intel core i5 (not quite sure which one rn), and 32GB of ram (64GB if #mixtral8x7b runs smooth that way).

https://artificialanalysis.ai/models/mixtral-8x7b-instruct

Quality vs. Throughput.

mixtral-8x7b-instruct on groq

Wow! What a difference with the LPU.

This makes it really cheaper.

#LLMs #Mistral #mixtral8x7b #groq

Brave Leo und Mixtral 8x7B: Deine KI-Browser-Assistenz - KINEWS24.de

Brave Leo und Mixtral 8x7B: Der KI-Browser-Assistenz

KINEWS24
Tested #Mixtral8x7b #LLM in #AI "lab". Amazing precise answers about private documents. Something like #PrivateGPT / #LocalGPT but way better. Sadly, can't host publicly.
Already full of ideas for #business cases.
Now, I need €€€€... €, to get hardware for homelab 😎🤣💶💶💶
Brave Leo und Mixtral 8x7B: Deine KI-Browser-Assistenz - KINEWS24.de

Brave Leo und Mixtral 8x7B: Der KI-Browser-Assistenz

KINEWS24
Also, #mixtral8x7b is such a great #llm! I'm using it daily and i'm happy to see it getting integrated into my main search engine.