Sort:  

it's an open source model, meaning anyone can host it. My thread explains how you can use it for free on groq.com for instance, which is a US based company.

gonna visit it:)

are you the one who made the groq.com?

I wish. No, groq is a company that makes hardware specifically designed for running ai models. I wish they were a publicly traded company so I could invest in it, but alas

I just tried using it lol

pretty damn fast, right? That's their thing. They're not using GPUs for inference, but their own, self-developed LPUs

hell yeah, i use it with Mixtral haha

Hi, @mightpossibly,

This post has been voted on by @darkcloaks because you are an active member of the Darkcloaks gaming community.


Get started with Darkcloaks today, and follow us on Inleo for the latest updates.