Open source Dracarys models ignite generative AI fired coding
For fans of the HBO series Game of Thrones, the term “Dracarys” has a very specific meaning. Dracarys is the word used to command a dragon to breathe fire.
While there are no literal dragons in the world of generative AI, thanks to Abacus.ai, the term Dracarys now has some meaning as well. Dracarys is the name of a new family of open large language models (LLMs) for coding.
Abacus.ai is an AI model development platform and tools vendor that is no stranger to using the names of fictional dragons for its technology. Back in February, the company released Smaug-72B. Smaug is the name of the dragon from the classic fantasy book The Hobbit. Whereas Smaug is a general-purpose LLM, Dracarys is designed to optimize coding tasks.
For its initial release, Abacus.ai has applied its so-called “Dracarys recipe” to the 70B parameter class of models. The recipe involves optimized fine-tuning among other techniques.
“It’s a combination of training dataset and fine-tuning techniques that improve the coding abilities of any open-source LLM,” Bindu Reddy, CEO and co-founder of Abacus.ai told VentureBeat. “We have demonstrated that it improves both Qwen-2 72B and LLama-3.1 70b.”
Gen AI for coding tasks is a growing space
The overall market for gen AI in the application development and coding space is an area full of activity.
The early pioneer in the space was GitHub Copilot which helps developers with code completion and application development tasks. Multiple startups including Tabnine and Replit have also been building features that bring the power of LLMs to developers.
Then of course there are the LLM vendors themselves. Dracarys provides a fine-tuned version of Meta’s Llama 3.1 general-purpose model. Anthropic’s Claude 3.5 Sonnet has also emerged in 2024 to be a popular and competent LLM for coding as well.
Article