AI Models: LLAMA 3.1 Heavy and GPT 4
• LLAMA 3.1 is a massive 405 billion parameter model with a 128,000 token contacts length.
• It is superior to OpenAI's GPT 40 and beats Claude 3.5 Sonet on some key benchmarks.
• The model is open source, allowing developers to make money off it as long as their app doesn't have 700 million monthly active users.
• The training data for the model is not open source, which might include blog posts, GitHub repos, Facebook posts, and WhatsApp messages.
• The model weights are open, a significant win for developers building AI-powered apps.