Mistral Unveils Medium 3: High-Performance AI at Unmatched Value

 On May 7, 2025, French AI startup Mistral announced the release of its latest model, Mistral Medium 3, emphasizing a balance between efficiency and performance. Positioned as a cost-effective alternative in the competitive AI landscape, Medium 3 is designed for tasks requiring high computational efficiency without compromising output quality. 

Performance and Cost Efficiency

Mistral claims that Medium 3 achieves "at or above" 90% of the performance of Anthropic’s more expensive Claude Sonnet 3.7 across various benchmarks. Additionally, it reportedly surpasses recent open models like Meta’s Llama 4 Maverick and Cohere’s Command A in popular AI performance evaluations.

The model is available through Mistral’s API at a competitive rate of $0.40 per million input tokens and $2 per million output tokens. For context, a million tokens approximate 750,000 words. 

Deployment and Accessibility

Medium 3 is versatile in deployment, compatible with any cloud infrastructure, including self-hosted environments equipped with four or more GPUs. Beyond Mistral’s API, the model is accessible via Amazon’s SageMaker platform and is slated for integration with Microsoft’s Azure AI Foundry and Google’s Vertex AI in the near future. 

Enterprise Applications

Tailored for coding and STEM-related tasks, Medium 3 also excels in multimodal understanding. Industries such as financial services, energy, and healthcare have been beta testing the model for applications including customer service, workflow automation, and complex data analysis. 

Expansion of Mistral’s Offerings

In conjunction with the Medium 3 launch, Mistral introduced Le Chat Enterprise, a corporate-focused chatbot service. This platform offers tools like an AI agent builder and integrates with third-party services such as Gmail, Google Drive, and SharePoint. Le Chat Enterprise, previously in private preview, is now generally available and will soon support the Model Coordination Protocol (MCP), facilitating seamless integration with various AI assistants and systems. 

---

Explore Mistral Medium 3: Mistral API | Amazon SageMaker

Meta and Cerebras Collaborate to Launch High-Speed Llama API

 At its inaugural LlamaCon developer conference in Menlo Park, Meta announced a strategic partnership with Cerebras Systems to introduce the Llama API, a new AI inference service designed to provide developers with unprecedented processing speeds. This collaboration signifies Meta's formal entry into the AI inference market, positioning it alongside industry leaders like OpenAI, Anthropic, and Google.

Unprecedented Inference Speeds

The Llama API leverages Cerebras' specialized AI chips to achieve inference speeds of up to 2,648 tokens per second when processing the Llama 4 model. This performance is 18 times faster than traditional GPU-based solutions, dramatically outpacing competitors such as SambaNova (747 tokens/sec), Groq (600 tokens/sec), and GPU services from Google. 

Transforming Open-Source Models into Commercial Services

While Meta's Llama models have amassed over one billion downloads, the company had not previously offered a first-party cloud infrastructure for developers. The introduction of the Llama API transforms these popular open-source models into a commercial service, enabling developers to build applications with enhanced speed and efficiency. 

Strategic Implications

This move allows Meta to compete directly in the rapidly growing AI inference service market, where developers purchase tokens in large quantities to power their applications. By providing a high-performance, scalable solution, Meta aims to attract developers seeking efficient and cost-effective AI infrastructure. 

---

Takeaway:
Meta's partnership with Cerebras Systems to launch the Llama API represents a significant advancement in AI infrastructure. By delivering inference speeds that far exceed traditional GPU-based solutions, Meta positions itself as a formidable competitor in the AI inference market, offering developers a powerful tool to build and scale AI applications efficiently.