9.6.25

Enable Function Calling in Mistral Agents Using Standard JSON Schema

 This updated tutorial guides developers through enabling function calling in Mistral Agents via the standard JSON Schema format Function calling allows agents to invoke external APIs or tools (like weather or flight data services) dynamically during conversation—extending their reasoning capabilities beyond text generation.


🧩 Why Function Calling?

  • Seamless tool orchestration: Enables agents to perform actions—like checking bank interest rates or flight statuses—in real time.

  • Schema-driven clarity: JSON Schema ensures function inputs and outputs are well-defined and type-safe.

  • Leverage MCP Orchestration: Integrates with Mistral's Model Context Protocol for complex workflows 


🛠️ Step-by-Step Implementation

1. Define Your Function

Create a simple API wrapper, e.g.:

python
def get_european_central_bank_interest_rate(date: str) -> dict: # Mock implementation returning a fixed rate return {"date": date, "interest_rate": "2.5%"}

2. Craft the JSON Schema

Define the function parameters so the agent knows how to call it:

python
tool_def = { "type": "function", "function": { "name": "get_european_central_bank_interest_rate", "description": "Retrieve ECB interest rate", "parameters": { "type": "object", "properties": { "date": {"type": "string"} }, "required": ["date"] } } }

3. Create the Agent

Register the agent with Mistral's SDK:

python
agent = client.beta.agents.create( model="mistral-medium-2505", name="ecb-interest-rate-agent", description="Fetch ECB interest rate", tools=[tool_def], )

The agent now recognizes the function and can decide when to invoke it during a conversation.

4. Start Conversation & Execute

Interact with the agent using a prompt like, "What's today's interest rate?"

  • The agent emits a function.call event with arguments.

  • You execute the function and return a function.result back to the agent.

  • The agent continues based on the result.

This demo uses a mocked example, but any external API can be plugged in—flight info, weather, or tooling endpoints 


✅ Takeaways

  • JSON Schema simplifies defining callable tools.

  • Agents can autonomously decide if, when, and how to call your functions.

  • This pattern enhances Mistral Agents’ real-time capabilities across knowledge retrieval, action automation, and dynamic orchestration.

Google’s MASS Revolutionizes Multi-Agent AI by Automating Prompt and Topology Optimization

 Designing multi-agent AI systems—where several AI "agents" collaborate—has traditionally depended on manual tuning of prompt instructions and agent communication structures (topologies). Google AI, in partnership with Cambridge researchers, is aiming to change that with their new Multi-Agent System Search (MASS) framework. MASS brings automation to the design process, ensuring consistent performance gains across complex domains.


🧠 What MASS Actually Does

MASS performs a three-stage automated optimization that iteratively refines:

  1. Block-Level Prompt Tuning
    Fine-tunes individual agent prompts via local search—sharpening their roles (think “questioner”, “solver”).

  2. Topology Optimization
    Identifies the best agent interaction structure. It prunes and evaluates possible communication workflows to find the most impactful design.

  3. Workflow-Level Prompt Refinement
    Final tuning of prompts once the best network topology is set.

By alternating prompt and topology adjustments, MASS achieves optimization that surpasses previous methods which tackled only one dimension 


🏅 Why It Matters

  • Benchmarked Success: MASS-designed agent systems outperform AFlow and ADAS on challenging benchmarks like MATH, LiveCodeBench, and multi-hop question-answering 

  • Reduced Manual Overhead: Designers no longer need to trial-and-error their way through thousands of prompt-topology combinations.

  • Extended to Real-World Tasks: Whether for reasoning, coding, or decision-making, this framework is broadly applicable across domains.


💬 Community Reactions

Reddit’s r/machinelearningnews highlighted MASS’s leap beyond isolated prompt or topology tuning:

“Multi-Agent System Search (MASS) … reduces manual effort while achieving state‑of‑the‑art performance on tasks like reasoning, multi‑hop QA, and code generation.” linkedin.com

 


📘 Technical Deep Dive

Originating from a February 2025 paper by Zhou et al., MASS represents a methodological advance in agentic AI

  • Agents are modular: designed for distinct roles through prompts.

  • Topology defines agent communication patterns: linear chain, tree, ring, etc.

  • MASS explores both prompt and topology spaces, sequentially optimizing them across three stages.

  • Final systems demonstrate robustness not just in benchmarks but as a repeatable design methodology.


🚀 Wider Implications

  • Democratizing Agent Design: Non-experts in prompt engineering can deploy effective agent systems from pre-designed searches.

  • Adaptability: Potential for expanding MASS to dynamic, real-world settings like real-time planning and adaptive workflows.

  • Innovation Accelerator: Encourages research into auto-tuned multi-agent frameworks for fields like robotics, data pipelines, and interactive assistants.


🧭 Looking Ahead

As Google moves deeper into its “agentic era”—with initiatives like Project Mariner and Gemini's Agent Mode—MASS offers a scalable blueprint for future AS/AI applications. Expect to see frameworks that not only generate prompts but also self-optimize their agent networks for performance and efficiency.

7.6.25

Alibaba's Qwen3-Embedding and Qwen3-Reranker: Redefining Multilingual Embedding and Ranking Standards linkedin.com +3

 Alibaba's Qwen team has unveiled two groundbreaking models: Qwen3-Embedding and Qwen3-Reranker, aiming to revolutionize multilingual text embedding and relevance ranking. These models are designed to address the complexities of multilingual natural language processing (NLP) tasks, offering enhanced performance and versatility.

Key Features and Capabilities

  • Multilingual Proficiency:
    Both models support an impressive array of 119 languages, making them among the most versatile open-source offerings available today. 

  • Model Variants:
    Available in three sizes—0.6B, 4B, and 8B parameters—these models cater to diverse deployment needs, balancing efficiency and performance. 

  • State-of-the-Art Performance:
    Qwen3-Embedding and Qwen3-Reranker have achieved top rankings on multiple benchmarks, including MTEB, MMTEB, and MTEB-Code, outperforming leading models like Gemini. 

  • Versatile Applications:
    These models are optimized for a range of tasks such as semantic retrieval, classification, retrieval-augmented generation (RAG), sentiment analysis, and code search. 

Technical Innovations

The Qwen3 models are built upon a dense transformer-based architecture with causal attention, enabling them to produce high-fidelity embeddings by extracting hidden states corresponding to specific tokens. The training pipeline incorporates large-scale weak supervision and supervised fine-tuning, ensuring robustness and adaptability across various applications. 

Open-Source Commitment

In line with Alibaba's commitment to fostering open research, the Qwen3-Embedding and Qwen3-Reranker models are released under the Apache 2.0 license. They are accessible on platforms like Hugging Face, GitHub, and ModelScope, providing researchers and developers with the tools to innovate and build upon these models. 

Implications for the AI Community

The introduction of Qwen3-Embedding and Qwen3-Reranker marks a significant advancement in the field of multilingual NLP. By offering high-performance, open-source models capable of handling complex tasks across numerous languages, Alibaba empowers the AI community to develop more inclusive and effective language processing tools.

References:

  1. Qwen GitHub

  2. Qwen3 Embedding Collection : Qwen3-Embedding Collection

  3. Hugging Face Collection

Rime's Arcana TTS Model Elevates Sales by 15% with Personalized Voice AI

 In the evolving landscape of AI-driven customer engagement, Rime's innovative text-to-speech (TTS) model, Arcana, is making significant strides. By enabling the creation of highly personalized and natural-sounding voices, Arcana has demonstrated a remarkable 15% increase in sales for prominent brands such as Domino's and Wingstop. 

Revolutionizing Voice AI with Personalization

Traditional TTS systems often rely on a limited set of pre-recorded voices, lacking the flexibility to cater to diverse customer demographics. Arcana addresses this limitation by allowing users to generate an "infinite" variety of voices based on specific characteristics. By inputting simple text prompts describing desired attributes—such as age, gender, location, and interests—businesses can create voices that resonate more deeply with their target audiences. 

For example, a company can request a voice like "a 30-year-old female from California who is into software," resulting in a unique and relatable voice profile. This level of customization enhances the authenticity of customer interactions, fostering stronger connections and driving engagement.

Technical Advancements Behind Arcana

Arcana's success stems from its multimodal and autoregressive architecture, trained on real conversational data rather than scripted voice actor recordings. This approach enables the model to produce speech that is not only natural-sounding but also contextually appropriate and emotionally nuanced. 

The model's capabilities extend to various speech styles, including whispering and sarcasm, and support for multiple languages. Such versatility ensures that businesses can tailor their communication strategies to diverse markets and customer preferences.

Enterprise Applications and Offerings

Designed for high-volume, business-critical applications, Arcana empowers enterprises to craft unique voice experiences without the need for human agents. For organizations seeking ready-made solutions, Rime offers eight flagship voice profiles, each with distinct characteristics to suit different brand personas. 

Implications for the Future of Customer Engagement

The demonstrated impact of Arcana on sales performance underscores the potential of personalized voice AI in transforming customer engagement strategies. By delivering voices that mirror the diversity and individuality of customers, businesses can create more meaningful and effective interactions.

As AI technology continues to advance, the integration of sophisticated TTS models like Arcana is poised to become a cornerstone of customer-centric marketing and communication efforts.

Mistral AI Releases Codestral Embed – A High‑Performance Model for Scalable Code Retrieval and Semantics

 Mistral AI has introduced Codestral Embed, a powerful code embedding model purpose-built for scalable retrieval and semantic understanding in software development environments. Positioned as a companion to its earlier generative model, Codestral 22B, this release marks a notable advancement in intelligent code search and analysis.


🔍 Why Codestral Embed Matters

  • Semantic Code Retrieval:
    The model transforms snippets and entire files into rich vector representations that capture deep syntax and semantic relationships. This allows developers to search codebases more meaningfully beyond simple text matching.

  • Scalable Performance:
    Designed to work efficiently across large code repositories, Codestral Embed enables fast, accurate code search — ideal for enterprise-grade tools and platforms.

  • Synergy with Codestral Generation:
    Complementing Mistral’s existing code generation model, this pipeline combines retrieval and generation: find the right snippets with Codestral Embed, then synthesize or augment code with Codestral 22B.


⚙️ Technical and Deployment Highlights

  1. Dedicated Embedding Architecture:
    Trained specifically on code, the model learns fine-grained semantic nuances, including API usage patterns, refactoring structures, and cross-library contexts.

  2. Reranking Capabilities:
    Likely enhanced with a reranker head—mirroring embeds + reranker designs popular for academic/state-of-the-art code search systems. This design improves relevance assumptions and developer satisfaction.

  3. Enterprise-Ready APIs:
    Mistral plans to offer easy-to-integrate APIs, enabling organizations to embed the model in IDEs, CI pipelines, and self-hosted code search systems.

  4. Open and Accessible:
    True to Mistral's open-access ethos, expect code, weights, and documentation to be released under permissive terms — fostering community-driven development and integration.


🧰 Use Cases

  • Code Search Tools:
    Improve developer efficiency by enabling intelligent search across entire codebases, identifying functionally similar snippets and patterns.

  • Automated Code Review:
    Find redundant, outdated, or potentially buggy code sections via semantic similarity — rather than just matching strings.

  • Intelligent IDE Assistance:
    Real-time contextual suggestions and refactoring tools powered by deep understanding of project-specific coding patterns.

  • Knowledge Distillation:
    Build searchable "FAQ" repositories with trusted best-practices code combined with Code embed for alignment and retrieval.


📈 Implications for Developers & Teams

  • Efficiency Boost: Semantic embedding accelerates code discovery and repurposing, reducing context-switching and redundant development work.

  • Better Code Quality:
    Context-aware search helps surface anti-patterns, duplicate logic, and outdated practices.

  • Scalability at Scale:
    Designed for enterprise settings, large monorepos, and self-managed environments.

  • Ecosystem Growth:
    Open access means third parties can build plugins, integrate with SIEMs, LSPs, and continue innovating — expanding utility.


✅ Final Takeaway

Codestral Embed is a strategic addition to Mistral’s AI-powered code suite. By unlocking scalable, semantic code search and analysis, it empowers developers and organizations to traverse complex codebases with greater insight and speed. Paired with Codestral 22B, it reflects a complete retrieval-augmented generation pipeline — poised to elevate code intelligence tooling across the industry.

6.6.25

NVIDIA's ProRL: Advancing Reasoning in Language Models Through Prolonged Reinforcement Learning

 NVIDIA has unveiled ProRL (Prolonged Reinforcement Learning), a groundbreaking training methodology designed to expand the reasoning boundaries of large language models (LLMs). By extending the duration and stability of reinforcement learning (RL) training, ProRL enables LLMs to develop novel reasoning strategies that surpass the capabilities of their base models.

Understanding ProRL

Traditional RL approaches often face challenges in enhancing the reasoning abilities of LLMs, sometimes merely amplifying existing patterns without fostering genuine innovation. ProRL addresses this by introducing:

  • KL Divergence Control: Maintains a balance between exploring new strategies and retaining learned knowledge.

  • Reference Policy Resetting: Periodically resets the policy to prevent convergence on suboptimal solutions.

  • Diverse Task Suite: Engages models in a wide array of tasks to promote generalization and adaptability.

These components collectively ensure that models not only learn more effectively but also develop unique reasoning pathways previously inaccessible through standard training methods.

Key Findings

Empirical evaluations demonstrate that ProRL-trained models consistently outperform their base counterparts across various benchmarks, including scenarios where base models fail entirely. Notably, improvements were observed in:

  • Pass@k Evaluations: Higher success rates in generating correct outputs within k attempts.

  • Creativity Index: Enhanced ability to produce novel solutions not present in the training data.

These results indicate that prolonged RL training can lead to the emergence of new reasoning capabilities, expanding the solution space beyond initial limitations.

Implications for AI Development

The introduction of ProRL signifies a pivotal shift in AI training paradigms. By demonstrating that extended and stable RL training can foster genuine reasoning advancements, NVIDIA paves the way for more sophisticated and adaptable AI systems. This has profound implications for applications requiring complex decision-making and problem-solving abilities.

Accessing ProRL Resources

To facilitate further research and development, NVIDIA has released the model weights associated with ProRL. Interested parties can access these resources here:

These resources provide valuable insights and tools for researchers aiming to explore the frontiers of AI reasoning capabilities.

Google's Gemini 2.5 Pro Preview Surpasses DeepSeek R1 and Grok 3 Beta in Coding Performance

 Google has unveiled an updated preview of its Gemini 2.5 Pro model, showcasing significant advancements in coding performance. According to recent benchmarks, this latest iteration surpasses notable competitors, including DeepSeek R1 and Grok 3 Beta, reinforcing Google's position in the AI development arena.

Enhanced Performance Metrics

The Gemini 2.5 Pro Preview, specifically the 06-05 Thinking version, exhibits marked improvements over its predecessors. Notably, it achieved a 24-point increase in the LMArena benchmark and a 35-point rise in WebDevArena, positioning it at the forefront of coding performance evaluations. These enhancements underscore the model's refined capabilities in handling complex coding tasks.

Outpacing Competitors

In rigorous testing, Gemini 2.5 Pro outperformed several leading AI models:

  • OpenAI's o3, o3-mini, and o4-mini

  • Anthropic's Claude 4 Opus

  • xAI's Grok 3 Beta

  • DeepSeek's R1

These results highlight Gemini 2.5 Pro's advanced reasoning and coding proficiencies, setting a new benchmark in AI model performance.

Enterprise-Ready Capabilities

Beyond performance metrics, the Gemini 2.5 Pro Preview is tailored for enterprise applications. It offers enhanced creativity in responses and improved formatting, addressing previous feedback and ensuring readiness for large-scale deployment. Accessible via Google AI Studio and Vertex AI, this model provides developers and enterprises with robust tools for advanced AI integration.

Looking Ahead

With the public release of Gemini 2.5 Pro on the horizon, Google's advancements signal a significant leap in AI-driven coding solutions. As enterprises seek more sophisticated and reliable AI tools, Gemini 2.5 Pro stands out as a formidable option, combining superior performance with enterprise-grade features.

Karpathy doesn't use a fancy app to manage his research. He uses a folder, Obsidian, and an AI — and I want to copy it. He posted about ...