At Qubika, we’re passionate about pushing the boundaries of what’s possible with data and AI.

That’s why we were thrilled to invite the Austin tech community to the first Databricks Meetup in Austin, on Tuesday, May 20, 2025. We welcomed data scientists, AI engineers, developers, and those simply curious about the future of AI to discuss cutting-edge innovations and practical insights.

How can the Databricks Mosaic AI Platform transform AI agent and RAG applications?

The highlight of the evening was a a deep dive by Samaya Madhavan, Senior Solutions Architect at Databricks, into the Databricks Mosaic AI Agent Framework and Agent Evaluation —a game-changer for building production-quality Agentic and Retrieval-Augmented Generation (RAG) applications.

In addition, Samaya explored:

• Human feedback mechanisms: How the framework enables seamless feedback loops via intuitive interfaces, empowering subject matter experts to fine-tune AI outputs efficiently.
• Automated quality assessments: Leveraging AI judges to provide detailed metrics on accuracy, relevance, and safety—pinpointing areas for improvement with precision.
• End-to-end workflow integrations: A full-circle development process connected to MLflow, simplifying everything from development to deployment.

These tools directly address critical challenges in AI projects—such as metric selection, rapid iterations, and collecting actionable human feedback—ultimately enabling organizations to deliver high-quality AI solutions at scale.

From concept to reality: Qubika’s perspective

The second talk of the event was delivered by Sebastian Diaz, Head of Data & AI at Qubika, who shared real-world experiences of building AI agents on the Databricks platform. Sebastian demonstrated how Qubika’s team uses the Databricks Mosaic AI Agent Framework to accelerate development cycles and enhance the performance of GenAI-powered solutions.

You can read more about our approach in Qubika’s white paper: Building powerful & scalable AI Agents

Check out some of the highlights of the event