We just took a boring chat interface of an AI agent to a whole new level with smart AR glasses. We built a system that doesn’t just assist, but completely transforms the way restaurants interact with customers.

We introduced a Realtime API integration with Brilliant Labs' smart glasses, capable of listening to conversations and delivering answers right in front of your eyes (literally, on your lenses!)

These smart glasses are trained on everything a restaurant might need: from menu details and allergy information to wine pairings and special requests. They empower staff to handle questions effortlessly, suggest dishes, and manage customer feedback in real-time. In the demo below, the system was answering allergy-related queries and wine pairings in real time—flawlessly.

We know there's still a long road ahead, but the potential is massive. This technology has the capability to empower not just restaurants but the entire hospitality industry, delivering a smooth, smart experience for both staff and the customers. I'm so excitedly looking forward to building many more interesting applications of AI Agents.

Here’s how it all unfolded: I took a leap of faith and flew to SF for tech week, not knowing what to expect. I teamed up with Apostoli Evreniadis, who's building Ality, an AI-driven restaurant ecosystem. Four days later, we won the Horizon Hack by Founders, Inc.—it still feels surreal! The energy, innovation, and people were incredible. Huge thanks to Hubert Thieblot and team for creating this inspiring space. I ended up canceled my return ticket to stay for the next month and fully dive into the builder community at Founders, Inc.

Original post