As AI capabilities advance at a breakneck speed, businesses are increasingly viewing Microsoft 365 Copilot not as a mere built-in productivity assistant, but as a customizable platform. In our recent webinar, Bespoke AI: Customizing Microsoft 365 Copilot with Agents, our CEO, Michal Pisarek, and Microsoft MVP Andrew Connell shared key strategies and insights on crafting custom agents—declarative and custom-engine—that turn Copilot into a powerful, personalized tool. Read on for the rundown.
Copilot's architecture places an emphasis on the role of the semantic index—a dual-index system built from Microsoft Graph content that supports personalized, security-trimmed responses. It enables Copilot to ground its outputs in both public and organizational data, providing contextually relevant answers. Crucially, even a single Microsoft 365 Copilot license can activate this index tenant-wide.
While Copilot uses foundational models like GPT-4o, Microsoft's orchestrator governs the interaction between user prompts, organizational data, and the model itself. This layered architecture is what sets Microsoft 365 Copilot apart from standalone tools like ChatGPT.
Do you find default Copilot applications—like the one in Outlook—underwhelming? You're not alone. The real value emerges when you build agents tailored to your business scenarios. As Andrew put it, “Copilot becomes truly useful when it’s working with your data, your rules, and your workflows.”
Two main customization paths exist:
Andrew detailed two customization vectors:
These enhancements also solve practical limitations. For instance, the semantic index only processes the beginning portion of large documents. A custom agent can bypass this by retrieving full content via custom APIs, enabling comprehensive document parsing.
Key operational advice included:
On the licensing side, it's important to note a few things: For one, dev tenants can't purchase Copilot licenses. Also, the new consumption model lacks grounding unless paired with a standard Copilot license. And finally, Power Platform licenses may be needed for agents writing to services like Dataverse.
Microsoft’s pivot from "custom copilots" to "agents" hints at a more autonomous future—where agents act independently on behalf of users. Andrew previewed that upcoming features—likely to be announced at Microsoft Build—will allow more nuanced deployment and integration, including differential surfacing across Teams and other apps.
Custom Copilot agents represent a shift from AI convenience to AI empowerment. By tailoring agents with organizational knowledge and business-specific actions, companies can unlock transformative value from their Microsoft 365 investments.
As Andrew reminded us, building with these tools isn’t just about keeping up—it’s about leading the curve. Whether you're a developer or an IT leader, now's the time to start shaping Copilot into your organization's smartest assistant.
Want to learn more? Andrew's currently offering his 6-hour pre-recorded workshop, Build Declarative Agents for Microsoft 365 Copilot, for 20% off at https://vtns.io/orchestry-april-2025. And if you want to go even deeper, he'll also be hosting a 2-day Copilot developer workshop on building declarative agents—sign up here.