-
Notifications
You must be signed in to change notification settings - Fork 2
Expand file tree
/
Copy pathapa.yaml
More file actions
525 lines (488 loc) · 24.9 KB
/
apa.yaml
File metadata and controls
525 lines (488 loc) · 24.9 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
################################################################################
# Microsoft Agent Platform Advisor — Scoring Matrix
# Platforms: Agent Builder (agent_builder), Microsoft 365 Copilot (m365_copilot),
# Copilot Studio (copilot_studio), Microsoft Foundry (foundry)
#
# Score scale: 0 = not a fit · 1 = weak signal · 2 = moderate · 3 = strong
# Max raw score per platform: 15 (5 questions × max 3)
################################################################################
meta:
version: "1.1"
platforms:
- id: agent_builder
label: Agent Builder
- id: m365_copilot
label: Microsoft 365 Copilot
- id: copilot_studio
label: Copilot Studio
- id: foundry
label: Microsoft Foundry
################################################################################
# QUESTIONS
################################################################################
questions:
- id: q1
label: Who is building this agent?
purpose: Sets persona weight for interpreting later answers
prompt: Some platforms are designed for makers using low-code tools, while others require professional development skills.
options:
- id: q1a
label: Business user or subject matter expert — no coding experience
scores:
agent_builder: 3
copilot_studio: 1
foundry: 0
- id: q1b
label: Low-code maker or IT professional — comfortable with drag-and-drop tools and configuration
scores:
agent_builder: 1
copilot_studio: 3
foundry: 0
- id: q1c
label: Professional developer — writes code and builds software
scores:
agent_builder: 0
copilot_studio: 2
foundry: 3
- id: q1d
label: Data scientist or AI/ML engineer — works with AI models and data infrastructure
scores:
agent_builder: 0
copilot_studio: 0
foundry: 3
- id: q8
label: Who will use this agent?
purpose: External-facing is a hard constraint that affects platform eligibility
prompt: Will this agent be used by people within your organization, or by external users such as customers or partners?
hard_rules:
- condition: option in [q8b]
effect: >
Set agent_builder = 0 and m365_copilot = 0.
Agent Builder has no external publishing path.
Microsoft 365 Copilot is tenant-scoped only.
options:
- id: q8a
label: Internal employees only — people inside our organization
scores:
agent_builder: 3
copilot_studio: 3
foundry: 1
- id: q8b
label: External users — customers, partners, or the public
scores:
agent_builder: 0
copilot_studio: 3
foundry: 3
hard_rule_trigger: true
- id: q8d
label: Not decided yet
scores:
agent_builder: 2
copilot_studio: 2
foundry: 1
- id: q2
label: Where will users interact with this agent?
purpose: Deployment surface is often a hard constraint
prompt: Think about where people will access or use the agent in their day-to-day work.
options:
- id: q2a
label: Inside Microsoft 365 apps — Teams, Copilot, SharePoint, or Outlook
scores:
agent_builder: 3
copilot_studio: 3
foundry: 1
- id: q2b
label: In a custom app — a website or mobile app your team builds
scores:
agent_builder: 0
copilot_studio: 3
foundry: 2
- id: q2c
label: Running automatically in the background — triggered by events, not by a person chatting with it
scores:
agent_builder: 0
copilot_studio: 2
foundry: 3
- id: q2d
label: Multiple places, or not decided yet
scores:
agent_builder: 1
copilot_studio: 3
foundry: 2
- id: q4
label: What should this agent do?
purpose: Single strongest discriminator between Copilot Studio and Foundry
prompt: What type of work do you want this agent to handle? Choose the option that best represents the most advanced task you expect it to perform.
hard_rules:
- condition: option == q4d
effect: >
Set foundry = 3. Cap agent_builder and m365_copilot at 0
regardless of other answers.
options:
- id: q4a
label: Answer questions in a single exchange — Q&A, lookups, or summaries
scores:
agent_builder: 3
copilot_studio: 3
foundry: 1
- id: q4b
label: Have a back-and-forth conversation and remember context
scores:
agent_builder: 2
copilot_studio: 3
foundry: 2
- id: q4c
label: Complete multi-step tasks — follow a process, check multiple systems, or take actions like submitting forms or updating records
scores:
agent_builder: 0
copilot_studio: 3
foundry: 3
- id: q4d
label: Manage complex workflows — coordinate multiple agents or handle long-running processes
scores:
agent_builder: 0
copilot_studio: 1
foundry: 3
hard_rule_trigger: true
- id: q3
label: What information does this agent need to access?
purpose: Grounding requirements narrow the field fast
prompt: Where does the information this agent needs currently live? Pick the option closest to where the information lives today.
options:
- id: q3a
label: Content in Microsoft 365 — like SharePoint, OneDrive, Teams, or Outlook
scores:
agent_builder: 3
copilot_studio: 2
foundry: 0
- id: q3b
label: Other business systems — like Salesforce, SAP, ServiceNow, or your own databases
scores:
agent_builder: 1
copilot_studio: 3
foundry: 2
- id: q3c
label: Advanced or private data sources — like data warehouses, large data storage, or AI search tools managed by your team
scores:
agent_builder: 0
copilot_studio: 1
foundry: 3
- id: q3d
label: A mix — some data in Microsoft 365, some in other systems
scores:
agent_builder: 1
copilot_studio: 3
foundry: 2
################################################################################
# SCORING ENGINE
################################################################################
scoring:
# Step 1 — Hard rules are evaluated before summing.
# They cap or zero out platforms regardless of cumulative scores.
# Hard rules represent real platform limitations, not preferences.
hard_rule_evaluation: pre_sum
hard_rules:
q4d:
zero: [agent_builder, m365_copilot]
label: "Complex agent orchestration — this is a hard requirement for Foundry"
q4c:
zero: [agent_builder]
label: "Multi-step tasks — Agent Builder cannot follow processes or take actions across systems"
q8b:
zero: [agent_builder, m365_copilot]
label: "External user audience — Agent Builder and M365 Copilot cannot publish externally"
q2b:
zero: [agent_builder]
label: "Custom app deployment — Agent Builder can only run inside Microsoft 365"
q2c:
zero: [agent_builder]
label: "Background execution — Agent Builder has no event-driven or autonomous capabilities"
q3c:
zero: [agent_builder]
label: "Advanced data sources — Agent Builder can only access Microsoft 365 data"
# Step 2 — Sum raw scores across all answered questions.
raw_score_max: 15 # 5 questions × max score of 3
# Step 2.5 — Persona preferences: soft overrides that force one platform
# above another when a specific persona is selected. Unlike hard rules,
# scores are preserved. A rationale message is shown to explain the override.
persona_preferences:
- when:
q1: q1d
prefer: copilot_studio
over: agent_builder
rationale: >
Copilot Studio is recommended over Agent Builder for data scientists and AI/ML engineers
because it supports custom AI model integration, code-first development via the VS Code
extension, and more flexible orchestration — capabilities that Agent Builder does not offer.
# Step 3 — Map raw scores to recommendation strength.
recommendation_thresholds:
- min: 12
max: 15
label: Strong fit
description: This platform is well-aligned with your requirements across all dimensions.
- min: 8
max: 11
label: Good fit
description: This platform meets most of your requirements with minor tradeoffs.
- min: 4
max: 7
label: Partial fit
description: This platform can address your scenario but may require workarounds.
- min: 0
max: 3
label: Not recommended
description: This platform is unlikely to meet your requirements in this scenario.
# Step 5 — Tie handling: surface both as a complementary pair.
tie_handling:
threshold_points: 2
present_as: complementary_pair
# Persona-based tiebreakers — applied before valid_pairs when a specific
# answer makes one platform a better fit despite equal scores.
tiebreakers:
- when:
q1: q1c
platforms: [agent_builder, copilot_studio]
prefer: copilot_studio
rationale: >
When the builder is a professional developer and scores are equal,
Copilot Studio is the better fit — it supports code-first authoring
via the VS Code extension while Agent Builder is no-code only.
- when:
q1: q1d
platforms: [copilot_studio, foundry]
prefer: copilot_studio
rationale: >
When the builder is a data scientist or AI/ML engineer and scores are equal,
Copilot Studio is preferred — it provides a faster path to production
agents while Foundry is reserved for deeper custom orchestration.
valid_pairs:
- platforms: [copilot_studio, foundry]
rationale: Build in Copilot Studio, extend with custom code in Foundry.
- platforms: [m365_copilot, copilot_studio]
rationale: Microsoft 365 Copilot for end users, Copilot Studio for customization and extension.
- platforms: [agent_builder, m365_copilot]
rationale: Agent Builder for Microsoft 365-native agents, Microsoft 365 Copilot for broader extensibility.
# Cross-question contradiction notes — shown as contextual banners
# when the user's answer combination is logically contradictory.
cross_question_notes:
- when:
q2: q2c
q4: q4a
note: >
You selected a background, event-driven agent but also chose simple Q&A.
Background agents typically process events automatically rather than answering
user questions. Consider whether your agent is event-driven or conversational.
- when:
q8: q8b
q2: q2a
note: >
You selected external users but want the agent inside Microsoft 365 apps.
External users typically can't access your organization's Teams, SharePoint,
or Outlook. Your agent may need a custom web deployment to reach them.
- when:
q1: q1a
q4: q4d
note: >
Complex multi-agent orchestration typically requires professional development
skills. Consider partnering with your development team, or selecting a simpler
task type that matches your experience level.
- when:
q1: q1a
q3: q3c
note: >
Advanced data sources like data warehouses and AI search tools usually require
technical expertise to configure. Consider whether your IT or development team
will help set up data access for the agent.
# Winner-persona mismatch notes — shown when the recommended platform
# doesn't match the builder persona.
winner_persona_notes:
- winner: foundry
persona: q1a
note: >
Microsoft Foundry is the right platform for this scenario, but it requires
professional development skills and Azure expertise. Consider partnering with
your development team to build and maintain this agent.
################################################################################
# RECOMMENDATION COPY
################################################################################
recommendations:
agent_builder:
headline: Agent Builder
description: Create simple agents in minutes without writing code, using your existing Microsoft 365 files and data
resources_url: https://microsoft.github.io/agent-resources/m365-copilot/#agent-builder
scoring_summary: Best suited for no-code scenarios entirely within Microsoft 365.
exploration_best_for: Create agents using your Microsoft 365 data
exploration_summary: >
Choose Agent Builder when you want to create agents without writing any code,
using data already in SharePoint or OneDrive. Ideal for business users who need
simple Q&A, summarization, or lookup agents for their team.
summary: >
The right starting point for business users who want to build
agents directly inside Microsoft 365 without writing code.
best_for:
- No-code creators working within Microsoft 365
- Internal-only agents grounded in SharePoint or OneDrive
- Simple Q&A, summarization, or lookup scenarios
watch_out_for:
- Can't be shared with people outside your organization
- Can only use data stored in Microsoft 365 (SharePoint, OneDrive, etc.)
- Not suitable for custom logic or external system integration
- No evaluation or testing tools — quality assurance is manual
- No lifecycle management — no versioning, environments, or CI/CD
- Minimal observability — limited visibility into agent behavior and usage
templates:
- label: Career Coach
description: Personalized career development plans, skill gap analysis, and actionable advice
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-career-coach
- label: Corporate Communications Crafter
description: On-brand internal and external communications — announcements, newsletters, exec updates
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-corporate-communications
- label: Customer Insight Assistant
description: Detailed customer profiles including industry, priorities, leadership, and competitors
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-customer-insight
- label: Idea Coach
description: Guided brainstorming sessions with creative exercises to develop and refine ideas
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-idea-coach
- label: Interview Question Assistant
description: Tailored, high-quality interview questions based on role and job description
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-interview-questions
- label: Learning Coach
description: Structured learning plans and topic summaries tailored to individual knowledge gaps
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-learning-coach
- label: Meeting Coach
description: Structured agendas, role assignments, and real-time guidance to run effective meetings
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-meeting-coach
- label: Prompt Coach
description: Guides users in crafting well-structured Copilot prompts through interactive feedback
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-prompt-coach
- label: Request for Proposal Assistant
description: Generates tailored RFP response drafts from existing proposal content and templates
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-rfp-assistant
- label: Quiz Tutor
description: Interactive quizzes based on training content to reinforce learning and knowledge retention
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-quiz-tutor
- label: Scrum Assistant
description: Real-time guidance on scrum ceremonies, backlog management, and Agile best practices
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-scrum-assistant
- label: Text Translator Assistant
description: Translates text, adjusts tone for professional communication, and improves writing quality
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-text-translator
- label: Writing Coach
description: Detailed feedback on clarity, coherence, grammar, and tone to elevate writing quality
url: https://learn.microsoft.com/microsoft-365/copilot/extensibility/agent-template-writing-coach
m365_copilot:
headline: Microsoft 365 Copilot
description: AI assistants built into Microsoft 365 apps like Teams, Outlook, and SharePoint — now with Copilot Cowork for autonomous, multi-step task automation
resources_url: https://microsoft.github.io/agent-resources/m365-copilot/
scoring_summary: Fits scenarios where built-in Copilot features in Microsoft 365 cover most of the need.
exploration_best_for: Use AI built into your Microsoft 365 apps
exploration_summary: >
Includes Copilot Cowork for autonomous multi-step task execution,
plus first-party agents like Researcher, Analyst, Facilitator, and Interpreter —
all built into Teams, Outlook, SharePoint, and other Microsoft 365 apps.
Ideal when built-in capabilities already cover most of your needs.
summary: >
Best when the built-in Microsoft 365 Copilot capabilities already meet most
of what you need. Copilot Cowork takes it further — delegating multi-step
tasks that span Outlook, Teams, Word, and more.
first_party_agents:
- label: Copilot Cowork
description: Autonomous multi-step task execution across Microsoft 365 — delegates work like meeting prep, calendar management, status reports, and cross-app workflows (Frontier preview)
url: https://learn.microsoft.com/microsoft-365/copilot/cowork/
- label: Sales agent
description: Seller productivity in Teams, Outlook, and CRM apps
url: https://learn.microsoft.com/microsoft-sales-copilot/
- label: Service agent
description: Customer service agent assistance across support channels
url: https://learn.microsoft.com/microsoft-copilot-service/
- label: Finance agent
description: Financial workflows, analysis, and reconciliation in Excel and Outlook
url: https://learn.microsoft.com/copilot/finance/
- label: Employee Self-Service Agent
description: HR and IT self-service within Teams for policies, FAQs, and requests
url: https://learn.microsoft.com/copilot/microsoft-365/employee-self-service/overview
- label: SharePoint Agent
description: Q&A grounded in a specific SharePoint site or document library
url: https://support.microsoft.com/office/get-started-with-sharepoint-agents-69e2faf9-2c1e-4baa-8305-23e625021bcf
- label: Facilitator Agent
description: Meeting facilitation, real-time notes, and action items in Teams
url: https://learn.microsoft.com/microsoftteams/facilitator-teams
- label: Researcher Agent
description: Synthesizes information from the web and Microsoft 365 to produce in-depth research and content
url: https://techcommunity.microsoft.com/blog/microsoft365copilotblog/researcher-agent-in-microsoft-365-copilot/4397186
- label: Analyst Agent
description: Transforms complex data into clear insights, charts, and visualizations using Python
url: https://techcommunity.microsoft.com/blog/microsoft365copilotblog/analyst-agent-in-microsoft-365-copilot/4397191
- label: Interpreter Agent
description: Real-time speech-to-speech interpretation in Teams meetings across nine languages
url: https://learn.microsoft.com/microsoftteams/interpreter-agent-teams
- label: Project Manager Agent
description: Automates project plan creation, task tracking, and status reporting in Planner (preview)
url: https://aka.ms/agents/ProjectManagerDocs
- label: Channel Agent
description: Teams channel expert for summarizing conversations, managing tasks, and boosting productivity (preview)
url: https://support.microsoft.com/office/get-started-with-channel-agent-for-teams-channels-b85945cf-deef-4f1e-9db1-66e1a23b6a65
- label: Community Agent
description: Accelerates knowledge sharing and surfaces expertise across org communities in Viva Engage (preview)
url: https://learn.microsoft.com/viva/engage/ai-technology-with-viva-engage/agents-community-network-deployment-config
copilot_studio:
headline: Copilot Studio
description: Build agents that connect to other business systems, automate processes, and work across websites, Teams, and more
resources_url: https://microsoft.github.io/agent-resources/copilot-studio/
scoring_summary: The most flexible low-code option for agents that connect to external systems.
exploration_best_for: Extend agents across business systems and workflows
exploration_summary: >
Choose Copilot Studio when you need agents that go beyond Microsoft 365 —
connecting to CRMs, databases, or external APIs with 1,400+ pre-built connectors.
Great for IT pros and makers building multi-turn conversational experiences.
summary: >
The most flexible option for building agents without heavy coding —
connect to outside systems, deploy to websites or Teams, and automate
business processes.
best_for:
- Low-code makers and IT pros
- Agents connecting to external APIs, CRM, ERP, or databases — over 1,400 pre-built connectors plus MCP server support
- Agent-to-agent orchestration — an agent can call other agents as tools
- Multi-turn conversational experiences
- Internal and external-facing deployment
- Built-in evaluation test sets with quality scoring and groundedness detection
watch_out_for:
- Complex ML pipelines or custom model training require Foundry
- Long-running multi-agent orchestration is better served by Foundry
- Model selection is limited to a curated list — no bring-your-own model
- No per-user long-term memory or personalization
persona_tips:
q1c: >
🛠️ <strong>Developer tip:</strong> You can build Copilot Studio agents in YAML using the
<a href="https://learn.microsoft.com/microsoft-copilot-studio/authoring-overview" target="_blank" rel="noopener noreferrer">Copilot Studio extension for VS Code</a>
foundry:
headline: Microsoft Foundry
description: A developer platform for building highly customized agents with your own AI models and full control over the technology stack
resources_url: https://microsoft.github.io/agent-resources/microsoft-foundry/
scoring_summary: The right choice when full technical control, custom models, or strict compliance is required.
exploration_best_for: Build fully customizable agentic systems
exploration_summary: >
Choose Microsoft Foundry when your team needs full technical control — bring
your own AI models, manage complex multi-agent systems, or meet strict
regulatory requirements. Built for professional developers and ML engineers.
summary: >
The right choice when your team needs full technical control — bring your
own AI models, manage complex multi-agent systems, or meet strict
regulatory requirements.
best_for:
- Professional developers and ML engineers
- Using your own AI models or fine-tuning existing ones
- Memory as a service — per-user long-term personalization with configurable scope (user, team, or org level)
- Full evaluation suite — automatic eval, human eval, and adversarial red teaming
- Full lifecycle management — git integration, CI/CD pipelines, and native versioning as a first-class primitive
- OpenTelemetry and App Insights integration for end-to-end observability
- Agent framework that can orchestrate across both Copilot Studio and Foundry agents
- AI gateway for granular cost control, rate limiting, and usage policies
- Systems where multiple agents work together and need to track shared progress
- Strict compliance requirements (e.g., healthcare, government, or data-residency regulations)
- Agents embedded in custom-built applications
watch_out_for:
- Higher implementation complexity and time-to-value
- Requires Azure expertise and development resources
- Overkill for standard Microsoft 365-native or low-code scenarios
################################################################################