Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →microsoftdocs/azure-pipelines
Expert knowledge for Azure Pipelines development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment.
Passed 9 of 17 test cases with the skill, and 9 of 17 without it.
and 10 more in the full report
12 fixed3 passed either way8 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
One of 12 test cases the skill fixed. Same model, same prompt, with and without the skill.
Our automated UI tests intermittently fail in Azure Pipelines due to timing issues. Engineers want to ignore all test failures, but management wants system-level detection and quarantine of flaky tests without masking real bugs. What feature and documentation URL covers flaky test management in Azure Pipelines?
| Checked | Without skill | With skill |
|---|---|---|
| Contains the reference URL https://learn.microsoft.com/en-us/azure/devops/pipelines/test/flaky-test-management?view=azure-devops | Missed | Passed |
| Describes quarantining flaky tests to prevent build failure | Passed | Passed |
The instructions your model reads when the skill loads.
This skill provides expert guidance for Azure Pipelines. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.
IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g.,
L35-L120), useread_filewith the specified lines. For categories with file links (e.g.,[security.md](security.md)), useread_fileon the linked reference file
IMPORTANT for Agent: If
metadata.generated_atis more than 3 months old, suggest the user pull the latest version from the repository. Ifmcp_microsoftdocstools are not available, suggest the user install it: Installation Guide
This skill requires network access to fetch documentation content:
mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.| Category | Lines | Description |
|---|---|---|
| Troubleshooting | L37-L48 | Diagnosing and fixing Azure Pipelines issues: service connections (ARM/workload identity), code coverage, logs, web app deployments, triggers, and runs that fail to start or complete. |
| Best Practices | L49-L60 | Guidance on YAML template design, caching for faster builds, cross-platform scripts, and best practices for configuring, parallelizing, and stabilizing automated tests (including UI and VSTest). |
| Decision Making | L61-L68 | Guidance on choosing GitHub-hosted agents, and safely migrating or replacing pipelines and tasks (from Jenkins, Classic pipelines, or retiring tasks) in Azure Pipelines. |
| Architecture & Design Patterns | L69-L76 | Designing end-to-end CI/CD architectures and patterns for Azure Web Apps and IaaS/VM-based applications, including baseline pipelines, DevTest/DevOps environments, and deployment topologies. |
| Limits & Quotas | L77-L86 | Managing Azure Pipelines limits: hosted agent quotas and deprecation, parallel jobs and concurrency, large package size constraints, and run retention configuration. |
| Security | L87-L135 | Securing Azure Pipelines: auth for agents and service connections, secrets/Key Vault, permissions and approvals, artifact/repo protection, policy/compliance checks, and secure YAML practices. |
| Configuration | L136-L505 | Configuring Azure Pipelines: agents, triggers, variables, environments, YAML schema, deployment strategies, and detailed task/step settings for building, testing, and deploying. |
| Integrations & Coding Patterns | L506-L534 | Patterns for building/testing apps (ASP.NET, .NET, Java, Python, Ruby, Xcode), integrating tools (Slack, ServiceNow, Jenkins, Key Vault), and scripting/REST/Function automation in pipelines. |
| Deployment | L535-L589 | Deploying apps and packages with Azure Pipelines: configuring agents, containers, artifacts, classic releases, databases, and Kubernetes/VM/web app deployments. |
test cases passed, vs 9 / 17 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.