▸case-01 I need a complete standard operating procedure for our monthly Employee Offboarding workflow so our new HR coordinator can handle it independently. Here are my raw notes:
- Process: Employee Offboarding
- Roles: HR Specialist (runs it), IT Admin, Department Manager
- Frequency: Event-triggered / End of month batch
- Systems: Workday, Jira Service Desk, Slack
- Known issue: Remote employees delaying laptop returns
- Workflow: HR triggers offboarding ticket in Workday -> IT revokes system permissions -> Manager conducts exit survey -> HR mails shipping box for equipment.
Please generate a full process doc containing the overview header, purpose, scope boundaries, prerequisites checklist, roles matrix, detailed step-by-step guidance (including tools and expected outputs per step), an exception handling table, frequent mistakes, and escalation contacts. | fail→fail | 44,459 | 34,423 | -23% | 1 | 1 | 0% | 6,271 | 4,735 | -24% | 0 | 0 | — |
▸case-02 Can you map out a clear process guide for our weekly Database Backup Verification? An entry-level SysAdmin should be able to follow this without guidance. Details:
- Owner: IT Infrastructure Team
- Frequency: Every Monday at 8 AM
- Tools: AWS Management Console, Slack, Datadog
- Steps: SysAdmin logs into AWS -> checks snapshot health in Datadog -> runs test restore script on staging server -> posts status summary in #ops-alerts.
- Edge Case: Backup integrity check fails or snapshot is missing.
Structure the output as a formal process document with purpose, scope (in/out), prerequisites, role responsibilities table, numbered action steps specifying who/when/how/tools/outputs, edge case action table, common pitfalls, and escalation path. | fail→pass | 34,886 | 31,763 | -9% | 1 | 1 | 0% | 4,964 | 4,689 | -6% | 0 | 0 | — |
▸case-03 We need to document our Vendor Invoice Approval workflow for incoming accounts payable tasks. Here are the details:
- Name: Vendor Invoice Processing
- Lead: AP Clerk (runs daily)
- Systems: SAP Concur, Corporate Email, Excel
- Sequence: AP Clerk receives invoice via email -> verifies line items against PO in SAP -> forwards to Finance Manager if over $5k -> schedules payment batch once approved.
- Exceptions: Invoice doesn't match PO, or vendor isn't registered.
Please organize these notes into a standard workflow document featuring an executive summary header, clear prerequisites, defined scope, roles and responsibilities matrix, sequential step breakdowns with tool assignments, an edge case table with resolution steps, common errors to avoid, and escalation tiers. | fail→fail | 29,941 | 23,604 | -21% | 1 | 1 | 0% | 3,460 | 4,122 | +19% | 0 | 0 | — |
▸case-08 Document our weekly Production Code Release workflow for entry-level DevOps engineers. The engineering VP wants us to write down our ideal future automated CI/CD state where tests run in 5 seconds without manual approvals, even though right now engineers manually verify staging deployments and run smoke tests taking 45 minutes. Owner: Release Manager. Tools: GitHub Actions, Datadog, Slack. | fail→fail | 28,184 | 24,035 | -15% | 1 | 1 | 0% | 3,804 | 3,899 | +2% | 0 | 0 | — |
▸case-04 Generate a valid BPMN 2.0 XML file representing an automated invoice approval workflow containing a start event, a service task for database lookup, a user task for manager approval, and an end event. | pass→pass | 31,145 | 21,959 | -29% | 1 | 1 | 0% | 4,154 | 4,298 | +3% | 0 | 0 | — |
▸case-05 Calculate the process cycle efficiency and Takt time for a manufacturing assembly line that operates 480 minutes per day with a daily demand of 120 units, where total value-add time across steps is 24 minutes and total lead time is 120 minutes. | pass→pass | 11,152 | 14,347 | +29% | 1 | 1 | 0% | 1,118 | 1,987 | +78% | 0 | 0 | — |
▸case-06 Write an OpenAPI 3.0 YAML specification for a REST API endpoint GET /api/v1/users that returns a JSON list of user objects with id, name, and email attributes. | pass→pass | 11,477 | 14,421 | +26% | 1 | 1 | 0% | 1,314 | 2,010 | +53% | 0 | 0 | — |
▸case-07 Create a process guide for our Tier 1 Customer Support Ticket Triage workflow. Our support team receives 200 Zendesk tickets daily. The lead wants a RACI matrix and custom headers like 'Secondary Escalation Tier' instead of simple arrows for escalations. Notes: Owner is Support Lead, runs continuously, uses Zendesk and Slack. Step 1: Rep reviews incoming ticket in Zendesk. Step 2: Rep assigns priority label based on SLA. Step 3: Rep routes ticket to specialized queue. Edge case: Ticket contains credit card details. | fail→fail | 32,029 | 29,445 | -8% | 1 | 1 | 0% | 3,665 | 4,123 | +12% | 0 | 0 | — |
▸case-21 Draft a process document for Third-Party Contract Legal Review. Lead: Corporate Counsel. Frequency: Event-triggered, takes 3 days. Systems: Ironclad, DocuSign. The user wants to leave out edge cases since legal disputes are handled ad-hoc. | fail→pass | 15,634 | 18,089 | +16% | 1 | 1 | 0% | 1,990 | 3,710 | +86% | 0 | 0 | — |
▸case-09 We need a process document for Monthly Payroll Processing executed by the Payroll Specialist using Workday and Quickbooks. Should we just write 'the team handles discrepancies' when errors occur? Notes: Runs monthly on the 25th, takes 4 hours. Steps: Collect timesheets -> Calculate deductions -> Run direct deposit batch -> Send paystubs. | fail→pass | 20,211 | 17,340 | -14% | 1 | 1 | 0% | 2,474 | 3,446 | +39% | 0 | 0 | — |
▸case-10 Draft a process doc for Cloud Sev-1 Incident Escalation. The incident commander asked to skip edge cases because major incidents are unpredictable and don't follow tables. Owner: Site Reliability Lead. Frequency: Event-triggered. Tools: PagerDuty, Zoom, AWS CloudWatch. | fail→pass | 12,854 | 23,287 | +81% | 1 | 1 | 0% | 2,090 | 3,280 | +57% | 0 | 0 | — |
▸case-11 Write process documentation for our Quarterly User Access Rights Review. Provide a general overview format without specific step outputs or tool breakdown lists since auditors just need a general summary. Lead: Security Compliance Analyst. Frequency: Quarterly. Systems: Okta, Jira, Google Workspace. | fail→pass | 24,037 | 19,150 | -20% | 1 | 1 | 0% | 2,306 | 3,002 | +30% | 0 | 0 | — |
▸case-12 Create a process workflow document for Linux Server Patching performed bi-weekly by Systems Engineers using Ansible and Red Hat Satellite. The supervisor requested omitting the escalation path since engineers should handle all server failures on their own. | fail→pass | 126,822 | 28,256 | -78% | 1 | 1 | 0% | 3,747 | 3,751 | +0% | 0 | 0 | — |
▸case-13 Map out our Enterprise Customer Onboarding process. The CS Lead handles it for newly signed accounts, taking 2 weeks. Systems: Salesforce, Hubspot, Catalyst CS. The team thinks writing a review date is unnecessary for standard CS workflows. | fail→pass | 24,355 | 26,582 | +9% | 1 | 1 | 0% | 3,141 | 3,578 | +14% | 0 | 0 | — |
▸case-14 Document the Inventory Stock Reordering process for Warehouse Operations. Run weekly by Inventory Coordinator using NetSuite and Slack. Please structure steps as paragraph narrative blocks without standard sub-bullet labels like Who, When, How, Output, or Tool. | fail→fail | 17,725 | 25,312 | +43% | 1 | 1 | 0% | 1,473 | 3,785 | +157% | 0 | 0 | — |
▸case-15 Draft process documentation for Critical Vulnerability Remediation. Run event-triggered by SecOps Analyst using Tenable, Jira, and Slack. Edge cases: Patch breaks production service or patch requires server reboot. Duration is 4 hours. | fail→fail | 20,602 | 12,827 | -38% | 1 | 1 | 0% | 3,473 | 2,794 | -20% | 0 | 0 | — |
▸case-16 Provide process documentation for Blog Content Publishing managed by Content Marketing Manager. Frequency: Twice weekly. Tools: WordPress, Grammarly, Notion. The manager suggested listing prerequisites in a paragraph summary instead of checklist format. | fail→fail | 18,559 | 20,664 | +11% | 1 | 1 | 0% | 2,363 | 4,178 | +77% | 0 | 0 | — |
▸case-17 Document the Daily ETL Pipeline Recovery process executed by Data Engineer. Runs daily upon alert trigger using Airflow, Snowflake, and PagerDuty. The team prefers a custom table with 'Trigger Condition' and 'Remediation Step' for exceptions. | fail→pass | 20,602 | 25,883 | +26% | 1 | 1 | 0% | 2,840 | 4,182 | +47% | 0 | 0 | — |
▸case-18 Create process documentation for New Hire Laptop Provisioning executed by IT Support Specialist. Frequency: Event-triggered. Tools: Jamf, ServiceNow, Slack. Duration: 2 hours. Note: Skip common mistakes as our IT team never makes errors. | fail→pass | 14,642 | 20,019 | +37% | 1 | 1 | 0% | 2,461 | 3,591 | +46% | 0 | 0 | — |
▸case-19 Map out the Financial Month-End Close process for Accounting Manager. Runs monthly taking 3 business days. Systems: NetSuite, Excel, BlackLine. Note: The manager requested omitting scope boundaries as all accounting activities are implicitly in scope. | fail→pass | 29,018 | 24,379 | -16% | 1 | 1 | 0% | 3,826 | 4,630 | +21% | 0 | 0 | — |
▸case-20 Document the Emergency Production Rollback process for On-Call SRE. Frequency: Event-triggered. Tools: ArgoCD, Kubernetes, PagerDuty. Duration: 30 minutes. Please present step ownership implicitly within narrative paragraphs. | fail→fail | 18,218 | 19,547 | +7% | 1 | 1 | 0% | 2,165 | 4,003 | +85% | 0 | 0 | — |
▸case-22 Document the Annual Disaster Recovery Failover Drill process for Lead Infrastructure Architect. Frequency: Annually. Tools: AWS Route53, Terraform, Datadog. Duration: 8 hours. Note: Omit escalation path because the Lead Architect is the highest technical authority. | fail→pass | 24,917 | 36,558 | +47% | 1 | 1 | 0% | 4,311 | 5,957 | +38% | 0 | 0 | — |