▸case-01 Can you generate a formal standard operating procedure for our Quality Assurance team under GMP compliance regarding sterile equipment calibration? Here are the details: Process Title is 'SOP-QA-042: Autoclave Weekly Sterilization and Calibration', Department is Quality Assurance & Sterilization, and the process involves inspecting gaskets, running a biological indicator test cycle at 121°C for 20 minutes, recording pressure and temperature logs, and tagging approved units. Roles involved are Sterilization Technician and QA Manager. Tools used include the Digital Autoclave Master Unit, Biological Indicator Ampoules, and Calibration Logbook. Please structure it with the full compliance header, scope details, role responsibility matrix, step-by-step procedure table, quality checks, non-conformance handling, and document history. | fail→pass | 31,233 | 24,008 | -23% | 1 | 1 | 0% | 5,099 | 4,603 | -10% | 0 | 0 | — |
▸case-02 I need an ISO 9001 and FCA compliant SOP written for our Risk & Compliance department. The title should be 'SOP-FIN-105: High-Risk Customer Enhanced Due Diligence'. The workflow requires a Compliance Analyst to flag accounts over $100k, pull sanctions databases and PEP lists, request proof of source of funds, draft an evaluation report, and submit it to the Compliance Director for final approval. Software used: World-Check, LexisNexis Risk Solution, and Core Banking Portal. Format the response as a complete operational standard operating procedure including document control metadata, purpose, definitions table, tool requirements, clear single-action procedure steps, failure criteria, non-conformance protocols, and version history. | fail→pass | 44,491 | 24,611 | -45% | 1 | 1 | 0% | 7,082 | 4,647 | -34% | 0 | 0 | — |
▸case-03 Please draft an audit-ready standard operating procedure for cloud infrastructure access provisioning under ISO 27001 standards. The document title is 'SOP-IT-018: Production AWS IAM Provisioning' for the IT Infrastructure Department. The process involves receiving an approved Jira ticket, verifying manager sign-off, creating the IAM user with least-privilege policy tags, enabling mandatory hardware MFA, sending credentials via secure channel, and logging the ticket completion. Roles are IT Support Specialist and Security Officer. Tools include AWS Management Console, Okta Security Platform, and Jira Service Desk. Provide the output following a formal SOP layout with metadata section, explicit scope exclusions, responsible matrix, step-by-step action table, quality control checkpoints, deviation management, and document history. | fail→pass | 37,864 | 36,671 | -3% | 1 | 1 | 0% | 5,912 | 5,849 | -1% | 0 | 0 | — |
▸case-04 Draft an enterprise Information Security Policy document for Acme Corp covering data classification, password standards, and acceptable use under ISO 27001 governance. We need high-level organizational principles and governance rules rather than step-by-step execution procedures. | pass→fail | 36,252 | 20,808 | -43% | 1 | 1 | 0% | 5,400 | 3,938 | -27% | 0 | 0 | — |
▸case-05 Write a Root Cause Analysis (RCA) post-mortem incident report for an outage on the payment gateway portal (Incident INC-8821). Include problem summary, root cause breakdown, timeline of events, and corrective action recommendations for the infrastructure team. | pass→pass | 22,828 | 26,652 | +17% | 1 | 1 | 0% | 2,904 | 4,600 | +58% | 0 | 0 | — |
▸case-06 Create a formal Job Description and Competency Matrix for a Senior Quality Assurance Auditor role in a GMP-regulated pharmaceutical facility, outlining primary responsibilities, required certifications, and key performance indicators (KPIs). | pass→pass | 27,278 | 25,765 | -6% | 1 | 1 | 0% | 3,614 | 3,675 | +2% | 0 | 0 | — |
▸case-07 Write a formal SOP titled 'SOP-QA-012: Finished Product Batch Release' for the Quality Assurance department under GMP rules. The process involves reviewing batch record documents, inspecting sample retain logs, verifying Certificate of Analysis results, signing release certificates, and archiving records. Roles: QA Specialist, Qualified Person. Tools: SAP ERP, LIMS. We often summarize steps into multi-action paragraphs like 'Review records and sign off', so make sure this is structured for audit readiness. | fail→fail | 32,164 | 28,523 | -11% | 1 | 1 | 0% | 5,420 | 5,212 | -4% | 0 | 0 | — |
▸case-08 Produce an operational SOP titled 'SOP-MFG-204: Cleanroom Ultrasonic Bath Maintenance' for Manufacturing Engineering under ISO 13485 compliance. Process: drain fluid, scrub reservoir, fill with DI water, add cleaning agent, run sonication test, record conductivity. Roles: Maintenance Tech, Cleanroom Supervisor. Tools: Sonitron Ultrasonic Cleaner, Oakton Conductivity Meter. Include metadata and quality checkpoints. Ensure the step commands do not use passive voice, even though operational guides often say 'the tank should be drained'. | fail→pass | 39,168 | 23,684 | -40% | 1 | 1 | 0% | 5,749 | 4,848 | -16% | 0 | 0 | — |
▸case-09 Draft an SOP titled 'SOP-LAB-005: Clinical Blood Sample Accessioning' for the Pathology Lab under CQC healthcare standards. The process requires receiving blood vials, verifying patient barcodes, checking refrigeration temperatures, logging receipts into LIMS, and placing samples in storage racks. Staff: Accessioning Technician, Lab Supervisor. Equipment: Barcode Scanner, LIMS Portal, TempTale Monitor. Include scope boundaries and non-conformance steps. | fail→pass | 34,860 | 34,092 | -2% | 1 | 1 | 0% | 5,082 | 5,302 | +4% | 0 | 0 | — |
▸case-10 Create an SOP titled 'SOP-COMP-002: Institutional Client KYC Verification' for Risk Management under FCA regulations. The workflow: receive onboarding request, collect corporate registry filings, cross-check sanctions registries, complete risk matrix scoring, send approval flag. Roles: KYC Analyst, Head of Compliance. Tools: Companies House API, LexisNexis Bridger. Ensure the purpose statement is concise and the procedure avoids combining multiple actions into single steps. | fail→pass | 15,340 | 19,556 | +27% | 1 | 1 | 0% | 3,173 | 4,566 | +44% | 0 | 0 | — |
▸case-11 Write an audit-compliant SOP titled 'SOP-EHS-009: Hazardous Chemical Waste Disposal' for Environmental Health & Safety under ISO 14001 standards. Workflow: label waste drums, weigh containers, generate manifest, notify licensed waste vendor, conduct secondary containment check, sign manifest receipt. Roles: EHS Officer, Facilities Tech. Tools: Mettler Industrial Scale, EHS Portal. Make sure quality checks and deviation protocols are fully populated. | pass→pass | 55,483 | 38,049 | -31% | 1 | 1 | 0% | 8,285 | 6,406 | -23% | 0 | 0 | — |
▸case-12 Produce an SOP titled 'SOP-OPS-033: Production Service Deployment' for DevOps under ISO 27001 controls. Workflow: verify approval in Jira, initiate Blue-Green deployment pipeline in Jenkins, execute smoke tests, switch traffic router, archive deployment log. Roles: Release Engineer, Ops Lead. Tools: Jenkins, AWS Route53, Jira. Be careful not to omit explicit exclusions in the scope or use narrative paragraphs for steps. | fail→pass | 43,816 | 24,238 | -45% | 1 | 1 | 0% | 5,593 | 5,635 | +1% | 0 | 0 | — |
▸case-13 Draft an SOP titled 'SOP-SAN-101: Conveyor Belt CIP Sanitation' for Food Safety Operations under HACCP / ISO 22000 standards. Workflow: pre-rinse belt with warm water, apply foam detergent, scrub belt surface, perform ATP swab testing, record RLU values in log. Roles: Sanitation Tech, QA Inspector. Tools: Hygiena ATP Luminometer, Foam Applicator. Include required tools list and version history. | fail→pass | 34,356 | 29,133 | -15% | 1 | 1 | 0% | 5,556 | 5,241 | -6% | 0 | 0 | — |
▸case-14 Write an SOP titled 'SOP-BIO-004: Cryopreserved Mammalian Cell Thawing' for Cell Therapy Manufacturing under GMP standards. Workflow: retrieve cryovial from liquid nitrogen storage, thaw in 37°C water bath, transfer suspension to centrifuge tube, perform cell count, record viability percentage. Roles: Bioprocess Technician, QC Specialist. Tools: LN2 Storage Dewar, Automated Cell Counter, Biosafety Cabinet. Include metadata control block and definition table. | fail→fail | 57,117 | 30,552 | -47% | 1 | 1 | 0% | 7,716 | 4,779 | -38% | 0 | 0 | — |
▸case-15 Create an SOP titled 'SOP-SEC-015: Data Center Visitor Escort and Badge Issuance' for Physical Security under PCI-DSS Requirement 9. Workflow: verify visitor ID against badge request, issue temporary visitor badge, log entry timestamp, escort visitor to server cage, log exit timestamp, collect badge. Roles: Security Guard, Escort Officer. Tools: Physical Access Control System (PACS), Visitor Logbook. Maintain audit readiness with non-conformance procedures. | fail→pass | 34,691 | 31,189 | -10% | 1 | 1 | 0% | 6,168 | 5,347 | -13% | 0 | 0 | — |
▸case-16 Draft an SOP titled 'SOP-MAINT-077: Hydraulic Actuator Visual Inspection' for Aviation Maintenance under FAA Part 145 certification. Workflow: clean actuator housing, inspect seals for fluid leakage, check mounting bolt torque, apply anti-corrosion coating, stamp maintenance log. Roles: Avionics Tech, Quality Inspector. Tools: Calibrated Torque Wrench, Borescope. Ensure active voice imperative wording for all maintenance tasks. | fail→pass | 21,068 | 23,666 | +12% | 1 | 1 | 0% | 3,850 | 4,151 | +8% | 0 | 0 | — |
▸case-17 Write an SOP titled 'SOP-LOG-052: Cold Chain Temperature Monitoring during Transport' for Logistics & Supply Chain under Good Distribution Practice (GDP). Workflow: activate temperature data logger, place logger in insulated shipper, seal shipping box with tamper-evident tape, verify transit log upon receipt, download logger data, file trip report. Roles: Logistics Specialist, Cold Chain Inspector. Tools: ELPRO Temperature Logger, Cold Chain Monitoring Software. Ensure exact header fields and responsibility assignments. | fail→pass | 26,327 | 21,223 | -19% | 1 | 1 | 0% | 4,526 | 5,009 | +11% | 0 | 0 | — |
▸case-18 Create an SOP titled 'SOP-AML-301: Suspicious Activity Report (SAR) Filing' for Financial Crime Compliance under FinCEN regulatory guidelines. Workflow: review AML alert escalation, investigate transaction history, compile supporting evidence package, draft SAR narrative, submit SAR via BSA E-Filing System, archive filing record. Roles: AML Analyst, AML Officer. Tools: BSA E-Filing System, AML Transaction Monitoring System. Ensure single-action steps and quality verification table. | fail→pass | 39,804 | 27,486 | -31% | 1 | 1 | 0% | 6,154 | 6,522 | +6% | 0 | 0 | — |
▸case-19 Draft an SOP titled 'SOP-CAL-008: Gravimetric Micro-Pipette Calibration' for Metrology & Testing under ISO/IEC 17025 accreditation. Workflow: dispense deionized water onto analytical balance, record mass readings across 10 replicates, calculate mean volume and inaccuracy percentage, affix calibration pass sticker, upload data to LIMS. Roles: Metrology Technician, Quality Manager. Tools: Mettler Toledo Microbalance, Distilled Water, LIMS. Include non-conformance response steps. | fail→fail | 53,778 | 22,456 | -58% | 1 | 1 | 0% | 8,298 | 5,351 | -36% | 0 | 0 | — |
▸case-20 Write an SOP titled 'SOP-EHS-104: High-Pressure Steam Valve Lockout/Tagout' for Plant Operations under OSHA 1910.147 standards. Workflow: notify affected operators, isolate primary steam valve, apply safety padlock and tag, bleed residual pressure, verify zero energy state with pressure gauge. Roles: Authorized LOTO Operator, Safety Supervisor. Tools: LOTO Padlock Kit, Pressure Gauge, Tagout Register. Ensure imperative voice and clear definitions table. | fail→pass | 24,046 | 21,914 | -9% | 1 | 1 | 0% | 3,784 | 5,059 | +34% | 0 | 0 | — |
▸case-21 Produce an SOP titled 'SOP-ENV-019: Drinking Water Chlorination Dosing Adjustment' for Water Treatment Operations under EPA Safe Drinking Water Act rules. Workflow: measure free chlorine residual at outlet, calculate required sodium hypochlorite dosage, adjust dosing pump stroke rate, wait 30 minutes, measure secondary chlorine level, log final reading. Roles: Water Treatment Operator, Water Quality Specialist. Tools: Hach Colorimeter, Sodium Hypochlorite Dosing System, Water Logbook. Include definitions and tools list. | fail→fail | 33,785 | 21,367 | -37% | 1 | 1 | 0% | 6,191 | 5,082 | -18% | 0 | 0 | — |
▸case-22 Draft an SOP titled 'SOP-FAB-055: Silicon Wafer Plasma Etching' for Semiconductor Fabrication under ISO 9001 certification. Workflow: load wafer cassette into loadlock, select etching recipe 4B, initiate vacuum pumpdown, run plasma etch cycle, unload processed wafers, measure step height with profilometer. Roles: Process Engineer, Fab Technician. Tools: Reactive Ion Etcher, Stylus Profilometer. Ensure document history and quality check table are included. | fail→pass | 49,170 | 29,250 | -41% | 1 | 1 | 0% | 7,502 | 5,390 | -28% | 0 | 0 | — |