▸case-01 We recently had confusion around remote work equipment stipends—some employees bought expensive gaming chairs while others weren't sure if secondary monitors were covered. Please draft an internal WFH Equipment Policy for us. Format the document with a main title block (domain, version, owner role) followed by a short explanation of why the policy exists. Write out each policy rule so that every rule explicitly states its underlying rationale and marks whether it is a zero-exception hard boundary or a discretionary zone (identifying decision factors and who decides). Include a dedicated section with 3 to 4 worked edge cases explaining the reasoning behind each answer, a candid enforcement section detailing the actual consequences of non-compliance and who arbitrates edge cases, and end with a standalone one-page summary card containing just the core rules for quick reference. | pass→pass | 76,127 | 33,904 | -55% | 1 | 1 | 0% | 5,599 | 4,766 | -15% | 0 | 0 | — |
▸case-02 Engineers at our company have started using public AI assistants on proprietary codebases without clear guidelines. I need you to draft an internal Generative AI Usage policy. Structure the document to include: a top header detailing the domain, version number, and owner role; a section covering why this policy is being established right now; a rules section where every rule explains the reason behind it and clearly distinguishes strict absolute boundaries from judgment areas (naming the criteria and designated approver); a worked scenarios section answering 3 to 5 realistic questions with explicit step-by-step logic shown; a realistic enforcement section outlining breach consequences and review frequency; and a condensed one-page reference card summarizing the key rules for everyday lookups. | fail→pass | 85,609 | 26,953 | -69% | 1 | 1 | 0% | 6,440 | 5,589 | -13% | 0 | 0 | — |
▸case-03 Our sales team needs a refreshed client gift and travel expense policy following recent confusion about taking prospects to expensive dinners during active contract renewals. Please draft a policy governing client entertainment. The output should feature a standard policy header (domain, version, owner role), a brief section detailing the background ambiguity it resolves, and a clear list of rules where each rule provides its reason and labels whether it is a non-negotiable rule versus a judgment zone (with factors and decision-makers specified). Additionally, include a section resolving realistic edge cases with full reasoning, an honest enforcement section outlining the actual consequence path and gray-case decider, and a final one-page summary card that acts as a fast cheat sheet for sales reps in the field. | fail→pass | 54,186 | 34,035 | -37% | 1 | 1 | 0% | 7,439 | 5,665 | -24% | 0 | 0 | — |
▸case-04 Our finance team is seeing personal charges accidentally placed on corporate cards and disputed charges for lounge access during flight delays. Draft a corporate credit card policy that sets clear rules for cardholders. Make sure to clearly state why each rule exists, separate absolute prohibitions from discretionary spending boundaries with decision criteria and assigned approvers, resolve 3 to 5 real scenarios in detail, explain actual non-compliance consequences and review schedule, and provide a one-page reference card. | fail→pass | 48,212 | 57,275 | +19% | 1 | 1 | 0% | 5,516 | 5,177 | -6% | 0 | 0 | — |
▸case-05 Employees are accessing customer databases from unmanaged personal smartphones after hours. Draft a comprehensive BYOD security policy for mobile devices. Ensure every rule contains an explicit rationale, separate absolute security requirements from discretionary device usages (stating approval factors and responsible manager), include 3 to 5 concrete worked edge cases, detail genuine enforcement consequences and review cadence, and append a one-page summary cheat sheet. | fail→pass | 66,337 | 41,282 | -38% | 1 | 1 | 0% | 8,267 | 5,655 | -32% | 0 | 0 | — |
▸case-06 Engineering and marketing teams are keeping legacy user database backups indefinitely on cloud storage buckets, increasing storage costs and privacy liability. Draft a data retention and deletion policy. Ensure each rule links to its operational or compliance justification, separates strict statutory retention limits from discretionary purge schedules with clear deciders, works through 3 to 5 edge cases, outlines realistic non-compliance consequences and review cycle, and includes a summary card. | fail→fail | 50,001 | 35,760 | -28% | 1 | 1 | 0% | 5,992 | 5,655 | -6% | 0 | 0 | — |
▸case-07 Software developers have raised questions about whether personal side projects built on weekends using company laptops belong to the company. Draft an IP and side project policy. Pair every rule with its underlying legal or business reason, distinguish absolute IP prohibitions from discretionary approval zones with criteria and decider roles, work out 3 to 5 realistic developer scenarios, detail genuine consequences and review cadence, and include a single-page card. | fail→fail | 50,898 | 29,156 | -43% | 1 | 1 | 0% | 7,333 | 4,673 | -36% | 0 | 0 | — |
▸case-08 Procurement is bottlenecked because employees are signing up for SaaS trials using corporate emails without IT security reviews. Draft a vendor security review policy. Every rule must state its risk-reduction reason, distinguish hard review mandates from low-risk discretionary exemptions (naming factors and deciders), work through 3 to 5 realistic software purchase edge cases, define realistic enforcement steps and review frequency, and end with a quick reference card. | fail→fail | 44,848 | 34,186 | -24% | 1 | 1 | 0% | 5,970 | 4,835 | -19% | 0 | 0 | — |
▸case-09 Support staff are sharing credentials for shared administrative portals via unencrypted team chat channels. Draft an authentication and password security policy. Ensure every rule gives its security justification, separates hard security boundaries from discretionary session timeout settings with decision roles, works out 3 to 5 actual edge cases, outlines realistic consequences and review cadence, and ends with a one-page lookup card. | fail→fail | 39,406 | 39,051 | -1% | 1 | 1 | 0% | 5,409 | 5,499 | +2% | 0 | 0 | — |
▸case-10 Employees are working remotely from foreign countries for months at a time, creating unexpected corporate tax and compliance liabilities. Draft an international remote work location policy. Ensure every rule provides its tax/legal justification, distinguishes hard stay-duration limits from discretionary extensions (stating factors and decider), works through 3 to 5 location scenarios, outlines honest consequences and review cadence, and includes a summary reference card. | fail→pass | 154,729 | 34,976 | -77% | 1 | 1 | 0% | 7,792 | 5,079 | -35% | 0 | 0 | — |
▸case-11 Engineering documentation on the company wiki is stale, orphaned, or duplicated across multiple spaces. Draft an internal documentation governance policy. Ensure every rule includes its maintenance rationale, separates strict deprecation rules from discretionary review schedules with decider roles, works through 3 to 5 documentation edge cases, specifies realistic enforcement and review frequency, and provides a quick-consult summary card. | fail→fail | 47,989 | 30,141 | -37% | 1 | 1 | 0% | 5,037 | 4,943 | -2% | 0 | 0 | — |
▸case-12 Employees are using broad notification handles like `@channel` in large non-emergency channels, causing widespread distraction. Draft an internal messaging and communication policy. Ensure every rule carries its productivity justification, distinguishes non-negotiable channel guidelines from discretionary broadcast approvals with criteria and decider roles, works 3 to 5 edge cases, details actual enforcement and review cadence, and provides a summary card. | pass→pass | 51,015 | 23,673 | -54% | 1 | 1 | 0% | 6,884 | 4,690 | -32% | 0 | 0 | — |
▸case-13 Developers want to contribute patches back to open source libraries used in production but lack clarity on licensing and approval requirements. Draft an open source contribution policy. Ensure every rule explicitly gives its IP/security rationale, separates clear license boundaries from discretionary review paths with factors and deciders, resolves 3 to 5 realistic pull request edge cases, details honest enforcement and review schedule, and includes a summary card. | fail→fail | 63,445 | 26,715 | -58% | 1 | 1 | 0% | 6,594 | 5,016 | -24% | 0 | 0 | — |
▸case-14 Recruiting is facing disputes over referral bonus payouts when multiple employees refer the same candidate or when candidates re-apply. Draft an employee referral policy. Include reasons for every rule, separate hard eligibility rules from discretionary bonus splitting guidelines (listing factors and decider), work through 3 to 5 referral edge cases, outline honest enforcement and review frequency, and provide a one-page summary card. | pass→fail | 42,220 | 27,165 | -36% | 1 | 1 | 0% | 5,798 | 5,358 | -8% | 0 | 0 | — |
▸case-15 Employees are discussing unreleased company products on personal social media accounts, causing leaks. Draft a social media and public statement policy. Ensure every rule includes its reputation/security reason, separates absolute non-disclosure lines from discretionary post approvals with criteria and deciders, works 3 to 5 social media edge cases, details real enforcement steps and review frequency, and includes a summary card. | pass→pass | 51,822 | 33,304 | -36% | 1 | 1 | 0% | 6,853 | 4,811 | -30% | 0 | 0 | — |
▸case-16 Engineering team members are burnt out from unpredictable off-hours incident pages and unclear compensation for weekend rotations. Draft an on-call compensation and rest policy. Require reasons for each rule, separate mandatory minimum rest periods from flexible shift swaps with factors and deciders, resolve 3 to 5 incident edge cases, outline realistic enforcement and review cycle, and append a one-page lookup card. | pass→pass | 60,645 | 28,013 | -54% | 1 | 1 | 0% | 8,266 | 4,768 | -42% | 0 | 0 | — |
▸case-17 Employees are requesting travel budget for international conferences without demonstrating clear business value or team knowledge sharing. Draft a conference attendance policy. Provide reasons for all rules, separate fixed spending caps from discretionary travel approvals with criteria and deciders, work 3 to 5 travel edge cases, detail genuine enforcement and review schedule, and include a summary card. | pass→pass | 40,369 | 26,724 | -34% | 1 | 1 | 0% | 5,994 | 5,002 | -17% | 0 | 0 | — |
▸case-18 Non-exempt hourly staff are logging unapproved overtime hours while responding to emails outside of scheduled shifts. Draft a timekeeping and overtime pre-approval policy. Ensure every rule includes its compliance reason, separates non-negotiable pre-approval rules from discretionary overtime requests with factors and deciders, works 3 to 5 time tracking edge cases, details honest enforcement and review cadence, and provides a quick-reference card. | pass→pass | 38,718 | 25,388 | -34% | 1 | 1 | 0% | 6,469 | 5,198 | -20% | 0 | 0 | — |
▸case-19 Site reliability engineering team members skip quarterly disaster recovery failover exercises due to fear of disrupting production traffic. Draft a disaster recovery testing policy. Ensure every rule carries its resilience reason, separates mandatory simulation schedules from discretionary test postponements with factors and deciders, works 3 to 5 testing edge cases, details realistic enforcement and review frequency, and includes a summary card. | fail→fail | 35,987 | 32,576 | -9% | 1 | 1 | 0% | 5,672 | 5,466 | -4% | 0 | 0 | — |
▸case-20 IT security discovered that departing employees retained access to SaaS tools for weeks after their termination dates. Draft an offboarding access revocation policy. Include reasons for every rule, separate strict immediate deprovisioning timelines from discretionary temporary access extensions with criteria and deciders, work 3 to 5 offboarding edge cases, outline honest enforcement and review schedule, and include a summary card. | fail→fail | 44,812 | 29,330 | -35% | 1 | 1 | 0% | 6,062 | 5,060 | -17% | 0 | 0 | — |
▸case-21 A manager brought us a specific formal complaint alleging workplace harassment between two sales representatives during an offsite meeting. Conduct the formal HR investigation, interview the witnesses, weigh the evidence, and issue a binding disciplinary finding for this specific case. | pass→pass | 12,490 | 25,498 | +104% | 1 | 1 | 0% | 1,883 | 5,015 | +166% | 0 | 0 | — |
▸case-22 We need to hire a Senior Software Engineer in California immediately. Draft a binding, legally enforceable California employment agreement contract including non-compete clauses, specific salary numbers, severance payout terms, and formal legal signature blocks. | pass→fail | 17,528 | 26,414 | +51% | 1 | 1 | 0% | 1,960 | 4,776 | +144% | 0 | 0 | — |
▸case-23 An employee has missed three consecutive client deadlines and failed a performance improvement plan. Draft their immediate official termination letter, outline their severance package calculation, and handle the formal HR firing execution process for this employee. | pass→fail | 19,180 | 29,018 | +51% | 1 | 1 | 0% | 3,241 | 4,946 | +53% | 0 | 0 | — |