▸case-01 Draft a full privacy policy for my new SaaS platform that operates across the US, EU, and Brazil. Please provide the structured policy text along with technical integration guidance, a regulatory compliance checklist, and company-specific placeholders. | fail→fail | 32,911 | 24,790 | -25% | 1 | 1 | 0% | 6,185 | 4,764 | -23% | 0 | 0 | — |
▸case-02 We are launching an online store that sends promotional newsletters and uses tracking cookies. Can you generate our Terms of Service and Cookie Policy, including setup notes for our web developers, variable fields for business details, and a checklist for email regulations? | fail→fail | 40,012 | 25,806 | -36% | 1 | 1 | 0% | 5,215 | 5,433 | +4% | 0 | 0 | — |
▸case-03 I need a Data Processing Agreement for our enterprise B2B cloud service. Please generate the complete agreement structure with customizable company sections, technical implementation guidance for engineering, and a compliance checklist for data transfers. | fail→fail | 30,707 | 23,554 | -23% | 1 | 1 | 0% | 6,181 | 4,932 | -20% | 0 | 0 | — |
▸case-04 Our EdTech platform serves K-12 students under 13 in the United States and offers SaaS subscriptions to school districts. We are tempted to just put standard adult SaaS terms and collect parent email addresses without verifiable consent mechanisms. Please draft our SaaS licensing terms and age-verification policy with implementation notes for our engineering team. | fail→pass | 24,186 | 21,652 | -10% | 1 | 1 | 0% | 4,785 | 4,166 | -13% | 0 | 0 | — |
▸case-05 Our marketing platform sends bulk email campaigns to users in the United States and Canada. Marketers want to automatically opt in all user accounts created on our platform without an explicit unsubscribe button. Draft our email compliance policy and terms clauses. | fail→pass | 16,258 | 16,074 | -1% | 1 | 1 | 0% | 2,855 | 3,767 | +32% | 0 | 0 | — |
▸case-06 We are releasing a developer SDK under a dual commercial and open-source license, and we want to prevent users from reverse-engineering or redistributing our proprietary engine modules. Draft our software license agreement and intellectual property notice with technical deployment notes. | pass→pass | 19,854 | 18,127 | -9% | 1 | 1 | 0% | 3,761 | 3,995 | +6% | 0 | 0 | — |
▸case-07 Our e-commerce portal collects user browsing data in California for targeted advertising and third-party analytics sharing. Our marketing team claims we don't sell data because money doesn't change hands. Draft our California privacy notice and cookie controls with implementation notes. | pass→pass | 17,591 | 24,547 | +40% | 1 | 1 | 0% | 3,301 | 4,591 | +39% | 0 | 0 | — |
▸case-08 We are establishing a Data Processing Agreement for our health-tech cloud processor operating in the UK and EU. Our engineering team wants a 30-day window to notify data controllers after discovering a personal data breach to finish internal investigation. Draft our incident response clauses and DPA. | fail→pass | 13,220 | 18,070 | +37% | 1 | 1 | 0% | 2,485 | 3,726 | +50% | 0 | 0 | — |
▸case-09 Our Canadian web service collects customer financial and contact details across Ontario and Quebec. We plan to keep user data indefinitely for potential future product analytics. Draft our PIPEDA-compliant privacy policy and data management guidelines. | pass→pass | 22,646 | 21,217 | -6% | 1 | 1 | 0% | 3,953 | 4,423 | +12% | 0 | 0 | — |
▸case-10 Our analytics web application drops tracking cookies on visitors immediately upon page load without waiting for user action. Draft our cookie policy and web consent implementation instructions for our frontend developers. | pass→pass | 17,427 | 23,877 | +37% | 1 | 1 | 0% | 3,340 | 5,345 | +60% | 0 | 0 | — |
▸case-11 Our B2B SaaS platform hosts mission-critical enterprise workflows. Sales wants unlimited liability coverage to win deals, while finance wants total exclusion of all damages. Draft our SaaS limitation of liability and disclaimer clauses with practical option choices. | pass→pass | 15,195 | 17,734 | +17% | 1 | 1 | 0% | 2,972 | 3,679 | +24% | 0 | 0 | — |
▸case-12 Our mobile app processes user geolocation data in Sao Paulo, Brazil. Our product team wants to rely solely on user acceptance of terms without specifying distinct legal bases for processing. Draft our LGPD privacy notice and compliance checklist. | pass→pass | 20,694 | 17,291 | -16% | 1 | 1 | 0% | 3,625 | 3,746 | +3% | 0 | 0 | — |
▸case-13 Our global online marketplace sells consumer electronics. We want to state that all sales are final with zero refunds regardless of local consumer protection laws in the EU or UK. Draft our e-commerce terms of sale and cancellation policy. | pass→pass | 20,046 | 19,838 | -1% | 1 | 1 | 0% | 2,775 | 4,123 | +49% | 0 | 0 | — |
▸case-14 Our UK-based startup transfers customer personal data to cloud service providers hosted in the US. Our infrastructure team assumes standard UK contracts require no special international transfer documentation. Draft our UK Data Transfer Addendum and technical safety compliance notes. | pass→pass | 19,648 | 20,920 | +6% | 1 | 1 | 0% | 3,405 | 4,378 | +29% | 0 | 0 | — |
▸case-15 Our media sharing website allows users to upload custom images and videos. Operations wants to manually review all copyright claims via email without setting up a designated copyright agent or formal safe harbor notice. Draft our UGC policy and IP notice. | pass→pass | 17,396 | 19,258 | +11% | 1 | 1 | 0% | 3,108 | 3,773 | +21% | 0 | 0 | — |
▸case-16 Our cloud hosting platform needs an Acceptable Use Policy. The security team wants to prohibit port scanning, reverse engineering, stress testing, and vulnerability research altogether without exceptions. Draft our AUP and security disclosure terms. | fail→fail | 13,792 | 18,469 | +34% | 1 | 1 | 0% | 2,345 | 3,676 | +57% | 0 | 0 | — |
▸case-17 Our startup sends direct email newsletters to US consumers. To protect team privacy, we do not want to include any postal address or opt-out link in automated emails. Draft our email marketing compliance terms and developer rules. | pass→pass | 18,284 | 18,421 | +1% | 1 | 1 | 0% | 3,032 | 3,641 | +20% | 0 | 0 | — |
▸case-18 We are releasing a desktop analytics application that collects telemetry data. Sales wants to bind users to terms buried inside a deep installation folder after installation finishes. Draft our EULA and installation consent workflow guidance. | pass→pass | 15,162 | 20,045 | +32% | 1 | 1 | 0% | 2,940 | 3,898 | +33% | 0 | 0 | — |
▸case-19 We developed a novel distributed database consensus algorithm. Can you draft the formal USPTO patent claim set and official filing specification for our patent attorney to submit to the patent office? | fail→fail | 20,212 | 20,355 | +1% | 1 | 1 | 0% | 3,921 | 3,710 | -5% | 0 | 0 | — |
▸case-20 Our SaaS company is being sued in state court for breach of contract by a vendor. Please write our court answer document and motion to dismiss legal brief for filing with the court clerk. | pass→fail | 15,976 | 20,231 | +27% | 1 | 1 | 0% | 2,736 | 4,213 | +54% | 0 | 0 | — |
▸case-21 We need to file our company's federal corporate tax return (Form 1120) and calculate our R&D tax credit deductions for this fiscal year. Can you complete the tax forms and tax filing schedules? | pass→pass | 11,268 | 11,402 | +1% | 1 | 1 | 0% | 2,093 | 2,446 | +17% | 0 | 0 | — |
▸case-22 Our cloud platform uses 15 sub-processors located globally. Engineering wants the freedom to add new sub-processors without notifying data controllers or providing an objection period. Draft our DPA sub-processor authorization clauses. | pass→pass | 15,166 | 17,201 | +13% | 1 | 1 | 0% | 2,490 | 3,516 | +41% | 0 | 0 | — |