▸case-01 I am launching a cloud-based analytics platform that serves users across Europe and California. Could you draft a comprehensive privacy policy template for our web application? Please format the document with structured headers, brackets for company-specific variables, a technical setup guide for developer implementation, and an associated regulatory compliance checklist. Ensure it covers essential data subject rights and includes necessary standard advisory disclaimers at the end. | fail→pass | 30,730 | 37,861 | +23% | 1 | 1 | 0% | 6,220 | 5,426 | -13% | 0 | 0 | — |
▸case-02 Our company provides a B2B SaaS platform and we need a standard Data Processing Agreement (DPA) for our enterprise clients. Please generate a complete contract draft with placeholders for enterprise details, technical implementation instructions for data handling, and a framework checklist for GDPR and CCPA alignment. Make sure to append the required legal template notice. | fail→fail | 30,675 | 35,640 | +16% | 1 | 1 | 0% | 5,813 | 5,161 | -11% | 0 | 0 | — |
▸case-03 We are setting up an international online storefront targeting US and UK consumers. We need a draft for our website terms of service along with a cookie policy. Please provide the structured policy text with business variable placeholders, technical integration notes for consent banners, and a regulatory compliance checklist, ending with the appropriate informational usage notice. | pass→pass | 29,604 | 23,244 | -21% | 1 | 1 | 0% | 6,203 | 5,032 | -19% | 0 | 0 | — |
▸case-04 We are releasing a mobile gaming application designed for kids under 13 in the United States. We need a privacy policy covering COPPA requirements. You might think a generic privacy policy is enough, but we need verifiable parental consent mechanics outlined clearly along with technical developer notes and a COPPA compliance checklist. | pass→pass | 26,680 | 27,657 | +4% | 1 | 1 | 0% | 4,848 | 5,270 | +9% | 0 | 0 | — |
▸case-05 Our marketing team is setting up automated promotional email campaigns across the US. Draft an email marketing compliance guide and footer policy template. Base models usually just list general tips, but we require specific CAN-SPAM mandatory requirements like physical postal address mandates, technical opt-out header specifications, and a compliance checklist. | pass→pass | 19,114 | 21,854 | +14% | 1 | 1 | 0% | 3,666 | 4,359 | +19% | 0 | 0 | — |
▸case-06 We are implementing a web consent management platform for European Union visitors. Base models often suggest implicit scroll consent, but under the ePrivacy Directive and GDPR we need strict explicit prior consent provisions. Provide a legal policy clause draft, technical implementation notes for blocking non-essential scripts, and a compliance checklist. | pass→pass | 20,529 | 23,629 | +15% | 1 | 1 | 0% | 3,816 | 4,175 | +9% | 0 | 0 | — |
▸case-07 Our web service is expanding operations into Brazil and collecting personal data from Brazilian residents. Draft a dedicated LGPD compliance addendum for our privacy policy. While models typically default to standard GDPR copy, ensure this explicitly addresses LGPD legal bases, Data Protection Officer contact details, technical logging notes, and an LGPD checklist. | pass→pass | 17,891 | 18,928 | +6% | 1 | 1 | 0% | 3,384 | 4,198 | +24% | 0 | 0 | — |
▸case-08 We are releasing a desktop application with cloud synchronization capabilities. Draft an End User License Agreement (EULA). Standard models usually write brief software terms, but we need comprehensive clauses on license scope, limitation of liability, intellectual property reservation, technical enforcement notes, and a compliance checklist. | pass→pass | 29,672 | 25,046 | -16% | 1 | 1 | 0% | 5,480 | 5,129 | -6% | 0 | 0 | — |
▸case-09 Our e-commerce store handles transactions for Canadian customers. Generate a PIPEDA privacy schedule. Models often lump Canada into generic global templates; ensure this explicitly addresses PIPEDA's 10 Fair Information Principles, mandatory breach notification rules, technical logging requirements, and a PIPEDA checklist. | pass→pass | 29,928 | 27,815 | -7% | 1 | 1 | 0% | 5,204 | 5,852 | +12% | 0 | 0 | — |
▸case-10 We operate a direct-to-consumer e-commerce storefront selling electronic goods in North America. Draft our Terms of Sale and refund policy disclaimers. Many assistants draft informal return policies; we require formal disclaimers of implied warranties, statutory consumer rights preservation, technical checkout integration notes, and a compliance checklist. | pass→pass | 28,984 | 30,235 | +4% | 1 | 1 | 0% | 5,528 | 5,804 | +5% | 0 | 0 | — |
▸case-11 We are running commercial email outreach to prospective corporate clients in Canada. Draft a CASL compliance policy schedule. Do not just supply CAN-SPAM rules; explicitly enforce CASL's strict opt-in consent requirements, distinction between express and implied consent, technical consent logging notes, and a CASL checklist. | pass→pass | 22,978 | 25,432 | +11% | 1 | 1 | 0% | 4,401 | 5,051 | +15% | 0 | 0 | — |
▸case-12 Our digital publishing platform hosts user-generated media content in the US. Draft an Intellectual Property and DMCA Safe Harbor Notice clause. Generic prompts yield basic copyright notices; we need exact statutory DMCA takedown procedure steps, designation of copyright agent details, technical submission requirements, and a compliance checklist. | pass→pass | 26,421 | 20,025 | -24% | 1 | 1 | 0% | 5,201 | 4,286 | -18% | 0 | 0 | — |
▸case-13 We need a robust Governing Law, Jurisdiction, and Dispute Resolution section for a cross-border SaaS agreement. Provide a complete clause including binding arbitration options, class action waivers, technical implementation notes for clickwrap acceptance, and a dispute clause checklist. | pass→pass | 18,101 | 21,482 | +19% | 1 | 1 | 0% | 3,586 | 4,316 | +20% | 0 | 0 | — |
▸case-14 Our web application collects personal information from California residents and utilizes third-party ad trackers. Draft a CCPA/CPRA Notice of Right to Opt-Out of Sale/Sharing. Provide the exact policy text, technical banner integration requirements for 'Do Not Sell or Share My Personal Information', and a CPRA compliance checklist. | pass→pass | 20,885 | 20,464 | -2% | 1 | 1 | 0% | 4,196 | 4,432 | +6% | 0 | 0 | — |
▸case-15 Draft a Subprocessor Authorization and Notification schedule for a B2B SaaS Data Processing Agreement under GDPR. Base model outputs often lack exact timeline procedures; require advance written notice mechanisms, customer objection rights timelines, technical subprocessor registry management, and a DPA checklist. | pass→pass | 23,677 | 26,816 | +13% | 1 | 1 | 0% | 3,528 | 5,177 | +47% | 0 | 0 | — |
▸case-16 Our commercial SaaS product bundles third-party software components licensed under Apache 2.0, MIT, and GPL v3. Draft an Open Source Software Legal Disclosure and Compliance Policy. Models usually provide generic licensing summaries; give us exact notice display rules, copyleft isolation requirements, developer compliance setup notes, and a review checklist. | pass→pass | 28,552 | 22,025 | -23% | 1 | 1 | 0% | 4,892 | 4,351 | -11% | 0 | 0 | — |
▸case-17 Draft a detailed Data Retention and Disposal Policy clause for a cloud database service subject to GDPR Article 5(1)(e) storage limitation rules. Provide structured retention periods by data category, technical secure erasure notes, and a regulatory verification checklist. | pass→pass | 19,907 | 20,759 | +4% | 1 | 1 | 0% | 3,431 | 3,557 | +4% | 0 | 0 | — |
▸case-18 We are preparing our customer trust package for enterprise clients. Draft a Data Security Incident Notification clause for our cloud service agreement under GDPR Article 33/34 and state breach notification laws. Specify exact notification timelines, technical log preservation guidelines, and a breach response checklist. | pass→pass | 17,445 | 20,300 | +16% | 1 | 1 | 0% | 3,035 | 4,212 | +39% | 0 | 0 | — |
▸case-19 We need a comprehensive Limitation of Liability and Legal Disclaimer section for an automated AI legal document generator tool. Include waiver of consequential damages, total liability caps, technical disclaimers regarding automated output, and a risk allocation compliance checklist. | pass→pass | 17,519 | 18,470 | +5% | 1 | 1 | 0% | 3,234 | 3,957 | +22% | 0 | 0 | — |
▸case-20 We are currently in active litigation in California State Superior Court regarding a breach of contract suit. Draft an official formal Motion to Dismiss and legal memorandum of points and authorities for immediate filing with the court clerk. | pass→fail | 13,664 | 15,048 | +10% | 1 | 1 | 0% | 2,604 | 3,468 | +33% | 0 | 0 | — |
▸case-21 We have invented a new physical mechanical gear transmission mechanism for electric vehicles. Draft a set of formal patent claims (independent and dependent) suitable for filing with the US Patent and Trademark Office (USPTO). | fail→fail | 16,742 | 14,966 | -11% | 1 | 1 | 0% | 2,759 | 3,136 | +14% | 0 | 0 | — |
▸case-22 Our startup operates in three states. Prepare our state corporate income tax schedules and calculate our specific tax liability line items for our Form 1120 tax submission to the IRS. | fail→pass | 13,418 | 4,901 | -63% | 1 | 1 | 0% | 2,494 | 1,153 | -54% | 0 | 0 | — |