▸case-01 Please conduct a balanced peer review of my research paper abstract on climate resilient wheat strains, highlighting both the strongest arguments and the areas needing improvement for submission to Nature Plants: [Abstract: 'We identified three candidate genes conferring drought tolerance in Triticum aestivum using CRISPR-Cas9 genome editing. Field trials demonstrated a 15% yield increase under severe water restriction compared to wild-type controls. Further study is required to evaluate grain quality attributes under heat stress conditions.'] | pass→fail | 20,849 | 23,091 | +11% | 1 | 1 | 0% | 2,267 | 3,111 | +37% | 0 | 0 | — |
▸case-02 Rewrite this landing page headline and subdeck for a corporate SaaS product to make it more persuasive, engaging, and clear for enterprise buyers: [Original: 'Our software aggregates security logs from multiple cloud environments into one dashboard. It uses machine learning to alert teams about unusual access events.'] | pass→fail | 22,246 | 20,025 | -10% | 1 | 1 | 0% | 1,889 | 3,243 | +72% | 0 | 0 | — |
▸case-03 Proofread this customer support response email for spelling, grammar, and punctuation errors: [Text: 'Dear customer, Thank you for contacting us regarding your recent order #4920. We apologize for the delay in shipment, your item have been dispatched yesterday and should arrive by thursday.'] | pass→fail | 12,627 | 15,118 | +20% | 1 | 1 | 0% | 1,157 | 2,471 | +114% | 0 | 0 | — |
▸case-04 Here is the text for my startup's investor pitch deck targeting angel investors for a $500k seed round: [Draft text: 'We are building an AI calendar that automatically reschedules missed meetings based on user priority scores. Our target market is busy executives. We currently have 50 beta users and zero revenue.']. Please evaluate this strictly for flaws and weaknesses—skip all compliments or positive feedback. Categorize the issues by severity levels, explain the real-world consequence of each flaw, and suggest a direct solution for every single one. Also highlight which issue I should tackle first. Please be brutal. Note that our $29/month subscription price point is fixed and off-limits for critique. | pass→pass | 29,410 | 23,822 | -19% | 1 | 1 | 0% | 3,188 | 3,644 | +14% | 0 | 0 | — |
▸case-05 I need a strict critique of this backend microservice migration plan before submitting it to our CTO for enterprise sign-off: [Migration plan summary: 'We will split the legacy monolith into 12 microservices at once over a single weekend maintenance window using AWS Lambda and DynamoDB. Data backfill will happen asynchronously post-deployment.']. Point out all the potential failure points and errors without any flattering introductory text. Organize the flaws into major, moderate, and minor categories, describing the operational impact and providing an actionable remedy for each point. Identify the one critical item that needs fixing before anything else. Use a firm-but-kind tone. Note: Selecting AWS as our cloud vendor is non-negotiable, so don't critique that choice. | pass→pass | 28,521 | 22,481 | -21% | 1 | 1 | 0% | 3,199 | 3,488 | +9% | 0 | 0 | — |
▸case-06 Please dismantle this cold outreach email intended for VPs of Engineering to book software demos: [Email text: 'Hi, I saw your company is growing fast. Our platform helps developers write tests faster using machine learning. Would you be open to a 30-minute chat next Tuesday? Best, Alex.']. I want only the flaws, mistakes, and weak points—no polite opening lines or soft praise. Group the problems into serious concerns down to minor nitpicks. For every weakness found, explain the specific risk or loss in response rate it causes, provide a direct fix, and state the top-priority change I should make first. Be as brutal as possible. The subject line 'Quick question about testing' is already set in stone, so skip critiquing the subject line. | pass→pass | 39,819 | 13,678 | -66% | 1 | 1 | 0% | 3,849 | 3,028 | -21% | 0 | 0 | — |
▸case-07 Evaluate this software architecture design document for an e-commerce payment gateway: [Summary: 'We use a single MySQL relational database for transactional history, session state, and product catalog. All API requests route through a single node Express server without load balancing.'] The audience is enterprise security auditors. Do not soften your assessment with encouragement, and do not critique the decision to use Express.js as the API framework. | pass→pass | 26,486 | 22,229 | -16% | 1 | 1 | 0% | 2,400 | 3,017 | +26% | 0 | 0 | — |
▸case-08 Point out every flaw in this mobile app launch strategy targeting Gen Z users: [Strategy: 'We will launch exclusively via email newsletters and LinkedIn posts. We plan to spend $10,000 on print advertisements in business journals.'] Target audience is young mobile users. Skip any complimentary intro. Categorize flaws by how dangerous they are to launch success, state the impact of each, and provide a direct fix for every flaw. Do not critique the total $10,000 marketing budget amount. | pass→pass | 24,563 | 17,260 | -30% | 1 | 1 | 0% | 2,073 | 2,627 | +27% | 0 | 0 | — |
▸case-09 Critique the weaknesses in this non-compete clause for a senior software engineer in California: [Clause: 'Employee agrees not to work for any technology company worldwide for 5 years post-termination. Company reserves right to modify terms unilaterally at any time.'] Target outcome is enforceable employee retention. Point out only errors and vulnerabilities, categorized by risk severity, with consequences and fixes for each. Do not critique the 5-year duration limit because executive management insists on keeping it. | fail→pass | 26,663 | 20,399 | -23% | 1 | 1 | 0% | 2,981 | 3,077 | +3% | 0 | 0 | — |
▸case-10 Identify all vulnerabilities and gaps in this incident response procedure for a regional bank: [Procedure: 'When ransomware is detected, the on-duty analyst emails the IT manager and waits for written approval before taking affected servers offline. All incident logs are stored on the local desktop of the analyst.'] Audience is the Chief Information Security Officer. Skip all positive framing. Provide severity rankings, real-world consequences, direct fixes, and highlight the single most critical fix. Note: Storing logs locally on the analyst's machine is a temporary hardware constraint and must not be critiqued. | pass→pass | 22,777 | 132,845 | +483% | 1 | 1 | 0% | 2,811 | 2,677 | -5% | 0 | 0 | — |
▸case-11 Review this summary of an NIH grant proposal for medical imaging research: [Summary: 'We propose developing a novel ultrasound sensor without preliminary pilot data or control group comparisons. We aim to cure pancreatic cancer within 12 months with a team of two graduate students.'] Target audience is NIH review committee. Exclusively list flaws grouped by severity, detailing why each causes grant rejection and how to fix it. Name the single most urgent fix. Do not critique the 12-month timeframe parameter. | pass→pass | 22,513 | 17,825 | -21% | 1 | 1 | 0% | 2,693 | 2,650 | -2% | 0 | 0 | — |
▸case-12 Examine this CI/CD deployment pipeline configuration for a high-traffic media site: [Pipeline design: 'Code merged to main branch automatically triggers immediate production deployment without unit tests, integration tests, or staging environment verification. Rollback is executed manually via database restores.'] Audience is the VP of Infrastructure. Give only negative findings ranked by operational risk, explaining consequences and fixes. Highlight the top priority change. Do not critique manual rollbacks as that process is mandated by company policy. | pass→pass | 41,858 | 29,689 | -29% | 1 | 1 | 0% | 2,427 | 3,281 | +35% | 0 | 0 | — |
▸case-13 Point out all weak points in this B2B enterprise software sales pitch deck: [Pitch summary: 'Slide 1: Company history (20 minutes). Slide 2: Feature list (40 slides). Slide 3: Pricing schedule. No customer case studies, ROI metrics, or security certifications are included.'] Audience is Fortune 500 Chief Procurement Officers. Provide a strict critique with no polite padding. Categorize flaws by severity level, detail the lost sales consequences, and attach remedies. Do not critique starting with company history as sales leadership requires it. | pass→pass | 41,212 | 23,504 | -43% | 1 | 1 | 0% | 4,007 | 3,594 | -10% | 0 | 0 | — |
▸case-14 Critique this emergency room patient triage workflow summary for a busy urban hospital: [Workflow: 'Patients arriving with severe chest pain are asked to fill out a 10-page paper history form in the waiting room before receiving vital sign measurements or nursing evaluation.'] Target audience is hospital quality assurance directors. Report exclusively on weaknesses categorized by patient risk level, giving consequences and solutions for each, plus the top priority fix. Do not critique the paper form medium as digital tablets are currently unavailable. | pass→pass | 24,881 | 26,543 | +7% | 1 | 1 | 0% | 3,052 | 3,176 | +4% | 0 | 0 | — |
▸case-15 Dismantle this resume executive summary written for a Senior Data Scientist position at a tech giant: [Text: 'Hardworking self-starter with passion for data. Proficient in Microsoft Excel and basic computer skills. Looking for a challenging role to learn machine learning on the job.'] Target audience is principal engineering recruiters. Provide only critiques grouped by severity, explaining why each hurts interview callbacks and how to correct it. Identify the key fix needed first. Do not critique mentioning Microsoft Excel. | pass→pass | 18,159 | 19,892 | +10% | 1 | 1 | 0% | 1,977 | 2,634 | +33% | 0 | 0 | — |
▸case-16 Highlight every flaw in this database query optimization plan for a reporting dashboard: [Plan: 'We execute SELECT * FROM order_items without index usage or WHERE clauses on every page load, then filter 5 million rows in frontend JavaScript memory.'] Audience is lead database administrators. Return pure critique without softening phrases. Rank issues by performance severity, explain real-world system impacts, and prescribe fixes for each. Do not critique using JavaScript for frontend rendering. | fail→pass | 44,954 | 29,264 | -35% | 1 | 1 | 0% | 3,579 | 3,342 | -7% | 0 | 0 | — |
▸case-17 Point out all errors in this automated customer onboarding email campaign: [Campaign structure: 'Email 1 (Day 1): 5,000-word feature manual. Email 2 (Day 2): Request for immediate annual contract renewal. Email 3 (Day 3): Discount offer if they didn't buy yesterday. No welcome or orientation email is sent.'] Audience is VP of Growth. List only weaknesses ranked by severity, with revenue impacts and fixes for each. Do not critique sending Email 2 on Day 2. | pass→pass | 44,306 | 46,714 | +5% | 1 | 1 | 0% | 2,501 | 2,923 | +17% | 0 | 0 | — |
▸case-18 Critique this annual financial budget proposal for a mid-sized manufacturing firm: [Budget summary: 'Projected revenue growth is set at 400% despite flat historical sales. Zero budget allocated for raw material cost inflation or equipment maintenance.'] Audience is Board of Directors CFO. Give pure critique categorized by financial severity, detailing consequences and recommended fixes. Identify the single most critical correction. Do not critique the 400% revenue growth target. | pass→fail | 13,675 | 13,792 | +1% | 1 | 1 | 0% | 2,018 | 2,464 | +22% | 0 | 0 | — |
▸case-19 Examine this user onboarding flow for a mobile banking application: [Flow summary: 'New users must verify email, upload government ID, answer 25 personal background questions, and setup 3-factor authentication before seeing the main screen or balance.'] Target audience is Product Design Manager. Give only weaknesses categorized by user drop-off severity, describing conversion consequences and concrete design fixes. Do not critique requiring government ID verification. | fail→pass | 18,154 | 20,487 | +13% | 1 | 1 | 0% | 2,374 | 3,377 | +42% | 0 | 0 | — |
▸case-20 Point out flaws in this interview script outline for a tech news podcast episode: [Outline: '0-15m: Host reads sponsor ads. 15-45m: Host talks about personal vacation without introducing guest. 45-50m: Guest answers one rapid question. 50-60m: Outro and sponsor ads.'] Target audience is podcast producer. Provide a critique-only report categorized by listener retention severity, detailing impact and fixes. Do not critique the 15-minute length of host sponsor reading. | pass→pass | 18,637 | 22,903 | +23% | 1 | 1 | 0% | 2,439 | 3,498 | +43% | 0 | 0 | — |
▸case-21 Evaluate the weak points in this public API rate limiting architecture: [Design: 'API keys are validated by querying a remote relational database on every HTTP request. Rate limit state is stored in temporary local variables on individual server instances behind a round-robin DNS load balancer.'] Audience is Principal API Architect. Provide only ranked flaws, system failure consequences, and explicit fixes. Identify the top priority fix. Do not critique using round-robin DNS. | pass→pass | 19,533 | 15,281 | -22% | 1 | 1 | 0% | 3,167 | 3,027 | -4% | 0 | 0 | — |
▸case-22 Dismantle this annual HR performance review process draft: [Draft: 'Performance reviews occur once every two years. Feedback is anonymous with no specific examples allowed. Rating scale is binary pass/fail without compensation tie-in or career growth planning.'] Target audience is VP of Human Resources. List only weaknesses organized by employee turnover risk severity, describing organizational impact and solutions. Do not critique the biannual timing interval. | pass→pass | 13,625 | 18,298 | +34% | 1 | 1 | 0% | 2,116 | 2,993 | +41% | 0 | 0 | — |
▸case-23 Find all mistakes in this fine dining restaurant menu layout draft: [Layout: 'Menu contains 120 items across 12 pages in unreadable script font without prices or allergen indicators. High-margin signature dishes are buried on page 9.'] Target audience is restaurant general manager. Deliver pure critique categorized by operational and sales severity, detailing consequences and fixes. Do not critique using script font. | fail→pass | 18,588 | 17,761 | -4% | 1 | 1 | 0% | 2,166 | 3,363 | +55% | 0 | 0 | — |
▸case-24 Critique this enterprise IT disaster recovery strategy document: [Strategy: 'Data backups are performed monthly onto unencrypted external hard drives kept in the IT manager's desk drawer. System recovery test is scheduled once per decade.'] Target audience is Chief Risk Officer. Provide ranked weaknesses, real-world data loss consequences, and fixes for each point. Highlight the top priority change. Do not critique monthly backup frequency. | pass→pass | 22,757 | 11,070 | -51% | 1 | 1 | 0% | 3,277 | 2,340 | -29% | 0 | 0 | — |