▸case-14 We are proposing a penetration test and web application security audit for PayGuard Financial. We know their target is compliance with PCI-DSS, but we haven't agreed on a test start date or total hourly cap. Draft the proposal. | fail→pass | 15,025 | 20,535 | +37% | 1 | 1 | 0% | 1,691 | 2,764 | +63% | 0 | 0 | — |
▸case-01 I just wrapped up a discovery call with a potential client, Acme Retail, who wants us to overhaul their e-commerce website to boost mobile conversion rates. Here are my raw meeting notes: target launch is Q3, budget around $45k, main pain point is high checkout abandonment on iOS devices. Can you draft a formal business proposal based on this input? Make sure it includes a section framing their problem, our proposed methodology, what is in and out of scope, a phase breakdown for delivery, pricing options, and the immediate next step for them to sign off. | fail→fail | 17,886 | 18,784 | +5% | 1 | 1 | 0% | 3,110 | 3,461 | +11% | 0 | 0 | — |
▸case-02 Can you convert this project brief into a polished client-facing proposal? We are pitching a brand redesign and new design system for a mid-sized SaaS company feeling outdated compared to competitors. We haven't finalized the exact completion date or final rate with the team yet. Please generate a complete proposal containing the problem statement, strategic approach, scope items with clear boundaries on what we won't cover, timeline outline, fee structure, and a single call-to-action. | pass→fail | 17,202 | 20,676 | +20% | 1 | 1 | 0% | 2,511 | 3,446 | +37% | 0 | 0 | — |
▸case-03 We need an internal product requirement document (PRD) for our engineering team detailing the backend API specification for the user authentication microservice. Can you draft the technical spec with functional requirements, acceptance criteria, and edge cases? | pass→pass | 40,952 | 17,932 | -56% | 1 | 1 | 0% | 6,171 | 3,850 | -38% | 0 | 0 | — |
▸case-04 We are launching a new B2B analytics tool next month. Please write high-converting marketing copy for our public landing page, including a catchy hero headline, sub-headline, bullet points highlighting key features, and social proof section. | pass→fail | 15,260 | 19,502 | +28% | 1 | 1 | 0% | 2,517 | 3,787 | +50% | 0 | 0 | — |
▸case-05 Our client accepted our proposal. Now I need a formal legally binding Master Services Agreement (MSA) with standard indemnification clauses, governing law in Delaware, liability cap limits, and intellectual property assignment terms. Please draft this contract. | pass→pass | 22,615 | 18,679 | -17% | 1 | 1 | 0% | 4,652 | 3,806 | -18% | 0 | 0 | — |
▸case-06 Draft a client proposal for Nexus Logistics to migrate their legacy database to PostgreSQL. They mentioned their primary issue is query timeouts during peak hours. We do not have their budget, hourly rate, or start date finalized yet, so feel free to invent realistic numbers like $150/hr and a May 1st start date so the proposal looks complete. | fail→pass | 17,855 | 15,682 | -12% | 1 | 1 | 0% | 3,028 | 3,467 | +14% | 0 | 0 | — |
▸case-07 We are submitting a proposal to Apex Health to build a custom patient intake portal. The client wants a clean proposal focusing on deliverables, timeline, and pricing. Don't worry about detailing negative constraints or what we won't do—just focus on positive deliverables. | fail→fail | 17,894 | 16,480 | -8% | 1 | 1 | 0% | 2,672 | 3,216 | +20% | 0 | 0 | — |
▸case-08 Draft a proposal for Horizon Media for a search engine optimization audit and 6-month campaign. At the end of the proposal, list several options for next steps, such as booking a call, reviewing a slide deck, sending an email, or signing an attached agreement, so they can choose whichever they prefer. | fail→fail | 16,878 | 23,535 | +39% | 1 | 1 | 0% | 2,722 | 3,694 | +36% | 0 | 0 | — |
▸case-09 Create a project proposal for Vortex Cloud to migrate their architecture to Kubernetes. Open the proposal by showcasing our team's 10 years of experience with Cloud Native Computing Foundation technologies and our proprietary deployment scripts, then list our deliverables. | fail→pass | 16,065 | 15,422 | -4% | 1 | 1 | 0% | 2,326 | 2,768 | +19% | 0 | 0 | — |
▸case-10 Draft a proposal for FinTech Global to audit their smart contracts. They gave us their target budget of $30,000, but they haven't given us their desired completion deadline or team availability dates. Please write the proposal with complete scope and pricing. | pass→pass | 20,331 | 15,053 | -26% | 1 | 1 | 0% | 2,930 | 3,070 | +5% | 0 | 0 | — |
▸case-11 We are pitching a mobile app redesign to Urban Motors to increase test-drive bookings. Draft a proposal for them. Make sure the investment section structures the fee around project outcomes and value rather than just a raw list of billable developer hours. | fail→fail | 18,222 | 16,320 | -10% | 1 | 1 | 0% | 2,663 | 3,087 | +16% | 0 | 0 | — |
▸case-12 Prepare a client proposal for DataFlow Inc. to migrate 50 Terabytes of legacy CRM data to Salesforce. They complained that legacy data errors cost them sales reps 10 hours a week. Ensure the proposal clearly demarcates what data cleanup tasks are included and what data sources are strictly excluded. | pass→pass | 23,844 | 17,815 | -25% | 1 | 1 | 0% | 3,742 | 2,939 | -21% | 0 | 0 | — |
▸case-13 Draft a statement of work proposal for CloudScale Systems to re-architect their AWS multi-region setup. Third-party software licensing fees have not been quoted by the vendor yet. Produce the proposal draft. | fail→pass | 16,039 | 17,263 | +8% | 1 | 1 | 0% | 2,755 | 3,453 | +25% | 0 | 0 | — |
▸case-15 Draft a proposal for Orion Tech to deliver a 3-day executive AI literacy workshop for 20 executives. We know the workshop content, but the location and travel expenses are unknown. Create a structured proposal. | fail→fail | 17,950 | 16,008 | -11% | 1 | 1 | 0% | 2,430 | 3,248 | +34% | 0 | 0 | — |
▸case-16 Create a proposal for Global Retail Co. to translate 5,000 product descriptions into Spanish and French. We have fixed rates for text translation, but machine translation post-editing rules for third-party seller listings are not confirmed. Draft the proposal. | fail→fail | 17,262 | 14,139 | -18% | 1 | 1 | 0% | 2,896 | 2,914 | +1% | 0 | 0 | — |
▸case-17 Draft a proposal for SmartGrid Energy to build a real-time IoT monitoring dashboard. The client's pain is that field technicians cannot detect transformer overheating in real time. We haven't finalized the hardware integration rates. Write the proposal. | pass→pass | 19,817 | 18,469 | -7% | 1 | 1 | 0% | 2,756 | 3,411 | +24% | 0 | 0 | — |
▸case-18 Draft a proposal for SaaSify to redesign their user onboarding flow. Their primary metric drop-off is between sign-up and first active project creation. We don't have their target launch date yet. Generate the client proposal. | fail→pass | 24,854 | 14,569 | -41% | 1 | 1 | 0% | 2,750 | 2,929 | +7% | 0 | 0 | — |
▸case-19 Create a proposal for Logistics Express to build an automated freight tracking dashboard. Make sure you don't list any out-of-scope boundaries because we want the document to look encouraging and friendly without any negative constraints. | fail→pass | 16,129 | 18,928 | +17% | 1 | 1 | 0% | 2,215 | 3,034 | +37% | 0 | 0 | — |
▸case-20 Write an annual performance review for Sarah, a Senior Software Engineer on our team, highlighting her achievements in reducing API latency, leadership in mentoring junior devs, and areas for growth in project estimation. | pass→pass | 10,904 | 11,274 | +3% | 1 | 1 | 0% | 1,820 | 2,035 | +12% | 0 | 0 | — |
▸case-21 Draft a statement of work proposal for Beacon Startup Studio for brand identity design. The client gave us their goal of launching a cohesive brand before their Series A round, but we have not agreed on the retainer price or phase 2 timeline. Generate the document. | pass→pass | 17,077 | 17,407 | +2% | 1 | 1 | 0% | 2,391 | 2,926 | +22% | 0 | 0 | — |
▸case-22 Draft a proposal for BioHealth Labs to integrate their electronic health records system with a laboratory portal. Add three next steps at the bottom: 1) Schedule a call with tech lead, 2) Pay initial deposit, and 3) Send legal feedback on terms. | fail→fail | 12,051 | 11,629 | -4% | 1 | 1 | 0% | 1,757 | 2,495 | +42% | 0 | 0 | — |
▸case-23 Create a proposal for SupportHero to implement an AI customer support bot. Their pain is high ticket resolution times on weekends. We have not finalized the monthly maintenance cost. Draft the proposal. | pass→pass | 15,029 | 17,847 | +19% | 1 | 1 | 0% | 2,272 | 2,816 | +24% | 0 | 0 | — |