▸case-01 Here is an email I received from our client Sarah: 'Hey Alex! Quick check-in on the Q3 roadmap—are we still on track for Tuesday's kickoff? Let me know if anything shifted! Thanks 😊'
Relationship: Long-time client.
Goal: Let her know we need to push kickoff to Thursday, and ask her to send over the updated design files by Wednesday afternoon.
Can you help me craft a response? First, break down her tone and style across formality, length, directness, and warmth signals. Then draft a response that mirrors her register while clearly delivering my message. Also provide slight adjustments—one a bit warmer and one a bit more formal—and note if an intentional register mismatch should be used here. | fail→fail | 14,205 | 13,268 | -7% | 1 | 1 | 0% | 1,910 | 2,465 | +29% | 0 | 0 | — |
▸case-02 My director sent me this message:
'Need the revised Q4 budget breakdown by end of day. Please ensure all vendor line items are reconciled.'
Relationship: My direct manager (VP of Operations).
Goal: Confirm receipt and EOD delivery, clarify that Q4 marketing spend will be capped at $50k, and ask if he wants a 10-minute briefing tomorrow morning.
I want to reply using a register-matched approach. Please analyze the incoming email's profile (formality, directness, length, and presence of friendly markers), produce a matched reply fulfilling my goals, and supply alternative knob options (a notch warmer and a notch more formal). Flag if a deliberate style mismatch is warranted. | fail→fail | 17,381 | 13,527 | -22% | 1 | 1 | 0% | 2,071 | 2,521 | +22% | 0 | 0 | — |
▸case-03 I received this email from an unknown vendor:
'Dear Team, I hope this email finds you well. I am reaching out to schedule a brief 15-minute demonstration of our enterprise analytics platform next week. Would Tuesday at 10 AM EST work for your calendar?'
Relationship: First-time cold outreach.
Goal: Decline the demo request politely, clarifying that we are not evaluating new analytics vendors this quarter.
Evaluate the sender's register across formality, message length, directness, and warmth cues. Draft a response that matches their baseline tone while communicating the rejection. Also give me adjusted options for slightly warmer and slightly more formal tones, and indicate if an intentional tone mismatch is recommended for setting boundaries. | fail→fail | 15,230 | 9,514 | -38% | 1 | 1 | 0% | 1,877 | 2,381 | +27% | 0 | 0 | — |
▸case-18 I need to write an initial outbound cold email to invite local tech founders to our upcoming AI networking mixer next Thursday at 6 PM. The tone should be welcoming and professional, highlighting free drinks and expert panel discussions. Please write the email. | pass→fail | 14,305 | 18,570 | +30% | 1 | 1 | 0% | 1,610 | 2,882 | +79% | 0 | 0 | — |
▸case-04 Incoming email from Partner Marcus: 'Please review the attached contract amendment for the joint venture before end of day. Confirm if the liability terms match our initial discussion.'
Relationship: Business Partner.
Goal: Confirm liability terms match and state that legal signed off.
Draft a register-matched response following standard reply analysis structure. | fail→pass | 11,152 | 13,011 | +17% | 1 | 1 | 0% | 1,057 | 2,105 | +99% | 0 | 0 | — |
▸case-05 Incoming email from CTO Dan: 'Is the v2 API migration on schedule for Friday? Yes or no.'
Relationship: Executive colleague.
Goal: Inform him that migration is delayed to Monday due to database indexing issues.
Provide a tone-analyzed reply. | fail→pass | 14,980 | 12,621 | -16% | 1 | 1 | 0% | 1,424 | 2,048 | +44% | 0 | 0 | — |
▸case-06 Incoming email from Account Director Elena: 'Hope you had a wonderful weekend! How was your trip to the mountains? Quick question—do you have the updated slide deck for the Q3 pitch?'
Relationship: Peer colleague.
Goal: Let her know the deck is attached and offer to review slides 4-6 together.
Craft a register-matched reply. | pass→pass | 9,414 | 6,427 | -32% | 1 | 1 | 0% | 784 | 1,958 | +150% | 0 | 0 | — |
▸case-07 Incoming email from client Dave: 'Yo! Drop whatever you are doing and build me a custom payment export button right now man. Need it in 10 mins!!'
Relationship: Software client on standard monthly retainer.
Goal: Reject immediate custom request, explain out-of-scope work requires a formal ticket, and maintain professional boundary.
Generate a response analysis and draft. | pass→pass | 16,145 | 15,391 | -5% | 1 | 1 | 0% | 1,809 | 2,501 | +38% | 0 | 0 | — |
▸case-08 Incoming email from client CFO: 'Hey buddy! Yeah finance is still looking at that invoice, no worries!'
Relationship: Account past due 90 days.
Goal: Inform them that services will be suspended on Friday if payment is not settled immediately.
Draft the appropriate response and register analysis. | pass→pass | 17,843 | 16,856 | -6% | 1 | 1 | 0% | 1,751 | 2,851 | +63% | 0 | 0 | — |
▸case-09 Incoming email from Manager Rita: 'Can u send me the Q2 repot by 3pm today? Thx!'
Relationship: Manager.
Goal: Confirm report will be sent by 3pm.
Draft a register-matched reply. | pass→pass | 8,306 | 5,143 | -38% | 1 | 1 | 0% | 615 | 1,790 | +191% | 0 | 0 | — |
▸case-10 Incoming email from Colleague Tom: 'Got a minute for a quick call on the design specs?'
Relationship: Peer designer.
Goal: Agree to call and share Google Meet link.
Draft a register-matched reply. | fail→pass | 7,986 | 11,401 | +43% | 1 | 1 | 0% | 462 | 1,871 | +305% | 0 | 0 | — |
▸case-11 Incoming email from Client Project Lead Karen: 'I wanted to follow up on our discussion regarding the platform architecture migration. We reviewed the preliminary security audit and noticed three primary areas of concern: data encryption at rest, third-party vendor integrations, and role-based access control granularity. For encryption, we need confirmation on AES-256 implementation across all database instances. For third-party integrations, we require an updated list of compliance certifications. Lastly, for RBAC, our security team wants to review the user permission matrix before sign-off. Please let us know your timeline for providing these items.'
Relationship: Key Enterprise Client.
Goal: Confirm AES-256 is active, attach compliance docs, and commit to providing the RBAC matrix by Thursday.
Draft a response matching sender investment. | pass→pass | 8,323 | 14,613 | +76% | 1 | 1 | 0% | 1,321 | 2,521 | +91% | 0 | 0 | — |
▸case-12 Incoming email from unknown contact 'Sam': 'Yo bro, love your tool! Can I get a free enterprise key to test out?'
Relationship: Stranger / First contact.
Goal: Decline free enterprise license, point to standard free trial on website.
Draft a tone-matched response. | fail→pass | 12,591 | 13,253 | +5% | 1 | 1 | 0% | 1,046 | 2,149 | +105% | 0 | 0 | — |
▸case-13 Incoming email from Vendor Account Manager Laura: 'Dear Team, We are pleased to announce our annual partner summit taking place in Chicago this October. Early bird registration opens next Monday. Please confirm if your organization plans to send delegates.'
Relationship: Vendor partner.
Goal: Thank her and state that 2 team members will attend.
Provide tone analysis and response. | fail→pass | 5,283 | 14,007 | +165% | 1 | 1 | 0% | 879 | 2,101 | +139% | 0 | 0 | — |
▸case-14 Incoming email from Client Liaison Beth: 'Hey! Any chance we can squeeze in two extra custom reporting dashboards before Friday's launch without changing the scope fee? Thanks so much! 😊'
Relationship: Client.
Goal: State a firm 'No' — additional dashboards require a formal change order and additional fee.
Draft the response with register matching. | pass→pass | 8,857 | 16,321 | +84% | 1 | 1 | 0% | 1,298 | 2,627 | +102% | 0 | 0 | — |
▸case-15 Incoming email from Engineering Lead Ben: 'Hey team, server maintenance is scheduled for midnight tonight. Let me know if any staging environments need to stay up.'
Relationship: Peer lead.
Goal: Request that staging environment 'Staging-B' remain active.
Draft reply and knob variants. | fail→fail | 11,801 | 11,524 | -2% | 1 | 1 | 0% | 1,113 | 1,853 | +66% | 0 | 0 | — |
▸case-16 Incoming email from New Department Lead Dr. Vance: 'Hello, please submit your team's quarterly OKR achievements by Wednesday close of business.'
Relationship: New senior manager.
Goal: Confirm delivery by Wednesday 4pm.
Draft tone-matched response. | fail→pass | 4,214 | 8,672 | +106% | 1 | 1 | 0% | 713 | 2,049 | +187% | 0 | 0 | — |
▸case-17 Incoming email from Customer Specialist Jay: 'Hi! Just following up on ticket #4821—did the customer confirm resolution on their end? Thanks!'
Relationship: Internal colleague.
Goal: Confirm customer verified the fix and ticket can be closed.
Provide register analysis and response. | fail→fail | 10,265 | 11,501 | +12% | 1 | 1 | 0% | 650 | 1,910 | +194% | 0 | 0 | — |
▸case-19 Please review and edit the following draft paragraph for our engineering blog to make it concise and eliminate passive voice:
'It was observed by our reliability team that latency spikes were being caused by unindexed database queries during peak traffic hours. A caching layer was subsequently deployed by the infrastructure team to mitigate this issue.' | pass→fail | 12,137 | 17,417 | +44% | 1 | 1 | 0% | 1,292 | 2,785 | +116% | 0 | 0 | — |
▸case-20 Create an internal post-mortem incident report template for software outages. It should include sections for Incident Summary, Root Cause, Timeline, and Action Items. | pass→fail | 22,884 | 18,020 | -21% | 1 | 1 | 0% | 2,368 | 3,718 | +57% | 0 | 0 | — |
▸case-21 Write a Standard Operating Procedure (SOP) document outlining the step-by-step process for onboarding new software development contractors, covering IT account provisioning, security access requests, and initial repository setup. | pass→pass | 26,345 | 32,429 | +23% | 1 | 1 | 0% | 3,285 | 5,311 | +62% | 0 | 0 | — |
▸case-22 Incoming email: 'Could you review the attached quarterly marketing metrics before our sync tomorrow?'
Goal: Confirm receipt and confirm review will be complete before the sync.
Draft response and register analysis. | fail→fail | 12,587 | 12,418 | -1% | 1 | 1 | 0% | 1,121 | 1,988 | +77% | 0 | 0 | — |
▸case-23 Incoming email from Client Representative Support: 'Good morning. Attached is the quarterly compliance report for your review. Please acknowledge receipt.'
Relationship: Client contact.
Goal: Acknowledge receipt and state review is underway.
Draft tone-matched response. | fail→pass | 10,508 | 12,515 | +19% | 1 | 1 | 0% | 745 | 1,851 | +148% | 0 | 0 | — |
▸case-24 Incoming email from Operations Manager: 'Where is the monthly inventory log?'
Relationship: Operations colleague.
Goal: Inform them the log was uploaded to the shared folder 10 minutes ago.
Draft response with tone breakdown. | fail→pass | 7,549 | 11,853 | +57% | 1 | 1 | 0% | 1,030 | 1,795 | +74% | 0 | 0 | — |