▸case-01 We received an external client task with an estimated budget and scope outline. Please provide a step-by-step checklist explaining whether this can be sent directly to production or if specific CSO sign-off and verification steps are needed first. | fail→pass | 12,176 | 14,270 | +17% | 1 | 1 | 0% | 1,963 | 1,193 | -39% | 0 | 0 | — |
▸case-02 Our team completed work on a client deliverable, but we are unsure if all stated specifications have been verified. Outline the protocol for verifying quality and determining when a task can officially be marked as delivered and settled. | fail→pass | 15,119 | 6,024 | -60% | 1 | 1 | 0% | 2,307 | 1,082 | -53% | 0 | 0 | — |
▸case-03 A client's project scope is changing midway through execution due to technical constraints. Provide a structured guide detailing how sales management should handle task status communications, timeline updates, and contract records. | fail→pass | 17,902 | 11,654 | -35% | 1 | 1 | 0% | 2,599 | 2,001 | -23% | 0 | 0 | — |
▸case-04 An account manager wants to fast-track an urgent client request sent via direct chat without filling out formal requirement forms, budget allocations, or deliverable definitions. How should this external client request be handled before work begins? | fail→pass | 10,271 | 4,179 | -59% | 1 | 1 | 0% | 1,595 | 817 | -49% | 0 | 0 | — |
▸case-05 An engineering lead suggests bypassing executive sign-off for a high-priority $50,000 client pilot project because the client signed a verbal intent agreement. What contract approval policy must be enforced before work enters production? | fail→pass | 7,861 | 3,059 | -61% | 1 | 1 | 0% | 1,241 | 683 | -45% | 0 | 0 | — |
▸case-11 A client completed payment via on-chain token transfer following a delivered milestone, but the operation lead hasn't logged the transaction in the earnings ledger. What record-keeping rule applies? | pass→pass | 9,680 | 2,770 | -71% | 1 | 1 | 0% | 1,614 | 613 | -62% | 0 | 0 | — |
▸case-06 A developer suggests delivering a partially finished software feature to an external client now and fixing remaining requirement gaps in a later patch to hit the end-of-month deadline. What delivery protocol must be followed? | pass→pass | 11,812 | 4,504 | -62% | 1 | 1 | 0% | 1,797 | 850 | -53% | 0 | 0 | — |
▸case-07 After completing a major milestone for an enterprise client, the finance team asks how earned compensation in digital settlement tokens should be managed once delivery is confirmed. What accounting procedure must be maintained? | fail→pass | 11,871 | 2,507 | -79% | 1 | 1 | 0% | 1,937 | 565 | -71% | 0 | 0 | — |
▸case-08 Mid-project telemetry shows an integration task will take two extra weeks due to third-party API rate limits. The project lead suggests staying silent until the original deadline passes. How should this situation be handled with the client? | pass→pass | 11,682 | 6,875 | -41% | 1 | 1 | 0% | 1,748 | 1,174 | -33% | 0 | 0 | — |
▸case-09 A client submits a fixed-budget proposal of $10,000 for a complex custom AI workflow. The sales associate wants to accept it immediately to hit quarterly sales quotas. What specific evaluation steps are mandatory prior to approving production? | fail→pass | 15,577 | 5,828 | -63% | 1 | 1 | 0% | 2,422 | 1,095 | -55% | 0 | 0 | — |
▸case-10 A prospective enterprise client submits an email task request with a defined budget and target date, but leaves deliverable specifications vague. Should the team initiate production prep? Explain the required submission standard. | pass→pass | 10,843 | 5,118 | -53% | 1 | 1 | 0% | 1,750 | 989 | -43% | 0 | 0 | — |
▸case-12 A client-facing project manager wants to mark an external analytics dashboard task as delivered because internal testing passed, even though one requested client filter feature was omitted. Is this permissible? | pass→pass | 12,015 | 4,137 | -66% | 1 | 1 | 0% | 1,874 | 835 | -55% | 0 | 0 | — |
▸case-13 During a web development sprint, an external client requests adding a custom payment gateway not in the original contract. The developer agrees to code it immediately. What policy workflow was missed? | fail→pass | 8,492 | 4,469 | -47% | 1 | 1 | 0% | 1,342 | 894 | -33% | 0 | 0 | — |
▸case-14 A partner firm emails an urgent data processing task directly to an engineer with an attached purchase order. The engineer prepares to deploy the script. What initial step must be taken first? | pass→pass | 7,664 | 2,862 | -63% | 1 | 1 | 0% | 1,120 | 649 | -42% | 0 | 0 | — |
▸case-15 A high-value sales lead demands a 48-hour delivery timeline for a custom protocol integration. The technical team assesses the true work effort as 100 hours. How should the CSO handle contract review? | fail→pass | 16,605 | 11,220 | -32% | 1 | 1 | 0% | 2,478 | 1,886 | -24% | 0 | 0 | — |
▸case-16 An operations team has logged earned token balances from three delivered client projects over the last six months without initiating settlement actions. What principle does this violate? | pass→pass | 8,590 | 2,656 | -69% | 1 | 1 | 0% | 1,233 | 545 | -56% | 0 | 0 | — |
▸case-17 An external project is running smoothly and on schedule, but the client hasn't received any progress reports in three weeks. The account executive believes updates are unnecessary unless problems arise. Evaluate this strategy. | pass→pass | 12,689 | 7,797 | -39% | 1 | 1 | 0% | 1,834 | 1,302 | -29% | 0 | 0 | — |
▸case-18 An account executive receives a signed contract and client deposit, but the CSO is out of office for two days. The client asks to start coding immediately. Can production commence? | fail→pass | 11,058 | 3,218 | -71% | 1 | 1 | 0% | 1,634 | 707 | -57% | 0 | 0 | — |
▸case-19 A client requests early release of a research report before data validation is complete, offering to sign an interim waiver. What delivery rule applies? | pass→pass | 9,176 | 5,082 | -45% | 1 | 1 | 0% | 1,356 | 962 | -29% | 0 | 0 | — |
▸case-20 Our internal devops team is planning a backend database index refactoring task that affects no client-facing contracts or external deliverables. Outline the required pull request review and code deployment checklist for this internal code maintenance. | pass→fail | 16,448 | 10,130 | -38% | 1 | 1 | 0% | 2,502 | 1,763 | -30% | 0 | 0 | — |
▸case-21 The board of directors is drafting an executive stock option vesting schedule for the incoming Chief Operating Officer. Provide recommendations on cliff periods and performance-based vesting structures. | pass→pass | 17,710 | 11,758 | -34% | 1 | 1 | 0% | 2,867 | 1,959 | -32% | 0 | 0 | — |
▸case-22 Our corporate finance team needs to deploy surplus USDT reserves from company treasury into low-risk DeFi yield protocols to earn interest on excess cash balance. What risk management framework should guide treasury yield allocation? | pass→pass | 18,206 | 13,018 | -28% | 1 | 1 | 0% | 2,865 | 2,162 | -25% | 0 | 0 | — |