▸case-01 Can you compile a daily news briefing for our executive team on major developments in semiconductor supply chains over the past day? We need a high-level summary upfront, followed by cited source updates, strategic implications for hardware procurement, and specific future events or triggers we should keep an eye on. | fail→fail | 16,501 | 38,624 | +134% | 1 | 1 | 0% | 2,368 | 5,306 | +124% | 0 | 0 | — |
▸case-02 I need a daily intelligence digest covering European energy market shifts for financial analysts. Please include today's date and cutoff time, summarize the top events with links to primary sources, outline the operational implications, and list key threshold events to monitor next. | fail→fail | 15,905 | 10,022 | -37% | 1 | 1 | 0% | 2,443 | 770 | -68% | 0 | 0 | — |
▸case-03 Please draft a daily summary of recent global cybersecurity policy updates for our risk management committee. Format it with an executive summary at the top, followed by verified primary updates, potential risk implications, and specific triggers or dates to watch moving forward. | fail→fail | 15,277 | 18,434 | +21% | 1 | 1 | 0% | 2,096 | 1,025 | -51% | 0 | 0 | — |
▸case-04 We need an immediate real-time flash alert sent out to on-duty security staff about an active, unconfirmed report of an operational disruption at our logistics hub right now. Should this follow our daily intelligence brief format with cutoff times, ranked implications, and watch triggers? | pass→pass | 10,317 | 10,403 | +1% | 1 | 1 | 0% | 1,468 | 1,684 | +15% | 0 | 0 | — |
▸case-05 Our strategy division is authoring a 50-page quarterly macroeconomic whitepaper analyzing monetary policy shifts over the last five years. Does this long-form research report need to adhere to the daily intelligence brief workflow with daily cutoff windows and watch triggers? | fail→fail | 12,401 | 15,907 | +28% | 1 | 1 | 0% | 1,956 | 1,751 | -10% | 0 | 0 | — |
▸case-06 Our marketing department is drafting an official corporate press release announcing the commercial launch of our new enterprise cloud software. Should this announcement be structured using daily intelligence briefing formats like cutoff times and impact ranking? | pass→pass | 13,605 | 10,421 | -23% | 1 | 1 | 0% | 1,977 | 1,655 | -16% | 0 | 0 | — |
▸case-07 We are preparing a daily update on central bank interest rate developments for our treasury desk. We have two candidate leads: a brand-new blog post speculating on next year's rate cuts, and a major unpredicted 50-basis-point rate change announced 12 hours ago by the ECB. Our desk editor suggests putting the blog post first because it was published 10 minutes ago. How should we order these developments in our briefing? | pass→pass | 11,565 | 9,327 | -19% | 1 | 1 | 0% | 1,680 | 1,693 | +1% | 0 | 0 | — |
▸case-08 An anonymous social media post claims that a major lithium supplier has filed for bankruptcy, causing a 5% spike in spot prices, but no regulatory filing or official statement exists yet. Should we report this bankruptcy filing as a confirmed event in today's battery materials intelligence briefing? | pass→pass | 11,716 | 6,310 | -46% | 1 | 1 | 0% | 1,731 | 1,219 | -30% | 0 | 0 | — |
▸case-09 A major port strike in Rotterdam occurred ten days ago and was covered last week. However, backlogged container vessel delays reached a critical record peak today. Should we re-include this ten-day-old strike item in today's maritime logistics briefing, and if so, how? | pass→pass | 12,079 | 11,586 | -4% | 1 | 1 | 0% | 1,823 | 2,019 | +11% | 0 | 0 | — |
▸case-10 We are compiling a daily brief on European natural gas storage. We have two updates: the EU Gas Infrastructure registry confirmed gas storage levels reached 92% today, while an equity analyst research note predicts winter storage will drop below 60% by February. How should these two items be presented? | pass→pass | 11,585 | 21,624 | +87% | 1 | 1 | 0% | 1,827 | 1,893 | +4% | 0 | 0 | — |
▸case-11 In our daily geopolitical risk brief regarding trade sanctions, we want to list potential future escalations in the watch items section. A team member drafted a watch item stating: 'Monitor international trade tensions for potential expansion.' Is this draft acceptable for our watch items section? | pass→pass | 11,311 | 9,055 | -20% | 1 | 1 | 0% | 1,514 | 1,525 | +1% | 0 | 0 | — |
▸case-12 When presenting our daily defense procurement intelligence brief to senior leadership, should we begin our final output with a detailed description of our search methodology and database querying process, or start directly with the key intelligence outcome? | pass→pass | 11,968 | 7,336 | -39% | 1 | 1 | 0% | 1,434 | 1,158 | -19% | 0 | 0 | — |
▸case-13 We gathered today's daily brief on sovereign debt markets, but commercial data access was down for Latin American bond markets during our reporting window. To sound confident, our analyst wants to omit any mention of missing data. How should we handle this in our delivery? | pass→pass | 13,273 | 8,358 | -37% | 1 | 1 | 0% | 1,809 | 1,317 | -27% | 0 | 0 | — |
▸case-14 We collected intelligence data covering developments up to March 12 at 17:00 UTC. An editor suggested titling the finished report 'Global Defense Intelligence Brief - March 15' to match today's publishing date. Is this title appropriate? | pass→pass | 21,589 | 6,573 | -70% | 1 | 1 | 0% | 1,476 | 1,331 | -10% | 0 | 0 | — |
▸case-15 When compiling our daily pharmaceutical regulatory brief, we found a summary paragraph on an aggregator blog discussing a new FDA drug approval. Can we cite the aggregator blog as our primary evidence, or what tool step should we take to verify it? | pass→pass | 12,422 | 7,615 | -39% | 1 | 1 | 0% | 1,858 | 1,309 | -30% | 0 | 0 | — |
▸case-16 To verify daily tariff changes on a customs authority portal, our script hits a dynamic Javascript portal that requires clicking cookie consent buttons and expanding dropdown menus. Which tool approach should be used to inspect this page? | pass→pass | 12,866 | 6,611 | -49% | 1 | 1 | 0% | 1,929 | 1,183 | -39% | 0 | 0 | — |
▸case-17 Our daily briefing on regional EV market share changes contains a complex comparative ranking of ten automotive manufacturers across five countries. Should we present this multi-country ranking purely in plain text paragraphs or generate a visual chart/graph? | pass→pass | 11,954 | 10,372 | -13% | 1 | 1 | 0% | 1,650 | 1,609 | -2% | 0 | 0 | — |
▸case-18 A client requested a daily brief on AI regulation. Before collecting news updates, what initial scoping details need to be confirmed to ensure the brief matches their operational needs? | fail→pass | 13,181 | 6,679 | -49% | 1 | 1 | 0% | 1,793 | 1,364 | -24% | 0 | 0 | — |
▸case-19 In delivering our daily brief on critical mineral exports, how should we represent the source material used to verify our reporting? | pass→pass | 16,729 | 13,719 | -18% | 1 | 1 | 0% | 2,361 | 2,176 | -8% | 0 | 0 | — |
▸case-20 An analyst turned in a daily brief on aviation safety where event descriptions cite '[Source: FAA Advisory]' without providing actual web links. Does this meet reporting requirements? | fail→pass | 9,625 | 4,382 | -54% | 1 | 1 | 0% | 1,792 | 947 | -47% | 0 | 0 | — |
▸case-21 A draft brief puts the overall report date 'October 24, 2026' in the document header, but the five individual news developments listed underneath do not have individual dates attached. Does this satisfy intelligence brief standards? | pass→pass | 20,484 | 6,448 | -69% | 1 | 1 | 0% | 2,047 | 1,108 | -46% | 0 | 0 | — |
▸case-22 We want to add a watch item regarding potential European Union trade retaliation against steel tariffs. Which formulation is correct: 'Watch for EU trade response' or 'Watch for EU Council vote on retaliatory steel tariffs scheduled for Nov 12 with a 55% majority trigger'? | pass→pass | 6,476 | 4,453 | -31% | 1 | 1 | 0% | 1,071 | 817 | -24% | 0 | 0 | — |