▸case-01 I need to set up a multi-agent workflow in Python where Agent A writes code, and Agent B reviews it strictly after Agent A completes. We want linear, step-by-step task execution without a managing agent overhead. How should the execution process type be configured in the orchestrator? | fail→fail | 12,063 | 7,194 | -40% | 1 | 1 | 0% | 1,920 | 1,656 | -14% | 0 | 0 | — |
▸case-02 We are building an agent team where a manager agent dynamically delegates subtasks to specialist worker agents and coordinates final output synthesis. Which process orchestration mode should be set on the agent collection object? | fail→fail | 7,763 | 4,760 | -39% | 1 | 1 | 0% | 1,280 | 1,098 | -14% | 0 | 0 | — |
▸case-03 When configuring a manager-led coordinated multi-agent system structure with hierarchical processing in Python, what additional manager-level parameter or attribute must be provided on the crew orchestrator? | fail→fail | 7,223 | 4,458 | -38% | 1 | 1 | 0% | 1,301 | 1,127 | -13% | 0 | 0 | — |
▸case-04 I am instantiating individual agent components for a financial analysis multi-agent pipeline using Python classes. What core attributes must be declared for each agent component to properly establish its identity, objective, and context? | fail→fail | 15,713 | 9,007 | -43% | 1 | 1 | 0% | 2,999 | 2,006 | -33% | 0 | 0 | — |
▸case-05 When defining work units for agents in a Python multi-agent system, we provided task description strings. However, execution failed or lacked structured expectations. What required attribute must be added alongside description to ensure proper task completion criteria? | fail→fail | 5,955 | 3,189 | -46% | 1 | 1 | 0% | 1,099 | 823 | -25% | 0 | 0 | — |
▸case-06 In an agent pipeline with multiple task objects, how do you explicitly link a specific task object to the designated specialist agent that should execute it? | fail→fail | 13,660 | 4,311 | -68% | 1 | 1 | 0% | 2,456 | 1,069 | -56% | 0 | 0 | — |
▸case-07 We have a multi-agent system where one high-precision agent requires an advanced reasoning model while a simple agent uses a smaller, faster model. How is custom model selection configured across different agents? | fail→fail | 13,467 | 11,703 | -13% | 1 | 1 | 0% | 2,624 | 2,509 | -4% | 0 | 0 | — |
▸case-08 We want an agent component to query a vector database using custom Python functions. Where should these tool functions or instances be attached in the setup code? | fail→fail | 10,513 | 7,282 | -31% | 1 | 1 | 0% | 2,077 | 1,734 | -17% | 0 | 0 | — |
▸case-09 If a tool should only be available during a specific phase of workflow execution rather than globally to an agent across all tasks, where should the tool array be assigned? | fail→fail | 8,273 | 4,798 | -42% | 1 | 1 | 0% | 1,427 | 1,052 | -26% | 0 | 0 | — |
▸case-10 How do you enable short-term, long-term, and entity memory sharing across agents in a multi-agent setup? | fail→pass | 16,526 | 12,396 | -25% | 1 | 1 | 0% | 2,867 | 2,697 | -6% | 0 | 0 | — |
▸case-11 We have a specialist agent that should strictly perform its assigned work without asking other agents for assistance or delegating work. Which agent configuration boolean disables delegation? | fail→fail | 2,725 | 2,514 | -8% | 1 | 1 | 0% | 458 | 639 | +40% | 0 | 0 | — |
▸case-12 During development of a multi-agent orchestration setup, we want detailed console execution logs showing agent thought processes and tool outputs. What parameter enables this globally? | fail→fail | 7,495 | 3,693 | -51% | 1 | 1 | 0% | 1,259 | 883 | -30% | 0 | 0 | — |
▸case-13 When assembling the main orchestrator instance that coordinates multiple agents and tasks, how are tasks and agents supplied to the central orchestrator class? | fail→pass | 15,681 | 7,098 | -55% | 1 | 1 | 0% | 3,004 | 1,678 | -44% | 0 | 0 | — |
▸case-14 What standard package class should be inherited when creating custom reusable tooling classes for multi-agent frameworks in Python? | fail→fail | 10,009 | 5,109 | -49% | 1 | 1 | 0% | 2,012 | 1,162 | -42% | 0 | 0 | — |
▸case-15 When constructing a custom tool with strict input type validation using Pydantic for agent orchestration, what class attribute defines the input argument structure? | fail→fail | 4,051 | 3,539 | -13% | 1 | 1 | 0% | 670 | 816 | +22% | 0 | 0 | — |
▸case-16 In a multi-agent pipeline, Task B requires output from Task A as direct input context without manual string formatting or custom callbacks. What parameter on the Task definition accepts prior task instances? | fail→fail | 3,401 | 3,045 | -10% | 1 | 1 | 0% | 694 | 816 | +18% | 0 | 0 | — |
▸case-17 Once the agents, tasks, and crew orchestrator are fully instantiated in Python code, what standard method call initiates the workflow execution? | fail→fail | 2,872 | 2,599 | -10% | 1 | 1 | 0% | 504 | 689 | +37% | 0 | 0 | — |
▸case-18 We need to pass dynamic runtime variables (such as target topic or user ID) into task prompt placeholders when starting a multi-agent pipeline execution. What argument is passed to the start method? | fail→fail | 6,444 | 3,722 | -42% | 1 | 1 | 0% | 1,090 | 867 | -20% | 0 | 0 | — |
▸case-19 To execute a multi-agent workflow asynchronously without blocking the main Python event loop, which method should be called on the crew orchestrator? | fail→fail | 2,933 | 3,126 | +7% | 1 | 1 | 0% | 512 | 779 | +52% | 0 | 0 | — |
▸case-20 How do I build a single-agent ReAct loop using raw LangChain standard initialize_agent or create_react_agent functions in Python? | fail→fail | 11,841 | 9,026 | -24% | 1 | 1 | 0% | 2,619 | 2,140 | -18% | 0 | 0 | — |
▸case-21 How do I configure a PyAutoGen ConversableAgent for two-party peer-to-peer chat with custom human-in-the-loop auto-reply settings? | fail→fail | 14,630 | 9,386 | -36% | 1 | 1 | 0% | 2,901 | 2,290 | -21% | 0 | 0 | — |
▸case-22 How do I create an assistant using the official OpenAI Python SDK client.beta.assistants.create endpoint with code interpreter enabled? | fail→fail | 7,385 | 5,877 | -20% | 1 | 1 | 0% | 1,467 | 1,423 | -3% | 0 | 0 | — |