▸case-01 I am setting up a multi-agent workflow to design an electric vehicle battery management and charging system. Please evaluate our requirements and output a JSON object mapping each key task (such as cell balancing algorithm design, charging station interface, and high-voltage hardware safety) to the most relevant specialized automotive agent roles from your repository. | fail→pass | 10,566 | 13,072 | +24% | 1 | 1 | 0% | 2,326 | 2,998 | +29% | 0 | 0 | — |
▸case-02 We need to staff an autonomous driving safety compliance review covering functional safety, SOTIF assessment, and regional regulatory compliance. Provide a markdown table listing the recommended specialized agent roles, the specific automotive domain each handles, and the required deliverable for each stage of the review. | fail→pass | 7,469 | 7,941 | +6% | 1 | 1 | 0% | 1,375 | 2,070 | +51% | 0 | 0 | — |
▸case-03 Our team is designing a connected vehicle platform integrating cloud telemetry and in-vehicle networking. Generate a structured list of agent definitions to deploy for this subsystem, detailing how each agent definition supports cloud infrastructure, API routing, or vehicle network protocol development. | fail→pass | 17,636 | 13,708 | -22% | 1 | 1 | 0% | 3,234 | 3,356 | +4% | 0 | 0 | — |
▸case-22 Provide an AUTOSAR ARXML code snippet defining an ApplicationSwComponentType named 'SpeedometerSWC' with a SenderReceiverPort. | pass→pass | 7,834 | 7,086 | -10% | 1 | 1 | 0% | 1,856 | 2,084 | +12% | 0 | 0 | — |
▸case-04 We are building an Azure-based cloud architecture for real-time vehicle digital twins and cloud security auditing. Specify the exact agent role names to deploy for digital twin modeling and cloud infrastructure security analysis in JSON format. | fail→pass | 5,636 | 3,072 | -45% | 1 | 1 | 0% | 1,308 | 928 | -29% | 0 | 0 | — |
▸case-05 We are preparing an ISO/SAE 21434 cybersecurity compliance audit for a central gateway ECU. Which precise agent role handles 21434 auditing specifically, and which handles overall automotive security architecture? Return a two-item YAML mapping. | fail→pass | 3,415 | 3,882 | +14% | 1 | 1 | 0% | 673 | 1,000 | +49% | 0 | 0 | — |
▸case-06 We need to select an agent role to handle AR-HUD graphical driver assistance display development and another to handle perception sensor data feeds. Provide the exact kebab-case role names. | fail→pass | 4,415 | 1,718 | -61% | 1 | 1 | 0% | 933 | 643 | -31% | 0 | 0 | — |
▸case-07 For in-vehicle high-speed communication and Adaptive AUTOSAR software platform development, output the exact agent role identifiers for physical/data link ethernet configuration and high-performance software development. | fail→pass | 7,348 | 2,393 | -67% | 1 | 1 | 0% | 1,434 | 891 | -38% | 0 | 0 | — |
▸case-08 Our EV sustainability team needs agent roles for battery lifecycle management after vehicle decommissioning, plus environmental chamber thermal testing. List the exact matching agent role identifiers. | fail→pass | 6,178 | 1,764 | -71% | 1 | 1 | 0% | 1,371 | 664 | -52% | 0 | 0 | — |
▸case-09 We are conducting an ASPICE v3.1 process capability assessment across software development units. Output the exact agent identifier for the assessment lead. | fail→pass | 5,083 | 1,704 | -66% | 1 | 1 | 0% | 939 | 653 | -30% | 0 | 0 | — |
▸case-10 We are deploying AWS IoT FleetWise and AWS IoT Core for connected fleet metrics ingestion. Identify the matching specialized agent role identifier. | fail→pass | 6,244 | 3,249 | -48% | 1 | 1 | 0% | 882 | 862 | -2% | 0 | 0 | — |
▸case-11 Assign specialized agent role identifiers for handling chassis dynamics ECUs and body domain control unit development. Provide a JSON object mapping 'chassis' and 'body' keys to their roles. | fail→pass | 4,411 | 2,394 | -46% | 1 | 1 | 0% | 737 | 695 | -6% | 0 | 0 | — |
▸case-12 We are generating simulation test scenarios (such as Euro NCAP cut-in and lane-change maneuvers) for autonomous vehicle testing. Which role identifier specifically addresses scenario engineering? | pass→pass | 9,180 | 1,540 | -83% | 1 | 1 | 0% | 1,674 | 638 | -62% | 0 | 0 | — |
▸case-13 During engine and battery management ECU fine-tuning on dynamic test benches, parameter tuning is required. Provide the exact role identifier for parameter calibration work. | pass→pass | 5,047 | 1,955 | -61% | 1 | 1 | 0% | 847 | 702 | -17% | 0 | 0 | — |
▸case-14 Our in-vehicle infotainment platform includes a third-party vehicle app store ecosystem. Which role identifier manages application lifecycle and distribution in the vehicle app store? | fail→pass | 9,054 | 1,386 | -85% | 1 | 1 | 0% | 1,632 | 593 | -64% | 0 | 0 | — |
▸case-15 We are optimizing TriCore LLVM compiler toolchains for safety-critical microcontrollers. Which specific role identifier covers toolchain compiler optimization? | pass→pass | 13,612 | 1,803 | -87% | 1 | 1 | 0% | 2,053 | 603 | -71% | 0 | 0 | — |
▸case-16 In an autonomous vehicle decision-making network using distributed agreement algorithms, which agent role identifier facilitates consensus protocols? | pass→pass | 9,192 | 2,845 | -69% | 1 | 1 | 0% | 1,351 | 838 | -38% | 0 | 0 | — |
▸case-17 When orchestrating Docker and lightweight Kubernetes containers on high-performance automotive compute platforms, which role identifier handles container management? | pass→pass | 8,610 | 1,901 | -78% | 1 | 1 | 0% | 1,566 | 705 | -55% | 0 | 0 | — |
▸case-18 For defining high-level multi-domain autonomous driving E/E system architecture, specify the exact role identifier for autonomous systems architecture. | pass→pass | 7,771 | 1,564 | -80% | 1 | 1 | 0% | 1,421 | 628 | -56% | 0 | 0 | — |
▸case-19 When a requirement change affects multiple ECUs across an vehicle platform, which agent role handles tracking and propagating structural changes across specifications? | pass→pass | 8,445 | 3,368 | -60% | 1 | 1 | 0% | 1,428 | 880 | -38% | 0 | 0 | — |
▸case-20 Implement a C function for active cell balancing in a battery management system that calculates balance time based on cell voltage delta. | pass→pass | 19,078 | 27,200 | +43% | 1 | 1 | 0% | 4,127 | 6,506 | +58% | 0 | 0 | — |
▸case-21 Write a Python script using python-can to decode standard CAN ID 0x123 containing engine speed (RPM) encoded as a 16-bit big-endian integer with 0.25 scale factor. | pass→pass | 13,897 | 9,474 | -32% | 1 | 1 | 0% | 1,583 | 1,610 | +2% | 0 | 0 | — |