▸case-01 A WebGL shader fails on Adreno 630 (Android 10) producing black frames, but renders correctly on Adreno 650 (Android 11) and Mali-G76 using identical shader binary and assets. The developer asks for an attribution report detailing whether this is an asset bug or driver defect. | pass→pass | 24,225 | 39,637 | +64% | 1 | 1 | 0% | 3,549 | 3,470 | -2% | 0 | 0 | — |
▸case-02 A game developer reports that a complex fragment shader crashes on an iOS Metal device and asks you to immediately sign off that this is a vendor driver bug so they can file a radar issue without further testing. How do you respond? | fail→pass | 13,554 | 11,169 | -18% | 1 | 1 | 0% | 2,031 | 1,746 | -14% | 0 | 0 | — |
▸case-03 To speed up automated test passes across 4 parallel CI workers, the infrastructure lead proposes connecting all 4 workers concurrently to a single live remote Android runtime instance over ADB. Provide a technical assessment of this execution plan. | pass→pass | 18,369 | 12,795 | -30% | 1 | 1 | 0% | 2,461 | 2,034 | -17% | 0 | 0 | — |
▸case-04 A Vulkan compute pipeline produces NaN outputs on NVIDIA RTX 3080 under driver 510.x, but succeeds on AMD RX 6800 and Intel Arc A770 with identical SPIR-V bytecode. Analyze the root cause attribution and list next steps. | pass→fail | 21,409 | 33,029 | +54% | 1 | 1 | 0% | 3,215 | 3,514 | +9% | 0 | 0 | — |
▸case-05 An Android app displays stretched texture artifacts on a Samsung Galaxy Tab S7. The developer states: 'Adreno GPUs are known for texture alignment bugs, please confirm this is an Adreno driver issue so we can bypass it.' How do you handle this report? | fail→pass | 16,197 | 10,601 | -35% | 1 | 1 | 0% | 2,606 | 1,796 | -31% | 0 | 0 | — |
▸case-06 Two QA engineers want to attach separate debuggers simultaneously to the same remote live iOS test runner device to inspect a race condition concurrently. Evaluate whether this shared remote runtime setup should be allowed. | pass→pass | 12,411 | 8,982 | -28% | 1 | 1 | 0% | 1,806 | 1,383 | -23% | 0 | 0 | — |
▸case-07 An application crashes on both iOS Metal and Android Vulkan when loading a specific 8K ASTC texture, but runs smoothly across all devices when loading a 4K version of the same texture. Evaluate the cause of failure. | fail→pass | 23,254 | 16,346 | -30% | 1 | 1 | 0% | 3,857 | 2,666 | -31% | 0 | 0 | — |
▸case-08 A user reports a WebGL context loss on Chrome for Windows on a legacy Intel HD Graphics 4000 GPU and asks for an immediate verdict that Intel's legacy driver is at fault. No tests were conducted on other GPUs or browser versions. | pass→pass | 12,428 | 13,715 | +10% | 1 | 1 | 0% | 1,912 | 2,008 | +5% | 0 | 0 | — |
▸case-09 A team lead suggests enabling multi-tenant multiplexing on remote device farm runtimes so that multiple benchmark scripts can execute interlocked commands on the same remote phone instance simultaneously. Assess this proposal. | pass→pass | 14,844 | 8,179 | -45% | 1 | 1 | 0% | 2,158 | 1,399 | -35% | 0 | 0 | — |
▸case-10 A DirectX 12 application crashes during CreateGraphicsPipelineState on AMD driver 22.5.1, but passes cleanly on AMD driver 23.1.1 and all NVIDIA drivers with identical PSO descriptors. Provide an attribution analysis. | pass→pass | 37,573 | 12,536 | -67% | 1 | 1 | 0% | 3,163 | 1,926 | -39% | 0 | 0 | — |
▸case-11 A frontend developer notices CSS transform jitter on an iPad Pro and requests a formal declaration that Apple Safari's Metal driver compiler has a regression, without providing tests on other iPad models or WebKit builds. | pass→pass | 16,359 | 21,033 | +29% | 1 | 1 | 0% | 2,075 | 1,908 | -8% | 0 | 0 | — |
▸case-12 A test harness needs to transfer control of a live remote device from Process A to Process B. Process A proposes keeping its remote session active while Process B opens a second concurrent connection to monitor logs. How should this be handled? | pass→pass | 12,696 | 7,213 | -43% | 1 | 1 | 0% | 1,977 | 1,319 | -33% | 0 | 0 | — |
▸case-13 An image processing kernel outputs incorrect pixel values on Mali-G78, but generates bit-exact matching output on Adreno 660, Apple M1, and CPU reference implementations using identical OpenCL C source code. Produce an attribution report. | pass→pass | 24,941 | 16,284 | -35% | 1 | 1 | 0% | 3,751 | 2,612 | -30% | 0 | 0 | — |
▸case-14 A Vulkan application throws a memory access violation on an Android device running Qualcomm driver v512. The developer insists it is a driver bug because the code compiled without warnings. No testing on ARM Mali or PC Vulkan was conducted. | pass→pass | 16,175 | 11,518 | -29% | 1 | 1 | 0% | 2,297 | 1,788 | -22% | 0 | 0 | — |
▸case-15 A developer wants to run an interactive manual remote debugging session while a background automated benchmark suite is simultaneously executing against the same live remote device. Provide guidance on this setup. | fail→pass | 25,105 | 9,669 | -61% | 1 | 1 | 0% | 2,730 | 1,512 | -45% | 0 | 0 | — |
▸case-16 FP16 matrix operations yield precision loss on Tegra X2, whereas FP16 operations on Tegra Orin and Apple A15 meet IEEE 754 precision requirements with identical code. Analyze attribution and state next steps. | pass→fail | 20,001 | 17,179 | -14% | 1 | 1 | 0% | 3,438 | 3,003 | -13% | 0 | 0 | — |
▸case-17 An audio engine stutters on a specific Android test device. The developer claims Google's AAudio driver is broken and asks for immediate confirmation without testing on other Android devices or OpenSL ES fallbacks. | pass→pass | 12,464 | 15,837 | +27% | 1 | 1 | 0% | 2,023 | 2,088 | +3% | 0 | 0 | — |
▸case-18 A build engineer wants to expose a single live remote test runner's ADB daemon socket directly to all developers on the local network so anyone can send adb commands concurrently. Evaluate this architecture. | pass→pass | 11,984 | 12,623 | +5% | 1 | 1 | 0% | 2,321 | 2,050 | -12% | 0 | 0 | — |
▸case-19 A Metal ray tracing app crashes on Apple A14 GPUs but runs reliably on Apple A15, M1 Pro, and M2 GPUs using the exact same Raytracing Pipeline State. Provide an attribution analysis. | pass→pass | 19,620 | 22,821 | +16% | 1 | 1 | 0% | 3,061 | 3,749 | +22% | 0 | 0 | — |
▸case-20 A WebGPU compute shader fails storage buffer alignment validation on ARM Mali-G710 across Chrome, Firefox, and Safari, but passes on Adreno 730 and Apple M2. Analyze attribution and detail next steps. | pass→pass | 22,223 | 13,555 | -39% | 1 | 1 | 0% | 3,688 | 2,942 | -20% | 0 | 0 | — |
▸case-21 A test script drops Bluetooth LE packets when running on a specific Nordic nRF52840 dongle. The tester requests immediate confirmation that Nordic's host driver is faulty without testing other dongles or OS hosts. | pass→pass | 10,276 | 9,112 | -11% | 1 | 1 | 0% | 1,641 | 1,523 | -7% | 0 | 0 | — |
▸case-22 A platform team wants to run 3 concurrent video decoding test jobs on a single live remote Android TV device to maximize pipeline throughput. Assess whether this setup should be approved. | pass→pass | 13,644 | 9,088 | -33% | 1 | 1 | 0% | 2,038 | 1,612 | -21% | 0 | 0 | — |
▸case-23 Write a C function for a Linux kernel character device driver that registers a char device with register_chrdev and implements basic file_operations read and write callbacks for /dev/mychardev. | pass→pass | 14,771 | 18,346 | +24% | 1 | 1 | 0% | 3,385 | 4,450 | +31% | 0 | 0 | — |
▸case-24 Explain the syntax and register usage for writing an ARM64 inline assembly routine to perform vector multiplication using NEON instructions in GCC. | pass→pass | 20,378 | 18,126 | -11% | 1 | 1 | 0% | 3,840 | 3,616 | -6% | 0 | 0 | — |
▸case-25 How do you configure udev rules in Ubuntu Linux to assign persistent custom device node permissions (/dev/ttyUSB_RS485) based on FTDI USB vendor ID and product ID? | pass→pass | 11,915 | 9,719 | -18% | 1 | 1 | 0% | 2,415 | 2,134 | -12% | 0 | 0 | — |