▸case-01 We have an OpenAPI specification file located at `./specs/payment-v2.yaml`. We need to generate a client library in Java 17 using Gradle as the build tool. The library should support both synchronous calls and reactive streams for high-throughput endpoints. Please generate the SDK project structure, including client source code, build scripts, unit tests, and distribution settings. | fail→fail | 29,509 | 35,069 | +19% | 1 | 1 | 0% | 6,486 | 7,541 | +16% | 0 | 0 | — |
▸case-02 Our team needs a Java client library wrapper for our REST API described in `https://api.internal.dev/v1/swagger.json`. We are targeting Java 11 with Maven. Please produce the complete source code, a pom.xml file configured for Central deployment, Javadoc documentation, and sample applications demonstrating how to perform API operations. | fail→fail | 39,247 | 34,108 | -13% | 1 | 1 | 0% | 8,260 | 8,642 | +5% | 0 | 0 | — |
▸case-03 Please create a Java 21 SDK project for the API spec at `./inventory-api.yaml`. We prefer Gradle and want support for reactive calls using Project Reactor. Deliver the complete project including source files, test suites, Javadoc, and publishing configs. | fail→fail | 36,581 | 33,874 | -7% | 1 | 1 | 0% | 8,241 | 8,622 | +5% | 0 | 0 | — |
▸case-04 We are designing a Java client class `MetricsClient` that takes 10 configuration parameters including timeout, retry limit, proxy settings, auth tokens, and base URL. Instead of requiring developers to pass a long parameter list to a public constructor or calling setters after instantiation, provide the Java client class structure showing how developers construct the client. | pass→pass | 17,468 | 19,760 | +13% | 1 | 1 | 0% | 2,740 | 3,657 | +33% | 0 | 0 | — |
▸case-05 In our Java SDK model class `UserProfile`, fields like `middleName` and `secondaryEmail` can be absent from the API response payload. Model developers usually return `null` directly with a `@Nullable` annotation. Show the Java getter method implementations for these optional fields according to Java SDK best practices. | pass→pass | 15,095 | 29,183 | +93% | 1 | 1 | 0% | 2,766 | 4,885 | +77% | 0 | 0 | — |
▸case-06 We are building a Java HTTP client wrapper `TelemetryClient` that maintains underlying connection pools and thread executors. Show how this client class should be declared and structured so that Java application developers can automatically clean up client resources using standard try-with-resources blocks. | pass→pass | 15,338 | 20,188 | +32% | 1 | 1 | 0% | 2,963 | 3,554 | +20% | 0 | 0 | — |
▸case-07 Our Java REST client needs an error handling structure for API failure responses like 401 Unauthorized, 404 Not Found, and 500 Internal Error. Developers often catch standard `RuntimeException` or raw `IOException`. Show the custom exception hierarchy class definitions starting from a base SDK exception. | pass→pass | 16,131 | 22,833 | +42% | 1 | 1 | 0% | 3,395 | 4,360 | +28% | 0 | 0 | — |
▸case-08 We need to add logging to our Java client library `OrderApiClient` to trace outbound request execution and HTTP status codes. Developers frequently insert `System.out.println` or default `java.util.logging`. Show how logging should be declared and invoked within the client class. | pass→pass | 13,698 | 12,563 | -8% | 1 | 1 | 0% | 2,712 | 2,863 | +6% | 0 | 0 | — |
▸case-09 We are defining data transfer model objects like `TransactionDetails` for our Java SDK. Developers usually generate JavaBean classes with public getters and setters. Show the Java class implementation for `TransactionDetails` ensuring data objects remain thread-safe and immutable once received. | pass→pass | 14,849 | 22,913 | +54% | 1 | 1 | 0% | 3,105 | 4,112 | +32% | 0 | 0 | — |
▸case-10 We have a Java SDK project built with Maven and want to prepare the `pom.xml` for release to Maven Central (Sonatype OSSRH). Show the distribution management and plugin build section required in `pom.xml` to satisfy Central publishing requirements. | pass→pass | 18,643 | 18,837 | +1% | 1 | 1 | 0% | 2,820 | 3,162 | +12% | 0 | 0 | — |
▸case-11 Our Java SDK uses Gradle (`build.gradle.kts`). We need to configure artifact publishing to Maven Central including source and javadoc jars. Provide the Gradle build script section that satisfies Maven Central deployment rules. | pass→pass | 17,434 | 18,389 | +5% | 1 | 1 | 0% | 2,717 | 3,148 | +16% | 0 | 0 | — |
▸case-12 Our enterprise API needs a Java SDK that serves both low-latency web services needing non-blocking reactive streams and legacy synchronous batch applications. Show the top-level SDK client interface structure that accommodates both synchronous and reactive consumption. | pass→pass | 22,827 | 24,842 | +9% | 1 | 1 | 0% | 3,393 | 4,339 | +28% | 0 | 0 | — |
▸case-13 We want to design a request builder interface `SearchRequest` in Java where developers set query terms, limit, and offset. Write the interface methods so calls can be chained together in a single expressive line. | pass→pass | 14,928 | 16,309 | +9% | 1 | 1 | 0% | 1,866 | 3,760 | +102% | 0 | 0 | — |
▸case-14 We are establishing the Maven configuration for a modern Java SDK targeting enterprise environments using Java 17. Provide the compiler plugin configuration in `pom.xml` specifying source and target compatibility. | pass→pass | 15,422 | 6,606 | -57% | 1 | 1 | 0% | 1,965 | 1,680 | -15% | 0 | 0 | — |
▸case-15 We need unit tests for our Java SDK's `UserClient` class to test HTTP 404 response handling without hitting live servers. Write a unit test class using mock server capabilities. | pass→pass | 20,267 | 22,373 | +10% | 1 | 1 | 0% | 3,335 | 3,988 | +20% | 0 | 0 | — |
▸case-16 We are creating payload model classes in our Java SDK like `AccountInfo` with 8 fields. To keep the SDK codebase clean, we want to leverage Lombok annotations. Write the Java class using Lombok to automatically generate builders, getters, and immutability. | pass→pass | 9,993 | 14,398 | +44% | 1 | 1 | 0% | 1,930 | 3,439 | +78% | 0 | 0 | — |
▸case-17 Our Java SDK needs to send a custom `User-Agent: Enterprise-Java-SDK/1.0` header on every HTTP request. Show how to configure this centrally in an HTTP client interceptor rather than in every service call. | pass→pass | 17,597 | 14,639 | -17% | 1 | 1 | 0% | 2,571 | 3,424 | +33% | 0 | 0 | — |
▸case-18 Network requests in our Java SDK may fail with transient 503 Service Unavailable errors. Show how to implement a retry policy on outbound requests without blocking threads with simple `Thread.sleep` loops. | fail→pass | 20,571 | 24,558 | +19% | 1 | 1 | 0% | 3,000 | 5,213 | +74% | 0 | 0 | — |
▸case-19 Provide the complete Javadoc header and signature documentation for a Java SDK method `public List<Device> listDevices(String region, Integer limit)` explaining inputs, return values, exceptions, and usage. | pass→pass | 10,363 | 17,203 | +66% | 1 | 1 | 0% | 1,945 | 2,695 | +39% | 0 | 0 | — |
▸case-20 We have an OpenAPI spec `./specs/crm-v1.yaml` and need a Python 3.11 client library generated using Pydantic and httpx. Please write the Python client class `CRMClient` and `pyproject.toml` configuration. | pass→pass | 21,318 | 33,878 | +59% | 1 | 1 | 0% | 4,752 | 7,597 | +60% | 0 | 0 | — |
▸case-21 We are developing a backend microservice in Java using Spring Boot. Please write a `@RestController` class `InvoiceController` with `@GetMapping` and `@PostMapping` endpoints that interacts with a Spring Data `@Repository`. | pass→pass | 16,416 | 24,366 | +48% | 1 | 1 | 0% | 2,527 | 4,808 | +90% | 0 | 0 | — |
▸case-22 We are designing a REST API for an inventory management service. Please write an OpenAPI 3.0 YAML specification document defining the `/items` endpoint with GET and POST operations, schemas, and HTTP status responses. | pass→pass | 18,672 | 15,030 | -20% | 1 | 1 | 0% | 3,190 | 3,928 | +23% | 0 | 0 | — |
▸case-23 We need to select an HTTP client library for synchronous operations inside our Java SDK targeting Java 17. Implement an HTTP executing method using a modern Java HTTP client library that supports connection pooling and timeouts instead of URLConnection. | pass→pass | 16,075 | 26,197 | +63% | 1 | 1 | 0% | 3,040 | 4,806 | +58% | 0 | 0 | — |
▸case-24 To deploy our Java SDK pom.xml to Maven Central via Sonatype, Central validation requires specific metadata fields. Show the pom.xml metadata tags required for Central approval. | pass→pass | 20,811 | 18,882 | -9% | 1 | 1 | 0% | 2,824 | 3,441 | +22% | 0 | 0 | — |