▸case-01 I am developing a custom language server for a domain-specific config language. Please design the core server architecture and return a JSON breakdown detailing the active capabilities, transportType, documentSync method, and generatedFiles array for the project layout. | fail→pass | 11,919 | 41,309 | +247% | 1 | 1 | 0% | 2,290 | 2,513 | +10% | 0 | 0 | — |
▸case-02 We are starting work on an editor language backend for our internal query language using Rust. Produce an initial server setup plan in JSON format with fields for capabilities, transportType, documentSync, and generatedFiles. | fail→pass | 6,375 | 4,896 | -23% | 1 | 1 | 0% | 1,350 | 1,377 | +2% | 0 | 0 | — |
▸case-03 I need to scaffold a language server implementation for a custom scripting language in VS Code. Provide a JSON response listing the capabilities array, the chosen transportType, the documentSync strategy, and the generatedFiles included in the scaffolding. | fail→pass | 8,306 | 3,813 | -54% | 1 | 1 | 0% | 1,379 | 1,335 | -3% | 0 | 0 | — |
▸case-04 We are building an editor language server for a local CLI compiler toolchain. The team is debating whether to set up an HTTP REST endpoint, an OS IPC socket, or standard input/output streams as the baseline transport layer. Provide a server configuration JSON specifying capabilities, transportType, documentSync, and generatedFiles. | fail→fail | 10,189 | 6,631 | -35% | 1 | 1 | 0% | 1,811 | 1,799 | -1% | 0 | 0 | — |
▸case-05 Our language server runs inside a remote Docker container daemon accessed across network boundaries by developer IDEs. Should we configure stdio, tcp, or websocket as the JSON-RPC transport protocol? Output the configuration in a JSON object with capabilities, transportType, documentSync, and generatedFiles. | pass→pass | 17,934 | 8,590 | -52% | 1 | 1 | 0% | 3,372 | 2,012 | -40% | 0 | 0 | — |
▸case-06 We are building a web-based IDE running in client browser tabs that talks to a backend language server process across the web. Which transport protocol from the supported options should be specified in our language server manifest? Return a JSON object with capabilities, transportType, documentSync, and generatedFiles. | fail→pass | 7,603 | 5,614 | -26% | 1 | 1 | 0% | 1,580 | 1,332 | -16% | 0 | 0 | — |
▸case-07 For a fast editor experience on large source code repositories with thousands of lines per file, some developers want to send full text on every keystroke while others want delta sync. Select the document synchronization mode and provide the architectural JSON specifying capabilities, transportType, documentSync, and generatedFiles. | fail→fail | 11,839 | 6,619 | -44% | 1 | 1 | 0% | 1,864 | 1,728 | -7% | 0 | 0 | — |
▸case-08 Create an architectural plan for a SQL dialect language server. Standardize the output into a JSON structure with capabilities, transportType, documentSync, and generatedFiles. | pass→pass | 24,827 | 16,369 | -34% | 1 | 1 | 0% | 5,707 | 2,799 | -51% | 0 | 0 | — |
▸case-09 We are building a language server backend in Rust and want an async framework library for JSON-RPC transport and LSP handler dispatching instead of writing raw byte parsing. What library ecosystem component should we adopt for Rust-based LSP development? | pass→pass | 12,633 | 10,713 | -15% | 1 | 1 | 0% | 2,312 | 2,202 | -5% | 0 | 0 | — |
▸case-10 We are implementing a Node.js-based language server in TypeScript for a template language. What standard official library framework should we use to implement the protocol connection and document synchronization handlers? | pass→pass | 9,032 | 6,247 | -31% | 1 | 1 | 0% | 1,750 | 1,617 | -8% | 0 | 0 | — |
▸case-11 In our language server, type checking operations on large projects take several seconds. How should background analysis results be handled when a user edits a file during an active workspace indexing pass? | pass→pass | 17,975 | 18,481 | +3% | 1 | 1 | 0% | 2,493 | 3,261 | +31% | 0 | 0 | — |
▸case-12 When a developer is actively typing code, the source file contains frequent syntax errors and incomplete statements. How should a language server parser handle these incomplete AST states during hover and completion requests? | fail→fail | 16,635 | 17,839 | +7% | 1 | 1 | 0% | 2,726 | 3,272 | +20% | 0 | 0 | — |
▸case-13 Sending full documentation and detail signatures for hundreds of completion suggestions slows down the auto-complete popup menu. What protocol pattern should be implemented to optimize initial completion payload size? | pass→pass | 11,339 | 13,070 | +15% | 1 | 1 | 0% | 1,876 | 2,952 | +57% | 0 | 0 | — |
▸case-14 When opening a massive project, parsing all source files takes 30 seconds. How should the language server inform the IDE user about ongoing workspace scanning without blocking interactive text editing? | pass→pass | 17,121 | 15,029 | -12% | 1 | 1 | 0% | 2,627 | 3,154 | +20% | 0 | 0 | — |
▸case-15 Regex-based textmate grammars in the editor cannot distinguish between a type name and a variable name when they share the same identifier syntax. How should the language server provide precise token coloring to the client editor? | pass→pass | 11,937 | 16,133 | +35% | 1 | 1 | 0% | 2,053 | 3,323 | +62% | 0 | 0 | — |
▸case-16 When a developer renames a function definition, how should the language server prepare edits so that all invocation sites across multiple workspace files update atomically in the client editor? | pass→pass | 16,309 | 16,870 | +3% | 1 | 1 | 0% | 2,776 | 3,040 | +10% | 0 | 0 | — |
▸case-17 As a developer types function arguments inside parentheses, how should the language server display parameter documentation and highlight the active parameter index? | pass→pass | 16,142 | 15,089 | -7% | 1 | 1 | 0% | 2,577 | 3,128 | +21% | 0 | 0 | — |
▸case-18 When static analysis flags an unused variable or a missing import, how should the language server offer automated code fixes that the developer can accept with a single click? | pass→pass | 14,358 | 18,630 | +30% | 1 | 1 | 0% | 2,582 | 4,127 | +60% | 0 | 0 | — |
▸case-19 When a developer positions the mouse cursor over a variable or class method, what information should the server hover handler assemble and return? | pass→pass | 15,256 | 15,215 | -0% | 1 | 1 | 0% | 2,279 | 2,682 | +18% | 0 | 0 | — |
▸case-20 We are implementing a Debug Adapter Protocol (DAP) server for a custom bytecode interpreter. How should the server respond to a 'stackTrace' request from VS Code to display local call frames and active variables? | pass→pass | 19,412 | 14,246 | -27% | 1 | 1 | 0% | 2,878 | 3,434 | +19% | 0 | 0 | — |
▸case-21 We need to automate DOM node inspection and CSS layout property extraction using Chrome DevTools Protocol (CDP). How do CDP JSON-RPC methods like DOM.getDocument and Page.navigate handle remote web page inspection? | pass→pass | 21,854 | 22,523 | +3% | 1 | 1 | 0% | 4,164 | 3,777 | -9% | 0 | 0 | — |
▸case-22 How do we write a Tree-sitter grammar file (grammar.js) using conflict rules and precedence annotations to construct a concrete syntax tree parser for a DSL? | pass→pass | 33,171 | 25,648 | -23% | 1 | 1 | 0% | 5,080 | 4,514 | -11% | 0 | 0 | — |