▸case-06 Run a schema check against an OpenAPI specification document fixture that contains openapi: 3.0.0 and info: with title: User API, but omits the mandatory info.version string. What findings and status should be emitted? | pass→pass | 8,590 | 4,469 | -48% | 1 | 1 | 0% | 1,495 | 775 | -48% | 0 | 0 | — |
▸case-01 Can you execute the metadata validator against my markdown test fixture that lacks mandatory frontmatter properties? Please report whether it flagged the omitted entries and recorded a failing status. | pass→pass | 5,566 | 3,394 | -39% | 1 | 1 | 0% | 814 | 596 | -27% | 0 | 0 | — |
▸case-02 Please run the spec compliance tool on this sample file missing essential header attributes. I need to see if the missing field issues are properly reported and if the overall outcome is flagged as a failure. | pass→pass | 5,028 | 5,865 | +17% | 1 | 1 | 0% | 746 | 1,210 | +62% | 0 | 0 | — |
▸case-03 Check this frontmatter sample using our validation tool. Ensure it identifies all the missing required fields and marks the validation run as failed. | fail→pass | 2,996 | 5,035 | +68% | 1 | 1 | 0% | 517 | 908 | +76% | 0 | 0 | — |
▸case-04 Evaluate a Jekyll markdown article fixture that defines layout: post but lacks title and author keys required by the publishing pipeline. How should the validator handle this file? | pass→pass | 10,075 | 4,862 | -52% | 1 | 1 | 0% | 1,968 | 851 | -57% | 0 | 0 | — |
▸case-05 Audit a Hugo post fixture that includes title: 'Release Notes' and tags: ['news'] but omits the mandatory date header property. What is the expected test output? | pass→pass | 18,669 | 3,097 | -83% | 1 | 1 | 0% | 1,474 | 508 | -66% | 0 | 0 | — |
▸case-07 Validate a documentation suite manifest fixture that defines title and pages array but leaves out the compulsory id field. How should the suite validator register this outcome? | pass→pass | 10,424 | 4,660 | -55% | 1 | 1 | 0% | 1,711 | 878 | -49% | 0 | 0 | — |
▸case-08 Execute the metadata verifier on a software component catalog entry fixture that supplies name and repository but omits the mandatory license entry. What output report should be generated? | pass→pass | 9,508 | 6,299 | -34% | 1 | 1 | 0% | 1,669 | 1,108 | -34% | 0 | 0 | — |
▸case-09 Check a package configuration fixture that specifies name: 'my-lib' and version: '1.0.0' but leaves out the required description field for internal registry publishing. What findings and status should be recorded? | pass→pass | 6,588 | 3,081 | -53% | 1 | 1 | 0% | 1,222 | 433 | -65% | 0 | 0 | — |
▸case-10 Validate a knowledge base article fixture containing frontmatter with title: 'Troubleshooting' and category: 'support', but omitting the required slug parameter. What should the test reporter produce? | pass→pass | 8,443 | 3,254 | -61% | 1 | 1 | 0% | 1,624 | 558 | -66% | 0 | 0 | — |
▸case-11 Run a lint inspection on a metadata manifest fixture that sets name: 'web-service' and version: '0.1.0' but omits the required maintainers array. How should the compliance checker reflect this? | pass→pass | 9,366 | 5,236 | -44% | 1 | 1 | 0% | 1,607 | 924 | -43% | 0 | 0 | — |
▸case-12 Verify a CMS article frontmatter fixture that provides title, author, and published_at, but fails to include the mandatory draft boolean flag. What is the expected reporting behavior? | pass→pass | 8,431 | 4,356 | -48% | 1 | 1 | 0% | 1,438 | 685 | -52% | 0 | 0 | — |
▸case-13 Execute the document validator on a technical RFC specification fixture that includes rfc_number: 104 and status: 'draft' but omits the compulsory summary section in its frontmatter header. What should be logged? | pass→pass | 6,025 | 2,901 | -52% | 1 | 1 | 0% | 1,201 | 576 | -52% | 0 | 0 | — |
▸case-14 Check a developer portal markdown fixture that has title: 'Authentication' and updated_at: '2025-01-01' but lacks the mandatory tags frontmatter list. What findings and overall state should be reported? | pass→pass | 5,730 | 2,258 | -61% | 1 | 1 | 0% | 1,049 | 467 | -55% | 0 | 0 | — |
▸case-15 Run a schema compliance check on a service catalog entry fixture that defines service_name: 'payment-gateway' and tier: 'critical' but lacks the mandatory owner_email key. What should the validator output? | pass→pass | 8,057 | 3,837 | -52% | 1 | 1 | 0% | 1,346 | 659 | -51% | 0 | 0 | — |
▸case-16 Inspect a localization bundle manifest fixture that provides bundle_id: 'i18n-core' and string_count: 450 but omits the required default_locale property. What is the validator expected to output? | pass→pass | 6,636 | 3,942 | -41% | 1 | 1 | 0% | 1,260 | 694 | -45% | 0 | 0 | — |
▸case-17 Check an e-commerce catalog item frontmatter fixture that provides name: 'Wireless Mouse' and price: 29.99 but omits the compulsory sku identifier. How should the verification run complete? | pass→pass | 5,940 | 2,238 | -62% | 1 | 1 | 0% | 1,009 | 450 | -55% | 0 | 0 | — |
▸case-18 Validate a stage deployment manifest fixture that specifies cluster: 'us-east-1' and replicas: 3 but omits the mandatory environment property. What should the checker report? | pass→pass | 7,011 | 2,781 | -60% | 1 | 1 | 0% | 1,185 | 557 | -53% | 0 | 0 | — |
▸case-19 Run a doc generator validator against a UI component spec fixture that specifies name: 'Button' and props: [] but omits the compulsory type property. What should the output show? | pass→pass | 7,277 | 9,892 | +36% | 1 | 1 | 0% | 1,287 | 764 | -41% | 0 | 0 | — |
▸case-20 Run the schema validator against a markdown article fixture that contains all required frontmatter header fields (title, author, date, layout) correctly populated with valid values. | pass→pass | 8,180 | 5,735 | -30% | 1 | 1 | 0% | 1,281 | 1,189 | -7% | 0 | 0 | — |
▸case-21 Execute a document link checking tool on a markdown file where all frontmatter attributes are valid, but a relative hyperlink [Architecture](./docs/arch.md) points to a non-existent file path. | pass→pass | 5,535 | 6,164 | +11% | 1 | 1 | 0% | 1,013 | 1,231 | +22% | 0 | 0 | — |
▸case-22 Validate a markdown file fixture where the YAML frontmatter contains a syntax parsing error due to irregular space indentation on line 3 ( author: tabbed). | pass→pass | 9,423 | 4,447 | -53% | 1 | 1 | 0% | 1,855 | 725 | -61% | 0 | 0 | — |