▸case-07 Convert this document into the Vanguard Trading Constitution:
'Vanguard Trading democratizes algorithmic asset management. Decision making: changes to trading algorithms require unanimous approval from the Risk Committee. Open tickets: Fix bug #402, update API keys for Binance, resolve memory leak in worker thread.'
Format as a constitution. | fail→pass | 12,179 | 10,388 | -15% | 1 | 1 | 0% | 1,147 | 1,551 | +35% | 0 | 0 | — |
▸case-01 Here is the Aegis Security Charter text:
'Aegis Security exists to safeguard financial data across cloud environments. We hold uncompromising data integrity and zero-trust verification as non-negotiable standards. Decisions require approval from two security architects.'
Please convert this into a project constitution. Also, share your personal thoughts on whether two security architects is too restrictive before giving the constitution. | fail→pass | 12,234 | 10,186 | -17% | 1 | 1 | 0% | 1,838 | 1,814 | -1% | 0 | 0 | — |
▸case-02 Extract the constitutional elements from the Atlas Logistics Charter:
'Atlas Logistics exists to streamline global freight routing. We value total transparency with shippers and relentless operational uptime. Technical implementation will use PostgreSQL, React 18, and AWS Fargate. Sprint budget is capped at $50,000 per iteration with weekly standups at 9 AM.'
Format the result as a constitution. | fail→fail | 10,181 | 4,387 | -57% | 1 | 1 | 0% | 979 | 1,683 | +72% | 0 | 0 | — |
▸case-03 Extract the core principles from the Hyperion Engine Charter:
'Hyperion Engine is committed to open source freedom. We maintain an uncompromising commitment to zero vendor lock-in across all storage adapters.'
Create a project constitution from this text. | fail→pass | 13,976 | 10,113 | -28% | 1 | 1 | 0% | 1,405 | 1,624 | +16% | 0 | 0 | — |
▸case-04 Here is the text for Krypton DB:
'Krypton DB delivers sub-millisecond graph queries for real-time fraud prevention. Core values: absolute data correctness, peer-reviewed algorithms.'
Generate the project constitution. Make sure to fill in standard governance procedures and performance benchmarks even if they aren't explicitly stated. | fail→pass | 15,347 | 16,580 | +8% | 1 | 1 | 0% | 2,245 | 2,861 | +27% | 0 | 0 | — |
▸case-05 Extract constitutional elements from the Quantum Pay Charter:
'Section 1: Security first. Always encrypt data at rest.
Section 2: Mission. Provide frictionless cross-border payments.
Section 4: Data Protection. All data at rest must be encrypted without exception.'
Format this into a project constitution. | pass→fail | 10,121 | 10,773 | +6% | 1 | 1 | 0% | 889 | 1,852 | +108% | 0 | 0 | — |
▸case-06 Extract the project constitution from the Solaria Energy Portal document:
'Solaria Energy Portal strives to accelerate residential solar adoption globally. We hold customer safety and green efficiency as core values. Key milestones: Phase 1 beta launch on October 15th, QA signoff by November 30th, full release in Q1.'
Format into a constitution. | fail→fail | 8,584 | 9,559 | +11% | 1 | 1 | 0% | 638 | 1,698 | +166% | 0 | 0 | — |
▸case-08 Organize the following text into the Nebula Framework Constitution:
'Nebula Framework empowers developers to build edge applications effortlessly. We believe in transparent public discourse and radical simplicity. Rule: Major release deployments require a 2/3 majority vote among core maintainers. Decision Process: Architecture RFCs must remain open for public comment for 14 days before voting.'
Structure this document properly. | fail→pass | 5,594 | 8,989 | +61% | 1 | 1 | 0% | 1,010 | 1,576 | +56% | 0 | 0 | — |
▸case-09 Extract the constitution from the Vortex Analytics Charter:
'Vortex Analytics exists to deliver zero-latency telemetry to embedded IoT devices. Principles: Hardware neutrality, offline-first reliability.'
Format into a project constitution. | pass→pass | 10,450 | 4,622 | -56% | 1 | 1 | 0% | 741 | 1,568 | +112% | 0 | 0 | — |
▸case-10 Extract the constitutional elements from the Orion Cloud Document:
'Orion Cloud aims to lower cloud hosting costs for early-stage startups. We value user privacy and transparent billing. Pricing Tiers: Starter tier is $99/month for 5 nodes; Enterprise tier is $499/month for unlimited nodes with 24/7 phone support.'
Produce the project constitution. | fail→fail | 9,549 | 4,115 | -57% | 1 | 1 | 0% | 879 | 1,662 | +89% | 0 | 0 | — |
▸case-11 Extract the constitutional text from the Titan Engine Charter:
'Titan Engine provides high-throughput game physics calculations. Value: Deterministic outcome guarantee across platform builds. Rule: Engine core changes require approval from Lead Architect.'
Ensure categories like Mission, Values, and Governance are clearly structured. | fail→pass | 7,502 | 2,870 | -62% | 1 | 1 | 0% | 458 | 1,356 | +196% | 0 | 0 | — |
▸case-17 Based on the Chrono Sync Charter below, create a 2-week Agile sprint plan with Jira user story breakdowns, story points, and developer task assignments:
'Chrono Sync synchronizes offline database transactions across mobile clients. Principles: Local-first storage, eventual consistency.' | pass→fail | 26,300 | 6,470 | -75% | 1 | 1 | 0% | 3,775 | 2,040 | -46% | 0 | 0 | — |
▸case-12 Consolidate these two source texts into a single constitution for Project Biomap:
Document A:
'Project Biomap exists to map human cellular structures at nanoscale resolution. Vision: Complete open-access cell atlas by 2030.'
Document B:
'Governance: Data releases must be reviewed by the Ethics Board. Quality Standard: Sequencing error rate must remain below 0.01%.'
Format as one constitution. | pass→pass | 3,684 | 12,532 | +240% | 1 | 1 | 0% | 681 | 1,544 | +127% | 0 | 0 | — |
▸case-13 Extract the constitution from the QuickDB Charter:
'QuickDB provides zero-config key-value storage for embedded rust applications. Core value: Zero third-party dependencies. Quickstart code:
```rust
let db = QuickDB::open("./data")?;
db.set("key", "value")?;
```
Governance: API breaking changes require RFC deprecation cycle of 6 months.'
Format into a constitution. | pass→fail | 6,087 | 4,604 | -24% | 1 | 1 | 0% | 1,064 | 1,665 | +56% | 0 | 0 | — |
▸case-14 Extract the project constitution from the Apex Cache Charter:
'Apex Cache accelerates distributed key-value lookup. Quality Standards: System p99 response time must stay under 5ms under peak load. Service availability target is 99.999% uptime.'
Format as a project constitution. | fail→pass | 3,976 | 10,302 | +159% | 1 | 1 | 0% | 738 | 1,765 | +139% | 0 | 0 | — |
▸case-15 Extract constitutional elements from the CyberShield Charter:
'CyberShield fosters a culture of psychological safety, continuous learning, and blameless post-mortems. Employee Perks: All staff receive $1,000 annual gym stipend, free lunch Fridays, and unlimited PTO.'
Create the CyberShield Constitution. | fail→pass | 8,027 | 12,050 | +50% | 1 | 1 | 0% | 1,420 | 2,095 | +48% | 0 | 0 | — |
▸case-16 Read the following Argon Protocol Charter:
'Argon Protocol enables cross-chain token swaps. Mission: Eliminate centralized exchange reliance. Values: Decoupled architecture, user key autonomy.'
Perform a comprehensive audit of this document. Point out missing governance policies, compliance risks, and security gaps, and suggest fixes. | pass→fail | 23,503 | 8,142 | -65% | 1 | 1 | 0% | 2,952 | 2,383 | -19% | 0 | 0 | — |
▸case-18 I am planning to launch a new enterprise AI product named Astra AI, but I have not written any charter or notes yet. Invent a full set of corporate values, mission statements, and governance structures for Astra AI from scratch. | fail→fail | 27,939 | 18,294 | -35% | 1 | 1 | 0% | 2,618 | 2,824 | +8% | 0 | 0 | — |
▸case-19 Extract the constitution from the Sentinel Hardware Charter:
'Sentinel Hardware builds tamper-resistant cryptographic modules. Quality Benchmark: FIPS 140-3 Level 4 validation required. Vendor Contacts: Supplier John Doe (john@vendor.com, 555-0199), IC Supplier Acme Corp (contact@acme.com).'
Format as a constitution. | fail→pass | 11,227 | 10,424 | -7% | 1 | 1 | 0% | 1,169 | 1,859 | +59% | 0 | 0 | — |
▸case-20 Extract constitutional elements from the Echo Sound Charter:
'Echo Sound exists to provide spatial audio rendering for indie game engines. Values: Low CPU overhead, developer accessibility. Ad Copy Options: "Crush the competition with Echo Sound! Click link for 50% off your annual subscription!"'
Format as a project constitution. | fail→pass | 5,410 | 5,136 | -5% | 1 | 1 | 0% | 876 | 1,778 | +103% | 0 | 0 | — |
▸case-21 Extract elements from the Polaris Platform Charter:
'Polaris Platform simplifies Kubernetes cluster management. Cultural Commitments: We practice blameless post-mortems, promote psychological safety, and encourage constructive dissent during design reviews.'
Format this into a project constitution. | pass→pass | 4,158 | 8,858 | +113% | 1 | 1 | 0% | 723 | 1,383 | +91% | 0 | 0 | — |
▸case-22 Extract constitutional content from the Vault Keep Charter:
'Vault Keep provides encrypted password storage. Decision Making: Any change to encryption primitives requires formal Architecture Decision Record approval signed by 3 module leads and 1 security reviewer.'
Format into a constitution. | pass→pass | 9,027 | 8,318 | -8% | 1 | 1 | 0% | 697 | 1,422 | +104% | 0 | 0 | — |
▸case-23 Here is the Helix Bio Charter:
'Helix Bio accelerates genomic research through open data sharing. Governance: Steering Committee of 5 principal investigators decides research priorities by simple majority vote.'
Extract the project constitution from this text, and also provide a 2-paragraph evaluation on whether simple majority vote is good for genomic projects. | fail→pass | 11,667 | 11,475 | -2% | 1 | 1 | 0% | 1,057 | 1,949 | +84% | 0 | 0 | — |