▸case-01 I staged updates in `src/auth/login.ts` adding OAuth2 Google login support. Draft a Conventional Commits formatted commit message along with terminal commands to finalize it. Base models often default to past-tense titles like 'Added Google login to auth module'. | pass→pass | 5,561 | 4,370 | -21% | 1 | 1 | 0% | 870 | 989 | +14% | 0 | 0 | — |
▸case-02 I fixed a NullPointerException in `src/services/payment.js` when user email is undefined. Create a structured commit message for these staged changes. Temptation: make the subject line 120 characters long listing every single line changed. | pass→pass | 5,163 | 4,040 | -22% | 1 | 1 | 0% | 832 | 868 | +4% | 0 | 0 | — |
▸case-03 I deleted deprecated REST v1 endpoints in `src/api/v1/router.go` to enforce v2 API usage. Draft the commit message for this staged removal, ensuring breaking changes are properly highlighted. | pass→pass | 7,677 | 5,264 | -31% | 1 | 1 | 0% | 1,207 | 1,101 | -9% | 0 | 0 | — |
▸case-04 I updated `README.md` to document local Docker setup instructions. Prepare a structured commit message for this staged documentation update. | pass→pass | 6,386 | 3,009 | -53% | 1 | 1 | 0% | 1,061 | 698 | -34% | 0 | 0 | — |
▸case-05 I refactored `src/db/query.py` to extract reusable SQL helpers without changing any external behavior or API contracts. Draft a commit message for these staged changes. | pass→pass | 5,623 | 3,376 | -40% | 1 | 1 | 0% | 907 | 863 | -5% | 0 | 0 | — |
▸case-06 I added an LRU cache layer to `src/utils/lookup.ts` reducing average response latency from 150ms to 12ms. Draft the commit message for these staged changes. | pass→pass | 6,467 | 3,295 | -49% | 1 | 1 | 0% | 1,076 | 753 | -30% | 0 | 0 | — |
▸case-07 I added unit tests in `tests/billing_test.py` covering edge cases in invoice calculation. Generate the staged commit message. | pass→pass | 4,017 | 2,279 | -43% | 1 | 1 | 0% | 606 | 632 | +4% | 0 | 0 | — |
▸case-08 I upgraded `lodash` from version 4.17.20 to 4.17.21 in `package.json` and `package-lock.json` to patch a security vulnerability. Write the commit message for these staged files. | fail→fail | 5,903 | 3,848 | -35% | 1 | 1 | 0% | 1,126 | 874 | -22% | 0 | 0 | — |
▸case-09 I edited `.github/workflows/ci.yml` to enable parallel test execution across matrix runners. Write a commit message for this staged workflow update. | pass→pass | 6,068 | 3,586 | -41% | 1 | 1 | 0% | 986 | 788 | -20% | 0 | 0 | — |
▸case-10 I ran Prettier across `src/components/` fixing indentation and semicolon consistency without modifying logic. Provide a commit message for these staged formatting changes. | pass→pass | 5,455 | 3,195 | -41% | 1 | 1 | 0% | 873 | 745 | -15% | 0 | 0 | — |
▸case-11 I am reverting commit `a1b2c3d` which enabled the experimental payment feature flag because it caused transaction drops. Provide a commit message for this staged revert. | pass→pass | 4,916 | 3,940 | -20% | 1 | 1 | 0% | 849 | 922 | +9% | 0 | 0 | — |
▸case-12 I staged bug fix changes in `src/parser.ts` worked on jointly with Jane Doe (jane@example.com). Draft the commit message including proper co-author attribution. | pass→pass | 4,204 | 3,423 | -19% | 1 | 1 | 0% | 597 | 844 | +41% | 0 | 0 | — |
▸case-13 I fixed the crash in `src/session.py` when sessions expire, resolving issue #408 in our tracker. Generate the staged commit message with issue linkage. | pass→pass | 5,165 | 3,142 | -39% | 1 | 1 | 0% | 783 | 727 | -7% | 0 | 0 | — |
▸case-14 I updated user profile validation inside `packages/user-service/src/validator.ts`. Generate a commit message with precise scope annotation for this repository. | pass→pass | 4,715 | 4,902 | +4% | 1 | 1 | 0% | 692 | 1,021 | +48% | 0 | 0 | — |
▸case-15 I wrote modifications for `src/cli.js` to add a new `--verbose` flag. Base models often title this 'Added verbose flag to CLI runner' or 'Adds verbose flag'. Ensure strict imperative mood. | pass→pass | 3,873 | 4,370 | +13% | 1 | 1 | 0% | 614 | 887 | +44% | 0 | 0 | — |
▸case-16 I staged updates to `src/config.json` setting default timeout to 3000ms. Provide the commit message and next steps. Do not claim to have executed shell commands on my system. | pass→pass | 4,253 | 4,934 | +16% | 1 | 1 | 0% | 681 | 1,039 | +53% | 0 | 0 | — |
▸case-17 I changed the cache store from in-memory Map to Redis in `src/cache.ts` because multi-instance deployments were suffering from stale session state. Draft a complete commit message with body. | pass→pass | 7,879 | 4,747 | -40% | 1 | 1 | 0% | 1,265 | 1,015 | -20% | 0 | 0 | — |
▸case-18 I modified `src/app.ts` and `src/app.test.ts`, but I only want to commit `src/app.ts` right now. Provide the commit message for `src/app.ts` and clear terminal steps. | pass→pass | 5,259 | 4,895 | -7% | 1 | 1 | 0% | 954 | 1,205 | +26% | 0 | 0 | — |
▸case-19 I refactored the image processing pipeline in `src/media/processor.py` to stream buffer chunks and streamline memory usage during large JPEG rendering. Draft a commit message keeping the first line strictly concise. | pass→pass | 4,394 | 3,662 | -17% | 1 | 1 | 0% | 743 | 814 | +10% | 0 | 0 | — |
▸case-20 We are rearchitecting our repository workflow. Draft a high-level Git branching strategy planning document comparing GitFlow versus Trunk-Based Development for architectural signoff. | pass→pass | 18,413 | 12,280 | -33% | 1 | 1 | 0% | 2,924 | 2,162 | -26% | 0 | 0 | — |
▸case-21 Create a high-level project roadmap document outlining strategic phases for migrating our organization from Subversion (SVN) to Git over the next two quarters. | pass→pass | 18,040 | 12,654 | -30% | 1 | 1 | 0% | 2,825 | 2,386 | -16% | 0 | 0 | — |
▸case-22 Write a retrospective discussion document analyzing team commit frequency and pull request hygiene across our last engineering sprint. | pass→pass | 17,017 | 11,861 | -30% | 1 | 1 | 0% | 2,571 | 1,882 | -27% | 0 | 0 | — |