Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Playwright E2E testing patterns, Page Object Model, configuration, CI/CD integration, artifact management, and flaky test strategies.
.claude/skills/loulanyue-e2e-testing/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-10 | ✗→✓ | ▲ Improved | 86% | 0% |
| case-11 | ✗→✓ | ▲ Improved | 99% | 0% |
| case-13 | ✗→✓ | ▲ Improved | 91% | 0% |
| case-20 | ✗→✓ | ▲ Improved | 66% | 0% |
| case-03 | ✓→✓ | = Same ✓ | 77% | 0% |
Comprehensive Playwright patterns for building stable, fast, and maintainable E2E test suites.
tests/
├── e2e/
│ ├── auth/
│ │ ├── login.spec.ts
│ │ ├── logout.spec.ts
│ │ └── register.spec.ts
│ ├── features/
│ │ ├── browse.spec.ts
│ │ ├── search.spec.ts
│ │ └── create.spec.ts
│ └── api/
│ └── endpoints.spec.ts
├── fixtures/
│ ├── auth.ts
│ └── data.ts
└── playwright.config.tstypescriptimport { Page, Locator } from '@playwright/test' export class ItemsPage { readonly page: Page readonly searchInput: Locator readonly itemCards: Locator readonly createButton: Locator constructor(page: Page) { this.page = page this.searchInput = page.locator('[data-testid="search-input"]') this.itemCards = page.locator('[data-testid="item-card"]') this.createButton = page.locator('[data-testid="create-btn"]') } async goto() { await this.page.goto('/items') await this.page.waitForLoadState('networkidle') } async search(query: string) { await this.searchInput.fill(query) await this.page.waitForResponse(resp => resp.url().includes('/api/search')) await this.page.waitForLoadState('networkidle') } async getItemCount() { return await this.itemCards.count() } }
typescriptimport { test, expect } from '@playwright/test' import { ItemsPage } from '../../pages/ItemsPage' test.describe('Item Search', () => { let itemsPage: ItemsPage test.beforeEach(async ({ page }) => { itemsPage = new ItemsPage(page) await itemsPage.goto() }) test('should search by keyword', async ({ page }) => { await itemsPage.search('test') const count = await itemsPage.getItemCount() expect(count).toBeGreaterThan(0) await expect(itemsPage.itemCards.first()).toContainText(/test/i) await page.screenshot({ path: 'artifacts/search-results.png' }) }) test('should handle no results', async ({ page }) => { await itemsPage.search('xyznonexistent123') await expect(page.locator('[data-testid="no-results"]')).toBeVisible() expect(await itemsPage.getItemCount()).toBe(0) }) })
typescriptimport { defineConfig, devices } from '@playwright/test' export default defineConfig({ testDir: './tests/e2e', fullyParallel: true, forbidOnly: !!process.env.CI, retries: process.env.CI ? 2 : 0, workers: process.env.CI ? 1 : undefined, reporter: [ ['html', { outputFolder: 'playwright-report' }], ['junit', { outputFile: 'playwright-results.xml' }], ['json', { outputFile: 'playwright-results.json' }] ], use: { baseURL: process.env.BASE_URL || 'http://localhost:3000', trace: 'on-first-retry', screenshot: 'only-on-failure', video: 'retain-on-failure', actionTimeout: 10000, navigationTimeout: 30000, }, projects: [ { name: 'chromium', use: { ...devices['Desktop Chrome'] } }, { name: 'firefox', use: { ...devices['Desktop Firefox'] } }, { name: 'webkit', use: { ...devices['Desktop Safari'] } }, { name: 'mobile-chrome', use: { ...devices['Pixel 5'] } }, ], webServer: { command: 'npm run dev', url: 'http://localhost:3000', reuseExistingServer: !process.env.CI, timeout: 120000, }, })
typescripttest('flaky: complex search', async ({ page }) => { test.fixme(true, 'Flaky - Issue #123') // test code... }) test('conditional skip', async ({ page }) => { test.skip(process.env.CI, 'Flaky in CI - Issue #123') // test code... })
bashnpx playwright test tests/search.spec.ts --repeat-each=10 npx playwright test tests/search.spec.ts --retries=3
Race conditions:
typescript// Bad: assumes element is ready await page.click('[data-testid="button"]') // Good: auto-wait locator await page.locator('[data-testid="button"]').click()
Network timing:
typescript// Bad: arbitrary timeout await page.waitForTimeout(5000) // Good: wait for specific condition await page.waitForResponse(resp => resp.url().includes('/api/data'))
Animation timing:
typescript// Bad: click during animation await page.click('[data-testid="menu-item"]') // Good: wait for stability await page.locator('[data-testid="menu-item"]').waitFor({ state: 'visible' }) await page.waitForLoadState('networkidle') await page.locator('[data-testid="menu-item"]').click()
typescriptawait page.screenshot({ path: 'artifacts/after-login.png' }) await page.screenshot({ path: 'artifacts/full-page.png', fullPage: true }) await page.locator('[data-testid="chart"]').screenshot({ path: 'artifacts/chart.png' })
typescriptawait browser.startTracing(page, { path: 'artifacts/trace.json', screenshots: true, snapshots: true, }) // ... test actions ... await browser.stopTracing()
typescript// In playwright.config.ts use: { video: 'retain-on-failure', videosPath: 'artifacts/videos/' }
yaml# .github/workflows/e2e.yml name: E2E Tests on: [push, pull_request] jobs: test: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: actions/setup-node@v4 with: node-version: 20 - run: npm ci - run: npx playwright install --with-deps - run: npx playwright test env: BASE_URL: ${{ vars.STAGING_URL }} - uses: actions/upload-artifact@v4 if: always() with: name: playwright-report path: playwright-report/ retention-days: 30
markdown# E2E Test Report **Date:** YYYY-MM-DD HH:MM **Duration:** Xm Ys **Status:** PASSING / FAILING ## Summary - Total: X | Passed: Y (Z%) | Failed: A | Flaky: B | Skipped: C ## Failed Tests ### test-name **File:** `tests/e2e/feature.spec.ts:45` **Error:** Expected element to be visible **Screenshot:** artifacts/failed.png **Recommended Fix:** [description] ## Artifacts - HTML Report: playwright-report/index.html - Screenshots: artifacts/*.png - Videos: artifacts/videos/*.webm - Traces: artifacts/*.zip
typescripttest('wallet connection', async ({ page, context }) => { // Mock wallet provider await context.addInitScript(() => { window.ethereum = { isMetaMask: true, request: async ({ method }) => { if (method === 'eth_requestAccounts') return ['0x1234567890123456789012345678901234567890'] if (method === 'eth_chainId') return '0x1' } } }) await page.goto('/') await page.locator('[data-testid="connect-wallet"]').click() await expect(page.locator('[data-testid="wallet-address"]')).toContainText('0x1234') })
typescripttest('trade execution', async ({ page }) => { // Skip on production — real money test.skip(process.env.NODE_ENV === 'production', 'Skip on production') await page.goto('/markets/test-market') await page.locator('[data-testid="position-yes"]').click() await page.locator('[data-testid="trade-amount"]').fill('1.0') // Verify preview const preview = page.locator('[data-testid="trade-preview"]') await expect(preview).toContainText('1.0') // Confirm and wait for blockchain await page.locator('[data-testid="confirm-trade"]').click() await page.waitForResponse( resp => resp.url().includes('/api/trade') && resp.status() === 200, { timeout: 30000 } ) await expect(page.locator('[data-testid="trade-success"]')).toBeVisible() })
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-01 | fail→fail | 16,102 | 10,921 | -32% | 1 | 1 | 0% | 3,140 | 4,664 | +49% | 0 | 0 | — |
case-02 | fail→fail | 16,092 | 14,837 | -8% | 1 | 1 | 0% | 2,678 | 5,163 | +93% | 0 | 0 | — |
case-03 | pass→pass | 17,415 | 18,000 | +3% | 1 | 1 | 0% | 3,428 | 6,051 | +77% | 0 | 0 | — |
case-04 | pass→pass | 15,654 | 17,549 | +12% | 1 | 1 | 0% | 2,799 | 5,810 | +108% | 0 | 0 | — |
case-05 | pass→pass | 11,825 | 8,846 | -25% | 1 | 1 | 0% | 2,136 | 4,057 | +90% | 0 | 0 | — |
case-06 | pass→pass | 16,458 | 10,647 | -35% | 1 | 1 | 0% | 2,857 | 4,390 | +54% | 0 | 0 | — |
case-07 | pass→pass | 12,313 | 10,257 | -17% | 1 | 1 | 0% | 2,064 | 4,270 | +107% | 0 | 0 | — |
case-08 | pass→pass | 11,526 | 9,637 | -16% | 1 | 1 | 0% | 1,857 | 4,168 | +124% | 0 | 0 | — |
case-09 | fail→fail | 17,393 | 19,124 | +10% | 1 | 1 | 0% | 3,491 | 6,162 | +77% | 0 | 0 | — |
case-10 | fail→pass | 13,309 | 8,765 | -34% | 1 | 1 | 0% | 2,105 | 3,923 | +86% | 0 | 0 | — |
case-11 | fail→pass | 14,684 | 11,037 | -25% | 1 | 1 | 0% | 2,298 | 4,571 | +99% | 0 | 0 | — |
case-12 | fail→fail | 15,874 | 16,660 | +5% | 1 | 1 | 0% | 2,696 | 5,395 | +100% | 0 | 0 | — |
case-13 | fail→pass | 9,669 | 5,313 | -45% | 1 | 1 | 0% | 1,745 | 3,340 | +91% | 0 | 0 | — |
case-14 | pass→pass | 9,775 | 5,482 | -44% | 1 | 1 | 0% | 1,818 | 3,480 | +91% | 0 | 0 | — |
case-15 | pass→pass | 9,536 | 4,402 | -54% | 1 | 1 | 0% | 1,558 | 3,191 | +105% | 0 | 0 | — |
case-16 | pass→pass | 8,301 | 5,384 | -35% | 1 | 1 | 0% | 1,655 | 3,435 | +108% | 0 | 0 | — |
case-17 | pass→pass | 9,526 | 8,306 | -13% | 1 | 1 | 0% | 1,695 | 4,008 | +136% | 0 | 0 | — |
case-18 | fail→fail | 11,396 | 7,717 | -32% | 1 | 1 | 0% | 2,056 | 3,814 | +86% | 0 | 0 | — |
case-19 | pass→pass | 9,930 | 5,123 | -48% | 1 | 1 | 0% | 1,889 | 3,351 | +77% | 0 | 0 | — |
case-20 | fail→pass | 16,113 | 11,963 | -26% | 1 | 1 | 0% | 2,717 | 4,512 | +66% | 0 | 0 | — |
case-21 | pass→pass | 15,371 | 12,861 | -16% | 1 | 1 | 0% | 2,745 | 4,852 | +77% | 0 | 0 | — |
case-22 | fail→fail | 15,604 | 14,184 | -9% | 1 | 1 | 0% | 2,388 | 4,851 | +103% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted. The headline lift of +18 percentage points is the difference between those two pass rates over the 22 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.