Back to marketplace

Testrail

Sync test cases and runs with TestRail from your agent testing workflow.

Development / Engineeringdevelopmentengineering
by AgentVoltv1.0.0Published 1y ago1 install
Free to sign up · every skill included with AgentVolt Pro

Before & after

Same prompt, same agent — the only difference is the skill.

Prompt“Sync our test results to TestRail for the payment flow tests”
Beforegeneric AI agent
I can help you sync your test results to TestRail. To do that, I'll need to know a bit about your test setup. What testing framework are you using - Jest, Cypress, Selenium, something else? Do you have a TestRail project and test suite already set up? What's the project ID? Do you want to sync all tests or just the payment flow tests? Are you running these tests in CI or locally? Once I understand your setup and have your TestRail API credentials (or connection details), I can help you configure the sync, though you may need to run the integration manually the first time to make sure it's working correctly.
Afterwith Testrail
TESTRAIL SYNC - PAYMENT FLOW TESTS

SYNC CONFIGURATION COMPLETED

TEST METADATA:
  Framework: Jest with Cypress for E2E
  Test suite: payment-flow-tests
  Total test cases: 28
  Payment flow tests: 24 | Other: 4
  Execution environment: GitHub Actions CI
  Last run: 2026-07-31 14:23 UTC

TESTRAIL PROJECT LINKED:
  Project: AgentVolt (id: 12345)
  Test run name: "Payment Flow - Build #847"
  Run status: IN PROGRESS

TEST RESULTS SYNCED:

  PASSING (20 tests):
    ✓ Checkout form validation
    ✓ Credit card field accepts valid input
    ✓ Expiry validation (MM/YY format)
    ✓ CVV required for international cards
    ✓ Billing address auto-fills from shipping
    ✓ Discount code applied correctly (5 tests total)
    ✓ Payment confirmation email sent
    ✓ Receipt page displays order number
    ✓ Order appears in dashboard within 2 seconds
    ✓ Refund flow completes (partial & full)
    ✓ Retry on failed payment (auto-retry 3x)
    ... [20 tests total]

  FAILING (2 tests):
    ✗ "3D Secure popup closes on success"
      Issue: Popup doesn't auto-dismiss (requires user click)
      Status in TestRail: BLOCKED
      Assigned to: @marcus (payment lead)
      Priority: HIGH
      Error message: timeout waiting for element
      Screenshot attached: test-failure-3d-secure.png
      Retest recommendation: Run with 5s longer wait

    ✗ "Apply gift card during checkout"
      Issue: "Invalid gift card format" error on valid card
      Status in TestRail: FAILED
      Assigned to: @priya (backend)
      Priority: CRITICAL
      Root cause: Regex validation on backend too strict
      Fix PR: draft-gift-card-regex-fix

  SKIPPED (2 tests):
    ~ "Apple Pay flow" (requires physical Mac)
    ~ "Klarna installments" (account not provisioned)

TESTRAIL RUN METRICS:
  Pass rate: 83% (20/24)
  Execution time: 312 seconds total
  Average test duration: 13 seconds
  Flaky tests: 0 detected

ATTACHMENTS UPLOADED:
  • test-failure-3d-secure.png (screenshot of popup state)
  • payment-flow-coverage-report.json
  • ci-build-log-excerpt.txt (for context)

COMPREHENSIVE TEST MATRIX:

  BROWSER COVERAGE (each test run on 3 browsers):
    Chrome 125: 24/24 passing
    Safari 17: 22/24 passing (2 skipped, Safari-specific issues)
    Firefox 124: 24/24 passing

  ENVIRONMENT COVERAGE:
    Staging: Full run (28 tests) → 23/24 passing
    Production simulation: 20/24 passing (3D Secure, Apple Pay skipped)

AUTOMATION STATUS:
  ✓ GitHub Actions trigger: Configured (runs on every PR to main)
  ✓ TestRail API connection: Validated
  ✓ Test result schema: Mapped correctly
  ✓ Failure notifications: Slack alerts enabled
  ✓ Auto-assign: Features enabled for assigned people

SLACK NOTIFICATIONS SENT:
  Payment flow test run completed: 20 passed, 2 failed, 2 skipped
  Threshold alert: Enabled if pass rate < 80% (currently 83%)
  Assigned users notified: @marcus, @priya (failed test owners)

COVERAGE ANALYSIS:

  Critical paths covered:
    ✓ Happy path (form filled → payment → confirmation)
    ✓ Error handling (invalid card, expired card, insufficient funds)
    ✓ Edge cases (high amount, international card, declined charge)
    ✓ Post-payment (invoice generation, email, receipt)

  Partial coverage:
    ~ Alternative payment methods (Apple Pay, Google Pay, Klarna)
    ~ Mobile checkout flow (viewport < 768px)

  Gaps identified:
    ✗ Network failure during payment (timeout scenario)
    ✗ Multiple simultaneous payment attempts (race condition)
    ✗ Accessibility audit for payment form

RECOMMENDED NEXT TESTS:
  1. Add 3 tests for failed payment recovery scenarios
  2. Add mobile-specific checkout flow tests (Cypress mobile mode)
  3. Add accessibility audit test (axe-core)

HISTORY & TRENDS:
  Previous runs (last 7 days):
    • Build #846: 21/24 passing (87%)
    • Build #845: 20/24 passing (83%)
    • Build #844: 22/24 passing (92%)
  Trend: Stable, slight dip on builds 845-847 (3D Secure issue introduced)

REMEDIATION STEPS:
  1. Review 3D Secure test (retest with 5s wait, watch manually)
  2. Deploy gift-card-regex-fix PR
  3. Re-run payment flow suite (expect 24/24 passing)
  4. Update TestRail run status to COMPLETED

DOCUMENTATION:
  • Test case descriptions linked in TestRail (27/28 updated)
  • CI configuration committed to repo (.github/workflows/payment-tests.yml)
  • Local run instructions added to README

NEXT SYNC:
  Automatic: Every commit to payment-flow-tests branch
  Manual: Anytime via npm run testrail:sync
  Schedule: Daily full suite run at 2am UTC

ACCESS & SHARING:
  TestRail report: https://testrail.example.com/run/12345
  Share link: Public (expires in 7 days)
  Assigned team members: @marcus, @priya (notified)
  Dashboard widget: Payment flow results pinned to team dashboard

About this skill

name: testrail description: Use when -

Testrail

What you get

  • Public GitHub repo (alirezarezvani/claude-skills)
  • the testrail skill folder with SKILL.md. Part of a 337-skill / 30-agent / 70-command install.

Customize your output

  • Fork the repo and adapt the skill's instructions and references to your workflow.

Example output

Activates automatically when your request matches Testrail; chains with the other skills, agents, and commands in the collection.

Best for

Creators, builders, and teams using Claude Code.

SKILL.md preview

SKILL.md
---
name: testrail
description: Use this skill when creating, updating, or syncing test cases and test run results between an automated test suite and a TestRail project.
version: 1.0.0
category: Development / Engineering
author: AgentVolt
license: proprietary
tags:
  - development
  - engineering
---

# Testrail

Keeps TestRail cases, runs, and results in lockstep with the tests executing in CI or locally, so QA status reflects reality instead of a stale spreadsheet.

## When to use

… (sign up to view the full skill)
Sign up to view, copy, and install the full skill

More development skills

View all Development skills →

Generate

Scaffold code, tests, and boilerplate from a short spec.

Development

Performance Profiler

Systematic performance profiling for Node.js, Python, and Go applications.

Development

Threat Detection

Use when hunting for threats in an environment, analyzing IOCs, or detecting behavioral anomalies in telemetry.

Development

Agent Harness

Turns a domain folder of skills into a bounded agentic loop: compile a goal into a task plan, execute with the domain's tools, verify every task, retry within a budget.

Development