Changelog

Version 0.3.4

  • New Feature: Sharded Environment Preservation: Complete tracking of all shard environments in merged reports.
  • Improved: Modern Environment Dashboard Redesign: A visually appealing and user-friendly redesign of the environment section of dashboard, with detailed bullet points.
  • Improved: Test skipped steps display: Complete step visibility for all test outcomes (passed, failed, skipped), Clear identification of failure/skip points in test execution & Better debugging experience with full execution context.
  • Improved: Retry History: Added retry history to the JSON report, which will show the retry history of individual tests.
  • Improved: Retry Count: Added retry count to the HTML report(s), which will show the retry count of individual tests, in Test Run Summary Tab.
  • Improved: Failed Test pointer: Added failed test pointer to the HTML report(s), which will show the exact code snippet at which the test failed.
  • Improved: Test Step Code Snippet: Added test step code snippet to the HTML report(s), which will show the exact code snippet of individual test step.
  • Improved: Enhanced CLI experience: Added new "logo" in CLI command execution and "pulse-logo" binary to package.json for direct logo display. Remove emoji from success messages for cleaner output.
  • Improved:Flaky Test Card:Added flaky test card to the HTML report(s), which will show the flaky test count in the Dashboard Tab.
  • Improved:Added Flaky test in charts:Added flaky test in charts present everywhere in the HTML report(s), which now considers the flaky test count in the all tabs.
  • Improved:Added Image compression:Added compression to the HTML report(s), which will compress the images in the report, so that 1000+ failed test cases with attached screenshots in attachments folder, will not make the report size too large.
  • Fix: Fixed Browser Distribution chart: Fixed the browser distribution chart to show the correct/full name in distribution of browsers. Also, max 3 browsers will be shown in the chart, if more than 3 browsers are used, then the chart will show the top 3 browsers and the rest will be shown as "+X more browsers" format.
  • Fix: Minor fixes in Documentation: "View Reporter Images" tab addition in the documentation.
  • Fix: Removed "unknown" test status: Removed "❓ unknown" test status option from the email HTML report, replaced with "⚠ flaky" based on the test outcome.

Version 0.3.3

  • New Feature: New cards: Added 2 new cards to the report dashboard, "Retry Count" and "Browser Distribution" for better visualization of the test results.
  • Improved: Email Template: Modernized the email template for emailable reports with improved styling and layout.
  • Improved: Enhanced UI update: Refined the user interface of both the report templates for better user experience and ease of navigation.
  • Improved: Eliminated `Expand All` and `Collapse All` buttons: Removed the expand all and collapse all buttons from the report's Test Run Summary tab to simplify the user interface and reduce confusion.
  • Improved: Easy Sharding: Resolving the complex sharding technique to make it easier for users to understand and implement. Now, just keep all the shard generated reports in a single directory and run the merge command to get the final merged json report.
  • Improved: Significantly improved Documentation: Enhanced the documentation to provide clear instructions and examples for using the sharding feature, making it easier for users to implement and manage their test suites, in CI/CD or, local. Visit Documentation Website for more details.
  • Fix: Fixed send email issue for merged report: Resolved the problem where the send report script failed to send emails for merged reports after multiple shards.
  • Fix: Fixed all kind of vulnerabilities: Addresses security concerns by updating dependencies to their latest versions, removing deprecated packages, and following best practices for secure coding. No Open Source Security Issue, No Code Security Issue, No Configuration Issue.

Version 0.3.2

  • Repository Update: Repository is public now, [Arghajit47/playwright-pulse](https://github.com/Arghajit47/playwright-pulse). Go ahead, take a look and contribute!
  • Fix: AGPL license related issues in dependency package.

Version 0.3.1

  • New Feature: Granular Duration Insights: Added "Duration by Spec files" and "Duration by Test Describe" charts to Execution Trends.
  • New Feature: Severity-Driven Reporting: Introduced pulse.severity helper to capture Minor to Critical test severity. Just add import {pulse} from '@arghajit/playwright-pulse-report into your test spec files.
  • New Feature: Severity Badges: Visualized severity in HTML, static, and email reports with color-coded badges.
  • New Feature: Severity Distribution Chart: Added a stacked column chart to the Dashboard showing results by severity level.
  • New Feature: Email Improvements: Added tag badges and severity indicators to email summaries.
  • New Feature: Custom SMTP Support: The send email report now supports custom credentials via environment variables (PULSE_MAIL_HOST, PULSE_MAIL_USERNAME, PULSE_MAIL_PASSWORD), allowing direct integration with Gmail and Outlook without manual credential fetching. If nothing mentioned in the environment variables, the reporter will fallback to the old default mechanism.
  • Improved: Performance: Applied lazy loading (IntersectionObserver) to duration charts.
  • Improved: Visual Consistency: Aligned charts with the orange accent theme and improved tooltip styling.
  • Improved: DX-Friendly Exports: Re-exported pulse helper and types for easier import.
  • Improved: Typed Severity: Extended TestResult with a strongly-typed severity field.
  • Improved: Static Report Performance: Enhanced static report loading speed by implementing lazy loading for detailed test case content.

Version 0.3.0

  • New Feature: Custom Annotations Support - Added full support for Playwright test annotations in reports with dedicated styling, showing Type, Description, and Location details.
  • New Feature: JIRA/Ticket System Integration - Clickable links for "issue" or "bug" type annotations that automatically detect JIRA tickets and open tickets in new browser tabs.
  • New Feature: Dynamic Output Directory Support - All CLI scripts now accept --outputDir (or -o) argument for custom output directories, supporting any folder name or nested path structure.
  • New Feature: Copy AI Prompt Button - Added "Copy AI Prompt" button in AI Failure Analyzer that copies a complete, ready-to-use prompt with instructions and test details for use with any AI tool (ChatGPT, Claude, Gemini, etc.).
  • Improved: Migrated from Google Gemini API to Groq API with llama-3.3-70b-versatile model for faster and more accurate AI failure analysis.
  • Improved: Enhanced TestResult interface with annotations field for comprehensive test metadata capture.
  • Improved: Improved CLI scripts architecture to support dynamic directory paths across all commands.
  • Improved: Automatic Config Detection - CLI scripts now automatically read outputDir from playwright.config file, eliminating the need to manually pass -o argument, unless overriding is needed.
  • Improved: Optimized API configuration with OpenAI-compatible endpoints and refined parameters.
  • Improved: Beautiful purple/violet themed annotations section for better visual distinction in reports.

Version 0.2.10

  • Fixed: Static report attachments - Other attachments are now properly opened in new tabs in static reports.
  • Fixed: Security vulnerabilities - Resolved low severity npm package vulnerabilities.

Version 0.2.9

  • Improved: send report feature.

Version 0.2.8

  • Improved: Readme file detailed setup instructions and comprehensive usage examples for better onboarding.
  • Updated: development dependencies to latest stable versions.
  • Updated: Node.js engine requirement for enhanced compatibility.
  • Updated: retry attempts for credential fetching in `send-report`, to handle transient network issues.
  • Fixed: "Skipping email sending due to missing or failed credential fetch" issue in send report workflow.
  • Security: Updated dependencies to address security vulnerabilities in the npm package.

Version 0.2.6

  • Improved: Debug logging with entire test code snippet is now attached to the failed test cases.
  • Improved: Official documentation where all the functionalities are explained with required code snippets and with new refreshed UI.

Version 0.2.5

  • Added: Test Distribution by Worker chart, which shows Total no. of skipped, passed and failed test cases in Test History tab, for both static and attachment based report.
  • Added: Copy Console for Console Log (stdout) for each test.
  • Added: View options to All kind of attachments for both static and attachment based report.
  • Improvements: Optimized report generation for large datasets. Added accurate browser name, version, and OS to test suites.
  • Improvements: Revamped the entire UI design of Documentation website.
  • Improvements: Changed The logo for the Playwright Pulse Report, throughout all the reporters.
  • Bug Fixes: Resolved issues with failed to load attachments in static report.
  • Bug Fixes: Fixed issues with Copy Prompt button, in Test Details tab.

Version 0.2.4

  • Improvements: Added resetOnEachRun config variable to handle Test sequential run, default value is true.
  • Documentation: Added Gitlab, jenkins CI/CD workflow in the documentation website.

Version 0.2.3

  • Added: Support for HTML, JSON, TEXT, CSV, and PDF file attachments.
  • Improvements: Optimized report generation for large datasets. Added accurate browser name, version, and OS to test suites.

Version 0.2.2

  • Added: Introduced System Information widget to visualize details about the test execution environment.
  • Enhanced Analytics: Improved accuracy in history trend calculations.

Version 0.2.1

  • Feature: Added history trends for the last 15 runs for test suites, suite duration, and individual tests.
  • Fixed: Corrected Project Name components in the test suite view.

Version 0.2.0

  • Major Update: Refined UI for static HTML reports and implemented History Trends.

Version 0.1.6

  • Update: Initial release of stable reporter features.

Version 0.1.5

  • Fix: Resolved path resolution issues for attachments.

Version 0.1.4

  • Feature: Added support for custom output directories.

Version 0.1.3

  • Improvement: Enhanced error formatting in the console log.

Version 0.1.2

  • Fix: Corrected JSON data structure for empty runs.

Version 0.1.1

  • Initial Release: Beta launch of the Playwright Pulse Reporter.

Support & Credits

For any issues, bug reports, or feature requests, please contact me, Arghajit Singha, via email at arghajitsingha47@gmail.com.

Special thanks to Suman Vishwakarma for continuous UAT feedback and support.