Test Run, Results & Test Information Modal
Learn how to execute your tests, interpret results, and access detailed test information in Maeris. This guide covers everything you need to know about running tests and analyzing outcomes.
Running Tests
There are several ways to execute tests in Maeris, depending on your needs and workflow.
Run Individual Test
Execute a single test case from the Notebook.
- Navigate to the Notebook
- Click on the test you want to run
- Click the "Run" button or use the play icon
- Monitor execution in real-time
Run Multiple Tests
Select and run multiple tests simultaneously.
- Select multiple tests using checkboxes
- Click "Run Selected" from the toolbar
- Tests will execute in parallel or sequentially based on configuration
Run Test Suite
Execute an entire test suite or regression pack.
Use the "Run Suite" option to execute all tests in a selected group or tag.
Test Execution Process
Execution Stages
- Initialization: Maeris prepares the test environment
Browser launch, environment setup, variable initialization
- Pre-Test Hooks: Execute any configured "Before Each" hooks
API calls, authentication, test data setup
- Test Steps: Execute each test step sequentially
Navigate, click, type, verify actions
- Post-Test Hooks: Execute any configured "After Each" hooks
Cleanup, data reset, API calls
- Result Generation: Compile results, screenshots, and logs
Generate report, capture screenshots, save execution data
Understanding Test Results
Passed Tests
A test passes when all steps execute successfully and all verifications are met. You'll see a green indicator and can review the execution details.
Failed Tests
A test fails when a step cannot be completed or a verification fails. Common failure reasons include:
- Element not found (selector issue)
- Timeout waiting for element
- Verification assertion failed
- Application error or unexpected behavior
Skipped Tests
Tests may be skipped due to prerequisites not being met, conditional logic, or manual skip configuration.
Test Information Modal
The Test Information Modal provides comprehensive details about your test case, including configuration, execution history, and results.
Modal Sections
- Test Overview: Basic information, description, tags, and status
- Test Steps: Detailed view of all test steps with selectors and actions
- Execution History: Complete history of all test runs with timestamps and results
- Latest Results: Detailed breakdown of the most recent test execution
- Screenshots: Visual evidence from test execution
- Logs: Detailed execution logs for debugging
- Configuration: Test settings, browser, environment, and timeouts
Result Details
What You'll See
- Execution Time: Total time taken to run the test
- Step-by-Step Results: Status of each individual step
- Screenshots: Visual snapshots at key points during execution
- Error Messages: Detailed error information for failed steps
- Network Logs: API calls and network activity during test execution
- Console Logs: Browser console messages and errors
- Performance Metrics: Page load times and performance data
Interpreting Results
- Review screenshots to see what happened at each step
- Check error messages to understand why a step failed
- Compare with previous runs to identify trends
- Use logs to debug issues and understand test behavior
Viewing Execution History
Access the complete execution history for any test to track performance over time and identify patterns.
- View all past executions with dates and times
- See pass/fail trends over time
- Compare execution times across runs
- Access historical screenshots and logs
- Identify flaky tests or intermittent failures
Best Practices
- Review Results Promptly: Check test results soon after execution to catch issues early
- Use Screenshots: Screenshots provide valuable context for understanding test behavior
- Analyze Logs: Detailed logs help diagnose complex issues
- Track Trends: Monitor execution history to identify patterns and flaky tests
- Document Failures: Note common failure patterns to improve test reliability
- Compare Runs: Compare current results with previous successful runs to identify changes
Next Steps
Now that you understand test execution and results:
- Reporting and Dashboard - Get comprehensive analytics and insights
- Fix My Test - Learn how to troubleshoot and fix failing tests
- Schedule Your Regression - Automate test execution