Widely used test frameworks in software development lack a standard for test results data output. Each test framework represents results output in a custom format. While most test frameworks offer a listener or emit events to provide programmatic access to results data once it is generated, these interfaces are also entirely custom to each test framework.
The closest to a standard is the JUnit XML format. Several test frameworks offer an option for outputting results to this data format. This is useful. The two main drawbacks are that some parser tools fail when custom fields are present and that over time the JSON data format has become more widely used than XML.
Tesults develops test framework integrations for submitting data to the Tesults service for analysis and reporting. All of the integrations transform custom data output by test frameworks to a standard JSON format that is then used to transmit results data to Tesults. When the Tesults API is utilized for data retrieval, the same standard JSON format is used in the response.
The Tesults JSON data standard defines a JSON format for specifying results output. It is simple and easy to understand and implement and has been used by Tesults for several years now with success. In the absence of any other common JSON test results format, test framework authors should consider supporting the format specified for outputting results data.
Data standards play a crucial role in ensuring that data is accurate, consistent, and interoperable, which is essential for efficient and effective data management.
The Tesults JSON data standard is used for the core Tesults service, APIs and test framework integrations for popular test frameworks. If you are a test framework author and have questions or feedback please contact firstname.lastname@example.org.