Summary: | ASTERISK-18437: TestSuite: Framework: Add post-test data collection and analysis | ||
Reporter: | Matt Jordan (mjordan) | Labels: | |
Date Opened: | 2011-09-06 16:18:52 | Date Closed: | |
Priority: | Major | Regression? | No |
Status: | Open/New | Components: | Tests/testsuite |
Versions: | Frequency of Occurrence | ||
Related Issues: | |||
Environment: | Attachments: | ||
Description: | Working with the implementation of ASTERISK-18428, design a framework that supports data collection of test results and data. Data collection may also include managing and collecting data from off-nominal situations (backtraces) and 3rd party tools, such as packet captures or valgrind. A post-test analysis framework should allow for test data that is collected to be sent through analysis tools developed by test developers to check for configurable requirements for a particular test. Tests should be able to define for a given set of test data what constitutes a requirement of the test, and how to check whether or not that requirements passes or fails. Post-test requirement failures should produce a report that can be integrated with bamboo. | ||
Comments: |