Job Creation, Execution, and Test Results
XPRESSO is a comprehensive and complementary network test automation web-based "dashboard" that's designed to maximize, expedite, and simplify your pyATS | Genie development, scripting, and CI/CD.
XPRESSO uses Jobs, Job Profiles, and Job Bundles to facilitate the execution, scheduling, and management of test scripts using the XPRESSO dashboard. This results in a Job Run.
This topic covers the primary automation feature set in XPRESSO; creating and executing Job and the various ways to view, search, and post test results from your Job Runs.
Creating Jobs, Job Profiles, and Job Bundles: Creating and executing a Job Run is the main test automation feature set in XPRESSO; this topic contains information about:
Creating Jobs: Lets you prepares Job Runs in advance of execution by providing the means to associate all required elements to run the Job such as: your test environment (test harness, Execution Engine, and Location-details); your lab resources (testbeds or topologies); and any localized arguments/environment variables.
Creating Job Profiles: Provides an additional layer on top of the Job layer that let you perform varying degree of tests (and coverages) using the same test script but with different parameters or arguments.
Creating Job Bundles: Bundles are grouped combinations of saved Jobs and Profiles in the group that can be saved and re-run, (for example for regression testing) with the specific job/profile setting.
Job Requests and Test Results: This topic contains information about:
Executing Job Requests: Provides an overview of a Job Run, how to create the different variables of Job Requests (individual, single, and bundled), how to schedule a Job run, executing the Job run request, and the various Job run request states and actions.
Viewing Job Test Results: Provides information about how to view a detailed analytic report of test statistics and view summary details, how to view Job execution statistic in real-time LiveView viewer, and how to post tests results into Cisco TRADe or the Jenkins run log.
Searching Job Test Results: Provides information about the different ways you can search for information in your test results.
Comparing Job Test Results: Provides information about about comparing the test results from two different test runs with no baseline set.
Setting Baseline and Baseline Comparison: Provides information about how to set a baseline Job run and how to enable baseline comparison with all subsequent Job runs.
Notifications, Messages, Actionable Requests and Bot Notifications: Provides capability to get notified of the important events via these channels.
Executing Manifest Requests: Provides an overview of how to execute a test through manifest file.
NOTE:
All the above entities in XPRESSO, once DELETED, can only be RESTORED and not created again with the same name. Restore can be done in the Current Group -> Restore tab. Required permissions can be given in the Current Group -> Permissions section.