About LSB Distribution Testkit Manager II

From ISP_RAS

Jump to: navigation, search

LSB Distribution Testkit Manager II (DTK Manager) is an improved version of LSB DTK Manager. It represents a user interface front-end of the LSB Distribution Testkit, which wraps all the current LSB/Moblin test suites into a user-friendly “single LSB/Moblin test suite” with unified test management and analysis capabilities. This facilitates test execution and results analysis thus making the LSB/Moblin tests more attractive for upstream developers as well as making certification process technically more inviting.

[edit]

Start using DTK Manager

The latest DTK Manager release package can be downloaded from here:
x86 (26 Mb), x86-64 (22 Mb), ia64 (17 Mb), ppc32 (19 Mb), ppc64 (9 Mb), s390 (15 Mb), s390x (11 Mb).

LSB DTK Manager 4.0.1.1 Release notes

Note:
DTK Manager II is incompatible with the old DTK Manager, and they cannot be used together. If you have DTK Manager installed on your computer, please, remove it before installing DTK Manager II and delete its data directory /var/opt/lsb/test/manager (backup it if you plan to return back to the old DTK Manager and will need your previous test results and user profiles).

The latest stable sources snapshot is at unofficial/dtk-manager-2 in LF Bazaar.

Please read LSB DTK Manager II Getting Started to get an overview of the tool with screenshots for using it smoothly.

[edit]

Key Features

The key features of LSB DTK Manager II are:

  • Support for both LSB and Moblin standards.
  • Integrated user interface for all the test suites:
    • web based;
    • command line.
  • Selection of tests to run (all, manually selected subset, predefined subsets, etc.).
  • Flexible selection of test suite versions and fine tuning of installation and running of each test suite.
  • Automatic download of missing test suites from the LF FTP site.
  • Advanced progress indication during test run.
  • Integration with the LSB Certification System.
  • 'One-button' tests execution.
  • Global test summary (for all the tests).
  • Unified reports in one place.
  • Side-by-side comparison of 2 or more test results.
  • Manifest-based approach that allows to maintain the list of tests without updating the DTK Manager itself.
  • Improved error handling and reporting.
[edit]

Future Plans

The following features can be included in the future (note: this is a wish list only - it will be continually supplemented while it is not guaranteed that all the features below will be ever implemented):

  1. Waiver detection should be synchronized with a centralized online DB of waivers.
  2. Build mapping between individual tests within LSB test suites and particular interfaces they test (or even particular assertions in the specifications). Given simple support in the test suites, this will allow the following:
    • Consolidated reports grouped by various criteria (by test suite, by target library, by specification section (libgroup), by interface, etc.).
    • Coverage reports:
      • list of tested/untested interfaces (with groupping and summaries);
      • list of tested/untested specification assertions (with groupping and summaries). This also can be presented as a colored specification where colors denote if each line in the specification is tested or not by the tests.
    • Links in the reports to the Specification’s text (e.g. pointing out for a fail which citation from the specification was actually violated).
  3. Exhaustive cross-linking of all the reports and related info like specification, documentation and online DB of waivers.
  4. Ability to re-execute only those test cases that failed at the previous run.
Retrieved from "http://ispras.linuxfoundation.org/index.php/About_LSB_Distribution_Testkit_Manager_II"
Personal tools