[gentoo-soc] PMS Test Suite, weekly report #4

[gentoo-soc] PMS Test Suite, weekly report #4

[Michał Górny]

[-- Attachment #1: Type: text/plain, Size: 2254 bytes --]

Hello, all.

Short summary: PMS Test Suite is a suite of tools and a test library
to test any of the Gentoo Package Managers for compliance against
the Package Manager Specification.

The project is a little ahead of schedule.

This week brought:
a) structural changes:
- merge of the test library and eclasses into main codebase, reducing
  the project to a single repository,
- an ability to generate the test repository from scratch (not only
  ebuilds but eclasses, repo_name and categories file too),
- merge of CLI handling code into a single executable,
- clone of the main code repository to github [1] for nice network
  graphs [2],
- move of D-Bus related out of main eclass;

b) CLI changes:
- support for `--pm-options' switch, to specify additional options
  passed to the Package Manager (like `--jobs' or so),
- as `pms-tester' script creates the repo itself, an arbitrary path may
  be passed as `--repository-path';

c) technical changes:
- support for checking whether a package is installed. This data is
  used by simple tests to determine whether a particular test failed or
  succeeded,
- any already-merged tests are unmerged before starting to perform
  tests, and all merged tests are unmerged after the tests are
  performed,
- an actual, working D-Bus support. D-Bus-based tests
  (i.e. the standard test library) are required to at least ping
  the test object in pkg_setup() (done through the eclass) to ensure
  they can't succeed without being actually run. D-Bus can be used to
  send text test results;

d) new (working) tests:
- the test for phase function call order (as it was in the example
  but fixed),
- a test for doins() failure handling (in EAPI < 4 and EAPI 4).


The next week should bring:
- a little cleanup in the library/case code inheritance to simplify
  writing new tests,
- a few more tests,
- increased number of checks to ensure tests don't end up as false
  negatives,
- a support for more Package Managers.

Right now, the test period is starting on my uni, so the development
may slow down a little.


[1] https://github.com/mgorny/pms-test-suite
[2] https://github.com/mgorny/pms-test-suite/network

-- 
Best regards,
Michał Górny

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 316 bytes --]