Test Report

This document is providing a test report for Trustpoint. It should be updated with every version bump.

Warning

This is still w.i.p.!

Unit Test Results

For a summary of all pytest executions please see the output of the GitHub action that provides an action to run every pytest. This action can be found here: pytest action.

The current status of all test executions is Pytest.

Integration Test Results

Since we are using BDD to define the tests, we provide the test runs by leveraging the behave framework. The summary of the tests can be seen in the following table. For more detailed output please visit the corresponding github action pages.

Functional Requirements

Name (Identifier)

Title

Status of the behave tests

R_001

Create, view, edit and delete a device

R_001_badge

R_002

Usage of any zero touch onboarding protocol

No test present.

R_003

Certificate Lifecycle Management

R_003_badge

R_004

REST API

R_004_badge

R_005

Docker Container Support

R_005_badge

R_006

Backup, Restore, and Update Mechanisms

R_006_badge

R_007

Logging Capabilities

R_007_badge

R_008

Auto-Generated Issuing CA’s

R_008_badge

R_009

High Availability

No test present.

R_010

CMP Endpoint for Onboarded Devices

R_010_badge

R_011

EST Endpoint for Onboarded Devices

R_011_badge

R_012

Language Selection and Translation

R_012_badge

R_013

Remote Credential Download

R_013_badge

R_101

Security Level Configuration

R_101_badge

R_102

Certificate Template Security

R_102_badge

R_103

Create, view, and delete a domain

R_103_badge

R_104

Create, view, and delete a truststore

R_104_badge

F_001

NTEU must be able to execute R_001 and R_002.

F_001_badge

Defect and Incident Reports

Here, the following should be provided:

  • A summary of defects identified during testing.

  • Resolution status of each defect.

  • Associated logs for debugging.

Acceptance Testing Summary

Here, the following should be provided:

  • Results of acceptance tests conducted with end users.

  • User feedback and final approval status.

  • Any open issues and their planned resolutions.

Coverage Metrics

The coverage metrics and the current coverage can be seen on Codecov. As of now, there is a coverage of Coverage.

Test Environment Details

To set up the test environment one can basically use the Trustpoint Development environment setup. The pipelines for running the tests are explained in the CI/CD chapter.

Remaining Test Tasks

Here, the following should be provided:

  • Any pending testing activities or unresolved issues.

  • Plan for further improvements, if applicable.