|
3 | 3 |
|
4 | 4 | Test suite for validation of openEO back-ends against the openEO API and related specifications.
|
5 | 5 |
|
6 |
| - |
| 6 | +Location: https://github.com/Open-EO/openeo-test-suite |
7 | 7 |
|
8 | 8 | ## Project structure and modular design
|
9 | 9 |
|
@@ -42,23 +42,24 @@ focussing on a specific API aspect to test or verify
|
42 | 42 | - Main location: [`src/openeo_test_suite/tests/processes/metadata`](./src/openeo_test_suite/tests/processes/metadata)
|
43 | 43 | - Defines tests to validate openEO process metadata against specs
|
44 | 44 | defined in the [openeo-processes](https://github.com/Open-EO/openeo-processes) project
|
45 |
| - - Functional tests concern actual values and behavior of processes (like parameters and return values), |
46 |
| - failures in these tests should be looked into and fixed. |
47 |
| - - Non-functional tests concern descriptions and other metadata of processes that have no impact on the actual behavior of the process, |
48 |
| - failures in these tests should be taken as warnings, but don't necessarily need to be fixed. These can be skipped by adding |
49 |
| - `-m "not optional"` to the pytest command. |
| 45 | + - Functional tests concern actual values and behavior of processes (like parameters and return values), |
| 46 | + failures in these tests should be looked into and fixed. |
| 47 | + - Non-functional tests concern descriptions and other metadata of processes that have no impact on the actual behavior of the process, |
| 48 | + failures in these tests should be taken as warnings, but don't necessarily need to be fixed. These can be skipped by adding |
| 49 | + `-m "not optional"` to the pytest command. |
50 | 50 | - Usage example for running these tests against a desired openEO backend URL:
|
51 | 51 | ```bash
|
52 | 52 | pytest src/openeo_test_suite/tests/processes/metadata \
|
53 |
| - -U openeo.example \ |
| 53 | + -U https://openeo.example \ |
| 54 | + -m "not optional" \ |
54 | 55 | --html=reports/process-metadata.html
|
55 | 56 | ```
|
56 | 57 | - **WP4 General openEO API compliance validation** (lead implementation partner: EODC)
|
57 | 58 | - Main location: [`src/openeo_test_suite/tests/general`](./src/openeo_test_suite/tests/general)
|
58 | 59 | - Provides tests to validate the general openEO API compliance of a back-end.
|
59 |
| - - The backend is checked against the openeo API specification defined in the [openeo-api](https://github.com/Open-EO/openeo-api/). |
60 |
| - - There are some tests which might run for a long time (as they running process_graphs on the backends) these can be skippied by adding |
61 |
| - `-m "not longrunning"` to the pytest command. |
| 60 | + - The backend is checked against the openeo API specification defined in the [openeo-api](https://github.com/Open-EO/openeo-api/) project. |
| 61 | + - There are some tests which might run for a long time (as they execute actual process graphs on the backends) |
| 62 | + these can be skipped by adding `-m "not longrunning"` to the pytest command. |
62 | 63 | - Usage example of just running these tests against a desired openEO backend URL:
|
63 | 64 | ```bash
|
64 | 65 | pytest src/openeo_test_suite/tests/general \
|
|
0 commit comments