Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RHEL10 Clients coverage in Content, some rhel7 and 8 content bumped to rhel9 and 10 #17003

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

damoore044
Copy link
Contributor

@damoore044 damoore044 commented Nov 26, 2024

PRT

For cases using fixture rhel_contenthost
parametrized by pytest.marker.rhel_ver_match or rhel_ver_list

trigger: test-robottelo
pytest: tests/foreman/api cli ui/module.py -k 'rhel10' 

The below chost environment variables were used prior for PRT but are no longer needed,
they've been merged into SatTower as the --nick rhel10 (satellite-jenkins # 1529)

env: # not needed anymore
     ROBOTTELO_content_host__rhel10__vm__workflow: 'deploy-template'
     ROBOTTELO_content_host__rhel10__vm__deploy_template_type: 'rhel'
     ROBOTTELO_content_host__rhel10__vm__deploy_custom_template_version: '10'

@damoore044 damoore044 added No-CherryPick PR doesnt need CherryPick to previous branches Stream Introduced in or relating directly to Satellite Stream/Master labels Nov 26, 2024
@damoore044 damoore044 self-assigned this Nov 26, 2024
@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/ -k 'rhel10' --ignore-glob='**/test_errata.py' --collect-only

@damoore044
Copy link
Contributor Author

damoore044 commented Nov 26, 2024

^ ignoring errata rhel10 cases for first collection,
as they've already been tested and merged in #16807

Works locally but fails for PRT, see below for proper CI exclusion comment

17:46:48  ============================= test session starts ==============================
17:46:48  platform linux -- Python 3.12.7, pytest-8.3.3, pluggy-1.5.0
    ...
17:47:20  collected 5460 items / 5412 deselected / 48 selected <<<

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/ -k 'rhel10' --collect-only $(find tests/foreman/ -type f -name 'test_errata.py' -exec echo --ignore={} \;)

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api/ -k 'rhel10' $(find tests/foreman/ -type f -name 'test_errata.py' -exec echo --ignore={} \;)
env:
     ROBOTTELO_content_host__rhel10__vm__workflow: 'deploy-template'
     ROBOTTELO_content_host__rhel10__vm__deploy_template_type: 'rhel'
     ROBOTTELO_content_host__rhel10__vm__deploy_custom_template_version: '10'

@damoore044
Copy link
Contributor Author

damoore044 commented Nov 26, 2024

^ foreman/API tests with rhel10 params, ignoring test_errata.py
Should be 9 new cases (rhel10) collected and executed

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api/ -k 'rhel10' $(find tests/foreman/api/ -type f -name 'test_errata.py' -exec echo --ignore={} \;)
env:
     ROBOTTELO_content_host__rhel10__vm__workflow: 'deploy-template'
     ROBOTTELO_content_host__rhel10__vm__deploy_template_type: 'rhel'
     ROBOTTELO_content_host__rhel10__vm__deploy_custom_template_version: '10'

@damoore044 damoore044 changed the title RHEL10 Clients coverage in Content, some rhel8 content bumped to rhel9 RHEL10 Clients coverage in Content, some rhel7 and 8 content bumped to rhel9 and 10 Nov 26, 2024
@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/ui/test_contenthost.py -k 'rhel10' 
env:
     ROBOTTELO_content_host__rhel10__vm__workflow: 'deploy-template'
     ROBOTTELO_content_host__rhel10__vm__deploy_template_type: 'rhel'
     ROBOTTELO_content_host__rhel10__vm__deploy_custom_template_version: '10'

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9471
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_contenthost.py -k rhel10 --external-logging
Test Result : == 10 failed, 10 passed, 129 deselected, 1457 warnings in 6396.11s (1:46:36) ===

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Nov 27, 2024
@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api/test_errata.py
env:
     ROBOTTELO_content_host__rhel10__vm__workflow: 'deploy-template'
     ROBOTTELO_content_host__rhel10__vm__deploy_template_type: 'rhel'
     ROBOTTELO_content_host__rhel10__vm__deploy_custom_template_version: '10'

@damoore044
Copy link
Contributor Author

^ Full test of all cases api/test_errata.py , rhel10 and priors.
Due to significant changes to that module

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api/test_errata.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9490
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/api/test_errata.py --external-logging
Test Result : ========== 4 failed, 10 passed, 4437 warnings in 10620.88s (2:57:00) ===========

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api/test_errata.py

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9554
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/api/test_errata.py --external-logging
Test Result : =========== 7 failed, 1279 warnings, 7 errors in 6489.17s (1:48:09) ============

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/api -k 'rhel10'

@damoore044
Copy link
Contributor Author

trigger: test-robottelo
pytest: tests/foreman/cli -k 'rhel10'

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9659
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/cli -k rhel10 --external-logging
Test Result : = 9 failed, 12 passed, 1938 deselected, 5353 warnings, 14 errors in 16245.78s (4:30:45) =

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
No-CherryPick PR doesnt need CherryPick to previous branches PRT-Failed Indicates that latest PRT run is failed for the PR Stream Introduced in or relating directly to Satellite Stream/Master
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants