Image build er step STIG document fails for RHEL8 gold image build

[vj0303]

Hello,

Building a gold image using AWS image builder from public AMI for rhel 8 and one of the component stig-build-linux-high document is failing with error. It appears that everything runs in the step , but finally fails in one of the document.
Was able to disable termination of the build instance and look at the logs.

Tried to download the S3 from the build instance but it gives Access Denied error which doesnt make any sense, since the same role work great on RHEL 7 image builder.

This document is used for rhel7 & rhel8 and fails only on rhel8.

Here is the run command failure log.

URL 'https://ec2imagebuilder-toe-us-east-1-prod.s3.us-east-1.amazonaws.com/bootstrap_scripts/bootstrap.sh' returned HTTP status '200'
Waiting for Cloud-init to initialize ...
Waiting for Cloud-init to initialize ...
{
    "executionId": "361fe210-5c92-11ee-9fc5-12b1cc6e6ca7",
    "status": "failed",
    "failedStepCount": 1,
    "executedStepCount": 79,
    "ignoredFailedStepCount": 0,
    "failureMessage": "Document arn:aws:imagebuilder:us-east-1:627945338248:component/stig-build-linux-high/2023.2.2/1 failed!",
    "logUrl": "/var/lib/amazon/toe/TOE_2023-09-26_17-29-13_UTC-0_361fe210-5c92-11ee-9fc5-12b1cc6e6ca7"
}


Below is from console.log from the build instance under the path /var/lib/amazon/toe/TTOE_2023-09-26_17-29-13_UTC-0_361fe210-5c92-11ee-9fc5-12b1cc6e6ca7 as given in above ssm run command output. 

2023-09-28T20:15:53.376164298Z CmdExecution: Command execution has been completed
2023-09-28T20:15:53.376170745Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:53.376176512Z CmdExecution: Stderr: No packages marked for removal.
2023-09-28T20:15:53.376183064Z CmdExecution: ExitCode 0
2023-09-28T20:15:53.376279885Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:53.386012885Z Phase validate
2023-09-28T20:15:53.387823661Z Step ValidateYumUpdate
2023-09-28T20:15:53.391030540Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:56.418550581Z CmdExecution: Command execution has been completed
2023-09-28T20:15:56.418558140Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:56.418563483Z CmdExecution: Stderr:
2023-09-28T20:15:56.418570474Z CmdExecution: ExitCode 0
2023-09-28T20:15:56.418683003Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:56.430868505Z Document arn:aws:imagebuilder:us-east-1:855991109994:component/bby-linux-system-cleanup/1.80.0/1
2023-09-28T20:15:56.432374912Z Phase build
2023-09-28T20:15:56.434155639Z Step RotateSystemLogs
2023-09-28T20:15:56.437582000Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:56.449474177Z CmdExecution: Command execution has been completed
2023-09-28T20:15:56.449480032Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:56.449484796Z CmdExecution: Stderr:
2023-09-28T20:15:56.449488899Z CmdExecution: ExitCode 0
2023-09-28T20:15:56.449552066Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:56.455243511Z Step StopRsyslogService
2023-09-28T20:15:56.458664725Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:56.463802514Z Stdout: Stopping rsyslog
2023-09-28T20:15:56.893545862Z CmdExecution: Command execution has been completed
2023-09-28T20:15:56.893555603Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:56.893562870Z CmdExecution: Stderr:
2023-09-28T20:15:56.893570584Z CmdExecution: ExitCode 0
2023-09-28T20:15:56.893679544Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:56.900347699Z Step RemoveRsyslogStateFiles
2023-09-28T20:15:56.903315738Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:56.904549598Z Stdout: imfile-state file not found
2023-09-28T20:15:56.904660133Z CmdExecution: Command execution has been completed
2023-09-28T20:15:56.904664266Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:56.904668621Z CmdExecution: Stderr:
2023-09-28T20:15:56.904672845Z CmdExecution: ExitCode 0
2023-09-28T20:15:56.904740655Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:56.910809580Z Step ClearShellHistory
2023-09-28T20:15:56.913759784Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:56.915284854Z Stdout: Clearing history.
2023-09-28T20:15:56.917075891Z Stdout: Clearing ssh files.
2023-09-28T20:15:59.559598850Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.559609457Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.559618620Z CmdExecution: Stderr:
2023-09-28T20:15:59.559623737Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.559720595Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.571631045Z Step StopServices
2023-09-28T20:15:59.575372409Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.608383664Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.608389739Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.608394930Z CmdExecution: Stderr:
2023-09-28T20:15:59.608421469Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.608502396Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.615448928Z Step RemoveServiceLogFiles
2023-09-28T20:15:59.618394380Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.621574413Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.621579638Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.621586468Z CmdExecution: Stderr:
2023-09-28T20:15:59.621590778Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.621651329Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.628310830Z Step ScrubSensuFiles
2023-09-28T20:15:59.632042205Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.635802381Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.635807388Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.635811541Z CmdExecution: Stderr:
2023-09-28T20:15:59.635815685Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.635881637Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.641817371Z Step RemoveOneagentFile
2023-09-28T20:15:59.644564098Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.646337174Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.646341948Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.646346109Z CmdExecution: Stderr:
2023-09-28T20:15:59.646350260Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.646433225Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.653325666Z Step RetainSSMAgentInstallation
2023-09-28T20:15:59.656889054Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.658705125Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.658710067Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.658714216Z CmdExecution: Stderr:
2023-09-28T20:15:59.658718425Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.658777236Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.664703916Z Step RemoveSyslogLogrotate
2023-09-28T20:15:59.667548813Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.669349285Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.669354109Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.669358333Z CmdExecution: Stderr:
2023-09-28T20:15:59.669362517Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.669449650Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.678653142Z Phase validate
2023-09-28T20:15:59.680169779Z Step ValidateClearShellHistory
2023-09-28T20:15:59.683451607Z ExecuteBash: STARTED EXECUTION
2023-09-28T20:15:59.926490323Z CmdExecution: Command execution has been completed
2023-09-28T20:15:59.926499101Z CmdExecution: Command execution was completed successfully
2023-09-28T20:15:59.926506961Z CmdExecution: Stderr:
2023-09-28T20:15:59.926512403Z CmdExecution: ExitCode 0
2023-09-28T20:15:59.926602233Z ExecuteBash: FINISHED EXECUTION
2023-09-28T20:15:59.940078700Z Executor: FINISHED EXECUTION OF ALL DOCUMENTS
2023-09-28T20:15:59.942629340Z TOE has completed execution with failure - Execution failed

[vj0303]

Could some one please help ? Removed the component stig-build-linux-high and was successfully able to build the gold AMI. I thinks some issue with stig for rhel 8