Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unreliable test: Q Feature Dev "Iterates on codegen" timeout and accept button failure #6513

Open
tomcat323 opened this issue Feb 5, 2025 · 0 comments
Labels
codewhisperer partner-team Triggers issue routing to owner team tests-ci-cd

Comments

@tomcat323
Copy link
Contributor

tomcat323 commented Feb 5, 2025

Test Details

Log of Test Failure

  1) Amazon Q Feature Dev
       /dev {msg} entry
         "before each" hook for "Iterates on codegen":
     Error: Test length exceeded max duration: 300 seconds
[No Pending UI Elements Found]
      at Timeout._onTimeout (/codebuild/output/src1654629272/src/github.com/aws/aws-toolkit-vscode/packages/core/src/test/setupUtil.ts:46:32)
      at listOnTimeout (node:internal/timers:581:17)
      at processTimers (node:internal/timers:519:7)

  2) Amazon Q Feature Dev
       file-level accepts
         accept button
           button text
             shows "Accept all changes" when no files are accepted or rejected, and "Accept remaining changes" otherwise:

      AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:

  assert_1.default.ok(insertCodeButton.pillText === 'Accept remaining changes')

      + expected - actual

      -false
      +true
      
      at Context.<anonymous> (test/e2e/amazonq/featureDev.test.ts:298:28)

globalSetup: after()
deleteTestTempDirs: deleted 1 test temp dirs
Error: 2 tests failed.
    at /codebuild/output/src1654629272/src/github.com/aws/aws-toolkit-vscode/packages/core/src/test/testRunner.ts:128:28
    at MultiReporters.done (/codebuild/output/src1654629272/src/github.com/aws/aws-toolkit-vscode/node_modules/mocha-multi-reporters/lib/MultiReporters.js:124:16)
    at done (/codebuild/output/src1654629272/src/github.com/aws/aws-toolkit-vscode/node_modules/mocha/lib/mocha.js:1007:16)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
�[90m[main 2025-01-29T00:29:31.269Z]�[0m Extension host with pid 3221 exited with code: 0, signal: unknown.
Exit code:   1

Additional Information

Introduced in: #6453

Got the confirmation that this is not an application issue, and partner proceeded with skipping the test: #6491.

The skip unblocks our CI and canary. However the issue is not resolved, a fix is still needed.

@tomcat323 tomcat323 added codewhisperer partner-team Triggers issue routing to owner team tests-ci-cd labels Feb 5, 2025
@tomcat323 tomcat323 changed the title Q Feature Dev "Iterates on codegen" timeout and accept button failure unreliable test: Q Feature Dev "Iterates on codegen" timeout and accept button failure Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
codewhisperer partner-team Triggers issue routing to owner team tests-ci-cd
Projects
None yet
Development

No branches or pull requests

1 participant