Skip to content

AI test

AI test #232

Manually triggered December 3, 2024 01:48
Status Failure
Total duration 9m 50s
Artifacts 4

ai.yml

on: workflow_dispatch
Matrix: main
Fit to window
Zoom out
Zoom in

Annotations

9 errors
main (18.19.0)
Process completed with exit code 1.
Unhandled error: packages/web-integration/src/playground/server.ts#L171
Error: listen EADDRINUSE: address already in use :::5800 ❯ Server.setupListenHandle [as _listen2] node:net:1817:16 ❯ listenInCluster node:net:1865:12 ❯ Server.listen node:net:1953:7 ❯ Function.listen ../../node_modules/.pnpm/[email protected]/node_modules/express/lib/application.js:635:24 ❯ src/playground/server.ts:171:30 ❯ PlaygroundServer.launch src/playground/server.ts:169:12 ❯ tests/unit-test/playground-server.test.ts:9:18 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { code: 'EADDRINUSE', errno: -98, syscall: 'listen', address: '::', port: 5800 } This error originated in "tests/unit-test/playground-server.test.ts" test file. It doesn't mean the error was thrown inside the file itself, but while it was running. The latest test that might've caused the error is "Playground Server". It might mean one of the following: - The error was thrown, while Vitest was running this test. - If the error occurred after the test had been completed, this was the last documented test before it was thrown.
tests/ai/web/puppeteer/showcase.test.ts > puppeteer integration > find widgets in antd: packages/web-integration/src/common/tasks.ts#L425
Error: 403 令牌额度不足 (request id: 2024120301575741479133125551835) Error: 403 令牌额度不足 (request id: 2024120301575741479133125551835) at Function.generate (/home/runner/work/midscene/midscene/node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/error.ts:78:14) at OpenAI.makeStatusError (/home/runner/work/midscene/midscene/node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:397:21) at OpenAI.makeRequest (/home/runner/work/midscene/midscene/node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:460:24) at processTicksAndRejections (node:internal/process/task_queues:95:5) at call (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:5460:22) at callToGetJSONObject (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:5508:20) at callAiFn (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:5540:32) at Module.plan (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:5832:30) at Object.executor (/home/runner/work/midscene/midscene/packages/web-integration/src/common/tasks.ts:425:24) at Executor.flush (/home/runner/work/midscene/midscene/packages/midscene/dist/lib/index.js:4592:25) ❯ Function.generate ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/error.ts:78:14 ❯ OpenAI.makeStatusError ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:397:21 ❯ OpenAI.makeRequest ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:460:24 ❯ Object.executor src/common/tasks.ts:425:24 ❯ PuppeteerAgent.aiAction src/common/agent.ts:151:13 ❯ tests/ai/web/puppeteer/showcase.test.ts:70:7
tests/ai/evaluate/inspect.test.ts > taobao-1-inspect: locate element: packages/midscene/tests/ai/evaluate/inspect.test.ts#L113
AssertionError: expected 2 to be less than or equal to 1 ❯ test.timeout tests/ai/evaluate/inspect.test.ts:113:40
tests/ai/evaluate/inspect.test.ts > taobao-2-inspect: locate element: packages/midscene/tests/ai/evaluate/inspect.test.ts#L113
AssertionError: expected 2 to be less than or equal to 1 ❯ test.timeout tests/ai/evaluate/inspect.test.ts:113:40
tests/ai/evaluate/inspect.test.ts > taobao-3-planning: locate element: packages/midscene/src/ai-model/openai/index.ts#L87
Error: 403 令牌额度不足 (request id: 2024120301581147847807477137447) ❯ Function.generate ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/error.ts:78:14 ❯ OpenAI.makeStatusError ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:397:21 ❯ OpenAI.makeRequest ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:460:24 ❯ call src/ai-model/openai/index.ts:87:22 ❯ Module.callToGetJSONObject src/ai-model/openai/index.ts:149:20 ❯ Module.callAiFn src/ai-model/common.ts:38:32 ❯ Module.AiInspectElement src/ai-model/inspect.ts:165:26 ❯ tests/ai/evaluate/inspect.test.ts:83:39 ❯ tests/ai/evaluate/test-suite/util.ts:69:17 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { status: 403, headers: { connection: 'keep-alive', 'content-length': '167', 'content-type': 'application/json; charset=utf-8', date: 'Tue, 03 Dec 2024 01:58:11 GMT', 'x-aihubmix-request-id': '2024120301581147847807477137447' }, request_id: undefined, error: { message: '令牌额度不足 (request id: 2024120301581147847807477137447)', type: 'Aihubmix_api_error', param: '', code: 'pre_consume_token_quota_failed' }, code: 'pre_consume_token_quota_failed', param: '' }
tests/ai/evaluate/inspect.test.ts > taobao-4-planning: locate element: packages/midscene/src/ai-model/openai/index.ts#L87
Error: 403 令牌额度不足 (request id: 2024120301583592411814263292749) ❯ Function.generate ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/error.ts:78:14 ❯ OpenAI.makeStatusError ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:397:21 ❯ OpenAI.makeRequest ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:460:24 ❯ call src/ai-model/openai/index.ts:87:22 ❯ Module.callToGetJSONObject src/ai-model/openai/index.ts:149:20 ❯ Module.callAiFn src/ai-model/common.ts:38:32 ❯ Module.AiInspectElement src/ai-model/inspect.ts:165:26 ❯ tests/ai/evaluate/inspect.test.ts:83:39 ❯ tests/ai/evaluate/test-suite/util.ts:69:17 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { status: 403, headers: { connection: 'keep-alive', 'content-length': '167', 'content-type': 'application/json; charset=utf-8', date: 'Tue, 03 Dec 2024 01:58:36 GMT', 'x-aihubmix-request-id': '2024120301583592411814263292749' }, request_id: undefined, error: { message: '令牌额度不足 (request id: 2024120301583592411814263292749)', type: 'Aihubmix_api_error', param: '', code: 'pre_consume_token_quota_failed' }, code: 'pre_consume_token_quota_failed', param: '' }
tests/ai/evaluate/inspect.test.ts > aweme_play-4-planning: locate element: packages/midscene/src/ai-model/openai/index.ts#L87
Error: 401 该令牌额度已用尽 (request id: 2024120301583946717420151620059) ❯ Function.generate ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/error.ts:74:14 ❯ OpenAI.makeStatusError ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:397:21 ❯ OpenAI.makeRequest ../../node_modules/.pnpm/[email protected][email protected]/node_modules/openai/src/core.ts:460:24 ❯ call src/ai-model/openai/index.ts:87:22 ❯ Module.callToGetJSONObject src/ai-model/openai/index.ts:149:20 ❯ Module.callAiFn src/ai-model/common.ts:38:32 ❯ Module.AiInspectElement src/ai-model/inspect.ts:165:26 ❯ tests/ai/evaluate/inspect.test.ts:83:39 ❯ tests/ai/evaluate/test-suite/util.ts:69:17 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Serialized Error: { status: 401, headers: { connection: 'keep-alive', 'content-length': '122', 'content-type': 'application/json; charset=utf-8', date: 'Tue, 03 Dec 2024 01:58:39 GMT', 'x-aihubmix-request-id': '2024120301583946717420151620059' }, request_id: undefined, error: { message: '该令牌额度已用尽 (request id: 2024120301583946717420151620059)', type: 'Aihubmix_api_error' }, code: undefined, param: undefined }
main (18.19.0)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size
e2e-cache-report Expired
29.2 MB
e2e-report Expired
14.6 MB
e2e-report-output Expired
35.4 MB
test-ai-output Expired
64.2 MB