Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: exclude docker pull time from job execution timeouts & incorrect job state while pulling image #4795

Open
laciferin2024 opened this issue Jan 2, 2025 · 1 comment
Open

bug: exclude docker pull time from job execution timeouts & incorrect job state while pulling image #4795

laciferin2024 opened this issue Jan 2, 2025 · 1 comment
Labels
request/new Request: Indicates a new request that has been submitted and awaits initial triage type/bug Type: Something is not working as expected

Comments

@laciferin2024
Copy link

Bug Description

I set up a bacalhau node with default timeout to 30m. bacalhau job ran for 30m timed out. I debugged a saw that all the time when job was in progress, it was actually image being pulled. Ultimately when image took longer to pull.

A new status for jobs like SettingUp would be nice,

image

This status

   bacalhau logs -f 7c5a7a88-f181-4dca-87aa-54b6ae293633
error reading log output: error received from server: failed to open log stream for job 7c5a7a88-f181-4dca-87aa-54b6ae293633: failed to get log stream for execution: e-d9269b5c-4b03-4132-9222-659f21007b14. getting outputs for execution (e-d9269b5c-4b03-4132-9222-659f21007b14): execution not found
image

This false positive confirmation of job in Progress, crashes my workflow
@laciferin2024 laciferin2024 added request/new Request: Indicates a new request that has been submitted and awaits initial triage type/bug Type: Something is not working as expected labels Jan 2, 2025
@linear Linear
Copy link

linear bot commented Jan 2, 2025

ENG-507 bug: exclude docker pull time from job execution timeouts

@laciferin2024 laciferin2024 changed the title bug: exclude docker pull time from job execution timeouts bug: exclude docker pull time from job execution timeouts & incorrect job state while pulling image Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
request/new Request: Indicates a new request that has been submitted and awaits initial triage type/bug Type: Something is not working as expected
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@laciferin2024