Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Profiler shows huge idle time #564

Open
alex19999 opened this issue Feb 12, 2023 · 0 comments
Open

Profiler shows huge idle time #564

alex19999 opened this issue Feb 12, 2023 · 0 comments

Comments

@alex19999
Copy link

I'm new to TF profiler and tensorboard. Could you please tell me how GPU idle time is calculated? I see contradictory data in profiling information on tensorboard:

  • I have no blank spaces in events trace (GPU compute stream) presented on trace_viewer page.
  • Wherein device (GPU) idle time shown on tensorflow_stats page is about 50%???

It's what I see when I use small batch size. After increasing batch size, same situation is on trace_viewer page, but GPU idle time decreased up to 7%. So, how is idle time calculated?

By the way, another two questions:

  1. What is steps on trace_viewer page?
  2. Why does trace_viewer page contain only a part of profiling time? I profiled about 100 seconds of execution, but I see only 10 seconds on trace_viewer page.

Thanks a lot in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant