Skip to content

Option to bypass GPU ThrottleMonitor on Jetson and enable TRT timing cache#8

Open
sergii-bond wants to merge 3 commits into
mainfrom
sb/jp-apr21
Open

Option to bypass GPU ThrottleMonitor on Jetson and enable TRT timing cache#8
sergii-bond wants to merge 3 commits into
mainfrom
sb/jp-apr21

Conversation

@sergii-bond
Copy link
Copy Markdown

What does this PR do?

  • Option to bypass GPU ThrottleMonitor on Jetson, as current options use nvidia-smi which is not available on Jetson.
  • Enable TRT timing cache to speed up repetitive model compilation of similar architectures.

Type of Change

  • New feature (non-breaking change that adds functionality)

Testing

  • I have tested this change locally
  • I have added/updated tests for this change

Test details:
Ran it on Jetson on multiple model configurations.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code where necessary, particularly in hard-to-understand areas
  • My changes generate no new warnings or errors
  • I have updated the documentation accordingly (if applicable)

Additional Context

None

@sergii-bond sergii-bond requested a review from isaacrob May 26, 2026 20:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant