Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Computer Vision live camera #96

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Conversation

RHeckerIntel
Copy link
Collaborator

@RHeckerIntel RHeckerIntel commented Feb 4, 2025

Adds camera selection for computer vision.

Code is still rough, but wanted to open PR.

Important implementation detail: Framerate shown on screen is min(inference speed, camera framerate). No intrapolation or any other techniques. Slow models will mean slow framerate.

image

Isolate was being fidgety about transferring the Status over isolate
barriers.
Timestamp needs to be kept inside the graph runner and then recovered so
that when switching from camera and live image you always get the latest
timestamp.
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

license-eye has checked 479 files.

Valid Invalid Ignored Fixed
214 1 264 0
Click to see the invalid file list
  • openvino_bindings/src/utils/input_devices.h
Use this command to fix any missing license headers
```bash

docker run -it --rm -v $(pwd):/github/workspace apache/skywalking-eyes header fix

</details>

openvino_bindings/src/utils/input_devices.h Outdated Show resolved Hide resolved
Copy link

codecov bot commented Feb 4, 2025

Codecov Report

Attention: Patch coverage is 0% with 71 lines in your changes missing coverage. Please review.

Project coverage is 35.16%. Comparing base (faa4348) to head (bc8f473).

Files with missing lines Patch % Lines
lib/interop/graph_runner.dart 0.00% 37 Missing ⚠️
lib/interop/generated_bindings.dart 0.00% 13 Missing ⚠️
lib/interop/device.dart 0.00% 12 Missing ⚠️
lib/providers/image_inference_provider.dart 0.00% 9 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #96      +/-   ##
==========================================
+ Coverage   26.63%   35.16%   +8.52%     
==========================================
  Files         111       43      -68     
  Lines        4907     1914    -2993     
==========================================
- Hits         1307      673     -634     
+ Misses       3600     1241    -2359     
Flag Coverage Δ
integrationtests ?
unittests 35.16% <0.00%> (-1.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Linter
Add none as camera device option
Fix cameraDevices list not working
@RHeckerIntel RHeckerIntel marked this pull request as ready for review February 4, 2025 16:24
Show model loading animation during transition

GraphRunner::closeCamera can be triggered twice which might cause a race
condition. Instead of fixing this properly with a mutex in C++ I just
eat the error code.

If there was a previous provider make sure we close the camera before loading a new one.
This ensures that the camera is ready to be used again when the model is loaded.
The integration test got an error onCancel after dispose.
The download is still in progress after the token is cancelled
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant