[bounty] implement device control and make --use-all-monitors work

[louis030195]

context:

had implemented a device manager that allows you to start and stop audio device recording or monitor recording using HTTP API

https://github.com/mediar-ai/screenpipe/tree/af0042683a0c7fd15d78d286da97ab9c1610af00

https://github.com/mediar-ai/screenpipe/blob/af0042683a0c7fd15d78d286da97ab9c1610af00/screenpipe-core/src/devices.rs

had to revert because it was memory leaking:

54ed2f1

memory has always been leaking a little bit (eg go from 4 gb to 5 gb after running for 5 days roughly) but it was reaching 10 gb after 3 days roughly (not acceptable)

previous implementation with dashmap had deadlocks (and only supported audio), usually we prefer to use channels

this feature is useful to improve the experience for:

1. people switching audio device and monitor devices regularly (commuting for work etc.) (e.g. --use-all-monitors argument to always record all monitors for example)
2. privacy preserving use cases
3. control resource usage dynamically
4. other use cases

definition of done:

• --use-all-monitors always record all monitor available, and stop recording when it's unplugged
• running screenpipe for 3 days, while having meetings, working, etc. and the memory stays under 4.5 gb, and CPU roughly the same (10-30% on my mac book pro m4 max)
• /audio/start, /audio/stop, /audio/list, /vision/start, /vision/stop, /vision/list

make this work reliably and prove it's not memory leaking

/bounty 400

bonus bounty:

• --use-all-default-audio-devices always record all default audio devices
• very good tests, good benchmarks of memory over time somehow, idk

[algora-pbc]

💎 $400 bounty • Screenpi.pe

Steps to solve:

1. Start working: Comment /attempt #1380 with your implementation plan
2. Submit work: Create a pull request including /claim #1380 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to mediar-ai/screenpipe!

Add a bounty • Share on socials

Attempt	Started (GMT+0)	Solution
🟢 @Ayush9026	Feb 17, 2025, 9:14:25 PM	WIP

[Ayush9026]

/attempt #1380

Options

• Cancel my attempt