Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Staging #389

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open

Staging #389

wants to merge 28 commits into from
+595 −346

Conversation

mccrindlebrian
Copy link
Contributor

@mccrindlebrian mccrindlebrian commented Mar 3, 2025 •
edited
Loading

Includes:

  1. We now utilize the credibility of miner scores per-task to allow us to skip validation and trust the results given by miners. This will, in the best case scenario, improve the speed of validators by 10x for good performing miners Features/credibility #384
  2. We now enable miners to be able to work on any job in the GJP, which includes a new ParticipationSynapse Allows for all miners to work on all jobs #390

mccrindlebrian and others added 28 commits February 25, 2025 22:41
@mccrindlebrian
add new metric credibility_over_time
c2c3142
@mccrindlebrian
reformat the registry to have new TaskMetrics and MinerData
e0f7a90
@mccrindlebrian
update registry tests
a90c667
@mccrindlebrian
remove unused method
163cca2
@mccrindlebrian
remove import
4280f5d
@mccrindlebrian
incorporate new validation probability function, and credibility-base…
2d2813d 
…d validation skipping
@mccrindlebrian
use miner_energies for skipping
88b1bbf
@danielpolimac
Corrected typo for GPU card in README
50a2454
@Sarkosos
Add ParticipationSynapse and participation step for job validation
fd8bd23 
- Introduce ParticipationSynapse to track miner participation in specific jobs
- Implement run_participation_step to query miners about job participation
- Update forward method to use participating miners instead of all miners
- Remove 'first' parameter from forward method
@Sarkosos
Add method to load active jobs from local database
1f75237 
- Implement add_active_jobs_from_db method in FoldingMiner
- Fetch active jobs from local database and add to simulation executor
- Handle job selection, deduplication, and error cases
- Support configurable job limit and worker slot management
@Sarkosos
Enhance miner job participation and management
32bc777 
- Add participation_forward method to BaseMinerNeuron to support job participation tracking
- Implement check_if_job_was_worked_on method in FoldingMiner for detailed job status
- Refactor run method to periodically check and add jobs from local database
- Improve job management with configurable job check interval
- Update axon to include participation forward function
@mccrindlebrian
Merge pull request #388 from danielpolimac/fix-readme-typo
3907bf5 
Corrected typo for GPU card in README
@Sarkosos
Refactor job loading and simulation creation in FoldingMiner
644fc65 
- Modify job loading to include S3 links and download input files
- Update simulation creation process to use downloaded configuration
- Improve job management with more detailed logging and error handling
- Adjust job check interval and add current job tracking
- Remove unnecessary synapse parameters from job creation methods
@mccrindlebrian
Merge branch 'main' into staging
bd96d03
@Sarkosos
black
4aeac62
@mccrindlebrian
black
b0e7761
@Sarkosos
Improve job processing and duplicate job prevention
ec0ee50 
- Fix indexing when fetching SQL job details
- Increment step counter in job processing
- Add duplicate job check in job loading to prevent reprocessing
- Enhance logging for skipped jobs
@Sarkosos
Adjust participation step timeout in forward validator
27f9416
@Sarkosos
Refactor file handling and job processing in FoldingMiner
55866f3 
- Remove query forward time tracking
- Simplify file existence check for existing job data
- Update data directory reference in synapse attachment
- Improve PDB file matching in output directory
@Sarkosos
Merge branch 'features/whole-subnet-participation' of https://github.…
bcd7310 
…com/macrocosm-os/folding into features/whole-subnet-participation
@mccrindlebrian
updates to exception notation
d42189d
@mccrindlebrian
Merge branch 'staging' into features/credibility
56b35bb
@mccrindlebrian
remove import
23f0231
@mccrindlebrian
Merge pull request #384 from macrocosm-os/features/credibility
85de18d 
Features/credibility
@mccrindlebrian
Merge branch 'staging' into features/whole-subnet-participation
8e0a405
@mccrindlebrian
Merge pull request #390 from macrocosm-os/features/whole-subnet-parti…
9b15aac 
…cipation

Allows for all miners to work on all jobs
@mccrindlebrian
v2.3.0
be4497c
@mccrindlebrian
docstrings for folding miner
ef050b1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@mccrindlebrian @danielpolimac @Sarkosos