Skip to content

Checkpoint/04 09 26#178

Closed
hariharan-devarajan wants to merge 19 commits intodevelopfrom
checkpoint/04-09-26
Closed

Checkpoint/04 09 26#178
hariharan-devarajan wants to merge 19 commits intodevelopfrom
checkpoint/04-09-26

Conversation

@hariharan-devarajan
Copy link
Copy Markdown
Member

No description provided.

hariharan-devarajan and others added 18 commits February 2, 2026 18:07
1. Enhance argument parsing and logging, add UTF-8 character removal, and update dependency handling
2. Tested Lustre configurations
3. Improved validation case to handle all cases
4. reduced logging to avoid blowing up log files
1. Generalized scheduler implementation to be updated by any user.
2. Specialized implementation for prolog and epilog script for slurm and flux and general.
1. Build instructions
2. Required dependencies
3. Deployment options
- Formatting on probe_validator.cpp
- Change DATACRUMBS_SCHEDULER_TYPE -> DATACRUMBS_LAUNCHER_TYPE
- Make DATACRUMBS_IS_ROOT and DATACRUMBS_USER readonly
1. Enhance argument parsing and logging, add UTF-8 character removal, and update dependency handling
2. Tested Lustre configurations
3. Improved validation case to handle all cases
4. reduced logging to avoid blowing up log files
1. Generalized scheduler implementation to be updated by any user.
2. Specialized implementation for prolog and epilog script for slurm and flux and general.
atttach.

1. Reduces the footprint of sudo review code.
2. Removes unneccessary scripts only support systemd in sudo.
3. Creates a system configuration and secrete to sign user probes.
4. No predefined probes, everything is a probe submitted by user.
5. Validation of probe is on runtime and we maintain invalid list.
6. Updated documentation.
7. No MPI dependency.
8. All other features moved to utils.
9. Composability replaced with user input of probes.
10. Include utils part of build for ease of deployment no direct
    dependency.
- Updated the RuntimeConfigurationManager to utilize an SQLite database for managing runtime probe states, replacing the previous JSON-based approach.
- Introduced new methods for loading and persisting runtime probe states, including successful and invalid probes.
- Modified the attach_runtime_probes function to record successful and invalid probes in the new database.
- Enhanced error handling and logging for database operations.
- Removed JSON dependencies in favor of SQLite for system configuration management in SystemConfigurator.
- Added new utility functions for executing SQLite commands and writing key-value pairs to the database.
- Updated related header files to reflect changes in data structures and method signatures.
@hariharan-devarajan hariharan-devarajan requested a review from a team as a code owner April 9, 2026 17:14
@hariharan-devarajan hariharan-devarajan force-pushed the checkpoint/04-09-26 branch 3 times, most recently from 3f667e4 to fc14054 Compare April 9, 2026 17:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant