From 93ce28552338e98a26861a610261d911477f43bf Mon Sep 17 00:00:00 2001 From: Sacha Lansky <23283108+sacha-l@users.noreply.github.com> Date: Sat, 10 Aug 2024 03:26:44 +0200 Subject: [PATCH 1/5] rebase #2354 --- applications/swarm-nl.md | 69 ++++++++++++++++++++++++++++++++++------ 1 file changed, 60 insertions(+), 9 deletions(-) diff --git a/applications/swarm-nl.md b/applications/swarm-nl.md index c4f0c649538..8521ed4e3de 100644 --- a/applications/swarm-nl.md +++ b/applications/swarm-nl.md @@ -137,20 +137,71 @@ We have built a PoC for SamaritanDB (see [the Github repo here](https://github.c ### Milestone 2 -- **Estimated Duration:** 1.5 months (6 weeks) -- **FTE:** 1 -- **Costs:** $12,000 +- **Estimated Duration:** 2.5 months (10 weeks) +- **FTE:** 1.5 +- **Costs:** $36,000 + +#### 1. Research on Scaling + +Research objective: to find the most efficient implementation to scale swarms, using state of the art research (estimated: 2 weeks). + + +**1 week:** + +- Fault tolerance algorithms and their implementations +- Sharding algorithms +- Cooperation / coordination algorithms + +**1 week:** + +- Report of findings +- Comparative analysis and final decisions based on our findings for the direction of our implementation + + +#### 2. Sharding and data forwarding implementation + + +**A. 3 weeks: sharding and data forwarding** + +- 1 week: scaffolding and draft implementation +- 2 weeks: review, testing and improvements + + +**B. 2 weeks: writing integration-like tests to demonstrate the algorithms at scale** + +- 1 week: benchmarking network behavior +- 1 week: documentation and results + + +#### 3. IPFS integration + + +**Estimated 1 week:** + +- Implementation of all IPFS features for a swarm / testing +- Documentation and guides to easily use the IPFS features (tweak library accordingly if necessary) + + +#### 4. Extendability of library + +**Estimated 2 weeks:** + +- Provide capabilities to take snapshots of networking state and send to remote server including logs +- Testing and documentation +- Touching up and miscellaneous + +This brings us to total estimation of 10 weeks with a 1.5 FTE. With hourly rates revised to 60 USD/hr at 40 hour per week, our estimations come to a 2400 USD (1 FTE) + 1200 (0.5 FTE). This brings the total to 36,000 USD for Milestone 2, to fund the work of a Lead Engineer + Protocol Researcher (Adedeji) and Project Lead + Developer (Sacha) required to ship the libraries' features for this milestone. | Number | Deliverable | Specification | | -----: | ----------- | ------------- | | **0a.** | License | Apache 2.0 | -| **0b.** | Documentation | We will provide both **inline documentation** of the code and a basic **tutorial** that explains how a user can add new nodes to SwarmNL. | -| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness. In the guide, we will describe how to run these tests. | +| **0b.** | Documentation | We will provide both **inline documentation** of all new code and basic guides that explain how a user can add new nodes to SwarmNL and showcase API usage for different network configurations. | +| **0c.** | Testing and Testing Guide | Core functions will be fully covered by comprehensive unit tests to ensure functionality and robustness.| | **0d.** | Docker | We will provide a Dockerfile(s) that can be used to test all the functionality delivered with this milestone. | -| 0e. | Demo API usage | Showcase API usage with short guides using different configurations. | -| 1. | Scaling | Implementation of sharding, data-forwarding and fault-tolerant algorithms into SwarmNL. | -| 2. | IPFS integration | Implementation of interfaces to upload, download and pin IPFS files. | -| 3. | Additional Extendability | Implementation of interfaces to POST arbitrary data to remote servers. | +| 1. | Research | Research on decentralized fault-tolerant, coordination and sharding algorithms for large scale networks. | +| 2. | Scaling | Implementation of sharding, data-forwarding and fault-tolerant algorithms into SwarmNL. | +| 3. | IPFS integration | Implementation of interfaces to upload, download and pin IPFS files. | +| 4. | Extendability of library | Implementation of interfaces to POST arbitrary data to remote servers. | ## Future Plans From 20f3e8a9c5548bdaafb2ba718b0eafc74bb73ba7 Mon Sep 17 00:00:00 2001 From: sacha <23283108+sacha-l@users.noreply.github.com> Date: Thu, 19 Sep 2024 22:16:57 +0200 Subject: [PATCH 2/5] update ah address --- applications/swarm-nl.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/swarm-nl.md b/applications/swarm-nl.md index 8521ed4e3de..1d214447b1d 100644 --- a/applications/swarm-nl.md +++ b/applications/swarm-nl.md @@ -1,6 +1,6 @@ # SwarmNL - **Team Name:** Algorealm -- **Payment Address:** 15APyDmWBwwv8LEW8rvFpiYAUCu7u4nxKBd7oGp4JR6nSrnE (Polkadot AssetHub) +- **Payment Address:** 14pG7HieCjNk2hZ4X2YvxkbpAXs9oCeW8aNZcD7tD2tpaJT9 (Polkadot AssetHub) - **Level:** 2 ## Project Overview :page_facing_up: From 5b6dba376a7272e9b5afd800e3b367666bad588b Mon Sep 17 00:00:00 2001 From: sacha <23283108+sacha-l@users.noreply.github.com> Date: Fri, 20 Sep 2024 02:08:10 +0200 Subject: [PATCH 3/5] change level from 2 to 3 --- applications/swarm-nl.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/swarm-nl.md b/applications/swarm-nl.md index 1d214447b1d..5f35bc7229c 100644 --- a/applications/swarm-nl.md +++ b/applications/swarm-nl.md @@ -1,7 +1,7 @@ # SwarmNL - **Team Name:** Algorealm - **Payment Address:** 14pG7HieCjNk2hZ4X2YvxkbpAXs9oCeW8aNZcD7tD2tpaJT9 (Polkadot AssetHub) -- **Level:** 2 +- **Level:** 3 ## Project Overview :page_facing_up: From 111d0e0416062fbd9463383fe077eaedf2bc904d Mon Sep 17 00:00:00 2001 From: sacha <23283108+sacha-l@users.noreply.github.com> Date: Fri, 27 Sep 2024 19:13:16 +0200 Subject: [PATCH 4/5] update --- applications/swarm-nl.md | 1 + 1 file changed, 1 insertion(+) diff --git a/applications/swarm-nl.md b/applications/swarm-nl.md index 5f35bc7229c..f8851cb7ab2 100644 --- a/applications/swarm-nl.md +++ b/applications/swarm-nl.md @@ -140,6 +140,7 @@ We have built a PoC for SamaritanDB (see [the Github repo here](https://github.c - **Estimated Duration:** 2.5 months (10 weeks) - **FTE:** 1.5 - **Costs:** $36,000 +- **DOT %:** 50% #### 1. Research on Scaling From 5b524d4f47af31f52e86e88ff03209b7f1743a55 Mon Sep 17 00:00:00 2001 From: sacha <23283108+sacha-l@users.noreply.github.com> Date: Tue, 8 Oct 2024 17:58:35 +0200 Subject: [PATCH 5/5] fix: update total cost --- applications/swarm-nl.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/applications/swarm-nl.md b/applications/swarm-nl.md index f8851cb7ab2..8e20858ca0f 100644 --- a/applications/swarm-nl.md +++ b/applications/swarm-nl.md @@ -118,7 +118,7 @@ We have built a PoC for SamaritanDB (see [the Github repo here](https://github.c - **Total Estimated Duration:** 3 months - **Full-Time Equivalent (FTE):** 1 -- **Total Costs:** $24,000 +- **Total Costs:** $48,000 ### Milestone 1