-
Notifications
You must be signed in to change notification settings - Fork 90
Bacalhau project report 20220527
This video shows off the new codebase with regard to input and output volumes - it demonstrates using image magick to resize an entire folder of landsat images using a single bacalhau command:
bacalhau-ipfs-volumes-resize.mp4
The command that runs this is shown as follows:
go run . --jsonrpc-port=$JSON_PORT_0 run \
--concurrency 3 \
-v $cid:/input_images \
-o results:/output_images \
dpokidov/imagemagick \
-- magick mogrify -resize 100x100 -quality 100 -path /output_images /input_images/*.jpgThe refactor branch is now merged to main - some time was spent to resolve merge conflicts and fix go module conflicts between the two branches. This is a good example of why not to have long lived branches (guilty!) however - this is now done and everything is working well
There has been various manual testing and trying out different docker images with different inputs before arriving at the landsat demo. This cleared up a few bugs and UX issues along the way :-)
Work has begun on creating a terraform script that will bootstrap an intra-connected bacalhau cluster on google cloud.
This will be the bootstrap cluster that new bacalhau nodes will join automatically (i.e. if there is no overriding connection details provided by the user)
We will start off using a fixed set of IP addresses but fairly quickly move to using a fixed set of DNS based multi-addresses - this is the same thing that go-ipfs does to bootstrap a node.
Discussions regarding what the code needs to do to support the long lived cluster mentioned above have resulted in the following tasks that need to be completed next week:
- complete the launch blockers above
- Docs for bacalhau.org
- Implement Python FaaS in beta