Skip to content

Commit

Permalink
Update README
Browse files Browse the repository at this point in the history
- Remove RC suffix.
- Update README to reflect support
 for CUDA and compressed plots
  • Loading branch information
haorldbchi committed Oct 3, 2023
1 parent 31eba69 commit 0574679
Show file tree
Hide file tree
Showing 3 changed files with 96 additions and 11 deletions.
103 changes: 94 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,71 @@
# BladeBit Chia Plotter
# Bladebit Chia Plotter

[![Release Builds](https://github.com/Chia-Network/bladebit/actions/workflows/build-release.yml/badge.svg?branch=master&event=push)](https://github.com/Chia-Network/bladebit/actions/workflows/build-release.yml)

A high-performance **k32-only**, Chia (XCH) plotter supporting in-RAM and disk-based plotting.
A high-performance **k32-only**, Chia (XCH) plotter.

Bladebit supports 3 plotting modes:
- Fully In-RAM (no drives required), CPU-based mode.
- GPU (CUDA-based) mode. Both fully in-RAM or disk-hybrid mode.
- Disk-based mode

## Usage
Run `bladebit --help` to see general help. For command-specific help, use `bladebit help <command_name>`.

## Requirements

**CUDA**

An NVIDIA GPU is required for this mode. This mode is exposed via the `cudaplot` command in a separate executable "bladebit_cuda". This mode has mainly been tested on consumer cards from the **10xx** series and up.

| Mode | OS | DRAM | VRAM | CUDA capability
|--------------------------------|----------------|------|------|----------------
| In-RAM | Linux, Windows | 256G | 8G | 5.2 and up
| Disk-hybrid 128G | Linux, Windows | 128G | 8G | 5.2 and up
| Disk-hybrid 16G (WIP) | Linux | 16G | 8G | 5.2 and up

> *NOTE: 16G mode currently a work in progress and at this stage it only works in Linux and direct I/O is unavailable in this mode.*

**CPU RAM-Only**

Available on Linux, Windows and macOS.
Requires at least **416G** of system DRAM.


**Disk**

Available on Linux, Windows and macOS.

A minimum of **4 GiB of RAM** is required, with lower bucket counts requiring up to 12 GiB of RAM. Roughly **480 GiB of disk space** is required in the default mode, or around **390 GiB of disk space** with `--alternate` mode enabled.

The exact amounts of RAM and disk space required may vary slightly depending on the system's page size and the target disk file system block size (block-alignment is required for direct I/O).

SSDs are highly recommended for disk-based plotting.


## Compressed Plots

Compressed plots are supported in CUDA mode and in RAM-only mode. CPU Disk-based mode does **NOT** currently support compressed plots.

Compressed plots are currently supported for compression levels from **C1** to **C7**. Note that bladebit compression levels are not compatible with other plotter compression levels. These compression levels are based on the *number of bits dropped from an entry excluding the minimum bits required to fully drop a table*. At `k=32` a the first table is fully excluded from the plot at 16 bits dropped.

> *NOTE: Although higher compression levels are available, support for farming them has not been currently implemented and are therefore disabled. They will be implemented in the future.*
Compression levels are currently roughly equivalent to the following plot sizes.

| Compression Level | Plot Size
|-------------------|-------------
| C1 | 87.5 GiB
| C2 | 86.0 GiB
| C3 | 84.4 GiB
| C4 | 82.8 GiB
| C5 | 81.2 GiB
| C6 | 79.6 GiB
| C7 | 78.0 GiB

These might be optimized in the future with further compression optimizations.


## Requirements

Expand Down Expand Up @@ -39,7 +102,7 @@ SSDs are highly recommended for disk-based plotting.


## Prerequisites
Linux, Windows and MacOS (both intel and ARM (Apple Silicon)) are supported.
Linux, Windows and macOS (both Intel and ARM) are supported.


### Linux
Expand Down Expand Up @@ -83,8 +146,12 @@ cmake --build . --target bladebit --config Release
The resulting binary will be found under the `build/` directory.
On Windows it will be under `build/Release/`.

For **bladebit_cuda**, the CUDA toolkit must be installed. The target name is `bladebit_cuda`.

For simplicity the `build.sh` or `build-cuda.sh` scripts can be used to build. On Windows this requires gitbash or similar bash-based shell to run.

## Usage
Run **bladebit** with the `-h` for complete usage and command line options:
Run **bladebit** (or **bladebit_cuda**) with the `-h` for complete usage and command line options:

```bash
# Linux & macOS
Expand All @@ -93,18 +160,33 @@ build/bladebit -h
# Windows
build/Release/bladebit.exe -h
```
The bladebit CLI uses the format `bladebit <GLOBAL_OPTIONS> <command> <COMMAND_OPTIONS>`.


The bladebit CLI uses the format `bladebit <GLOBAL_OPTIONS> <sub_command> <COMMAND_OPTIONS>`.

Use the aforementioned `-h` parameter to get the full list of sub-commands and `GLOBAL_OPTIONS`.
The `sub_command`-specific `COMMAND_OPTIONS` can be obtained by using the `help` sub command with the desired command as the parameter:
Use the aforementioned `-h` parameter to get the full list of commands and `GLOBAL_OPTIONS`.
The `command`-specific `COMMAND_OPTIONS` can be obtained by using the `help` sub command with the desired command as the parameter:

```bash
bladebit help cudaplot
bladebit help ramplot
bladebit help diskplot
```

### CUDA
Basic `cudaplot` usage:
```bash
# OG plots
./bladebit_cuda -f <farmer_public_key> -p <pool_public_key> cudaplot <output_directory>

# Portable plots
./bladebit_cuda -f <farmer_public_key> -c <pool_contract_address> cudaplot <output_directory>

# Compressed plots
./bladebit_cuda -z <copression_level> -f <farmer_public_key> -c <pool_contract_address> cudaplot <output_directory>

# 128G disk-hybrid mode
./bladebit_cuda -z <copression_level> -f <farmer_public_key> -c <pool_contract_address> cudaplot --disk-128 -t1 <temp_dir> <output_directory>
```

### In-RAM
Basic `ramplot` usage:
```bash
Expand All @@ -113,6 +195,9 @@ Basic `ramplot` usage:

# Portable plots
./bladebit -f <farmer_public_key> -c <pool_contract_address> ramplot <output_directory>

# Compressed plots
./bladebit -z <copression_level> -f <farmer_public_key> -c <pool_contract_address> ramplot <output_directory>
```

### Disk-Based
Expand Down
2 changes: 1 addition & 1 deletion VERSION
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
3.1.0
rc2

2 changes: 1 addition & 1 deletion src/main.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -367,7 +367,7 @@ void ParseCommandLine( GlobalPlotConfig& cfg, IPlotter*& outPlotter, int argc, c
// The remainder should be output folders, which we parse after the plotter consumes it's config

///
/// Validate global conifg
/// Validate global config
///
FatalIf( farmerPublicKey == nullptr, "A farmer public key must be specified." );
FatalIf( !KeyTools::HexPKeyToG1Element( farmerPublicKey, *(cfg.farmerPublicKey = new bls::G1Element()) ),
Expand Down

0 comments on commit 0574679

Please sign in to comment.