Skip to content

Latest commit

 

History

History
 
 

docs

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
data
data
 
 
doxygen
doxygen
 
 
examples
examples
 
 
sphinx
sphinx
 
 
user_guide
user_guide
 
 
README.md
README.md
 
 
conf.py
conf.py
 
 
examples.md
examples.md
 
 
license.md
license.md
 
 

README.md

rocAL User Guide

Today’s deep learning applications require loading and pre-processing data efficiently to achieve high processing throughput. This requires creating efficient processing pipelines fully utilizing the underlying hardware capabilities. Some examples are load and decode data, do a variety of augmentations, color-format conversions, etc. Deep learning frameworks require supporting multiple data formats and augmentations to adapt to a variety of data-sets and models.

AMD ROCm Augmentation Library (rocAL) is designed to efficiently do such processing pipelines from both images and video as well as from a variety of storage formats. These pipelines are programmable by the user using both C++ and Python APIs.

User Guide Chapters

Key Components of rocAL

  • Full processing pipeline support for data_loading, meta-data loading, augmentations, and data-format conversions for training and inference.
  • Being able to do processing on CPU or Radeon GPU (with OpenCL or HIP backend)
  • Ease of integration with framework plugins in Python
  • Support variety of augmentation operations through AMD’s Radeon Performance Primitives (RPP).
  • All available public and open-sourced under ROCm.

Prerequisites

Refer rocAL Prerequisites

Build instructions

Refer rocAL build instructions

rocAL Python

  • rocAL Python package has been created using Pybind11 which enables data transfer between rocAL C++ API and Python API.
  • Module imports are made similar to other data loaders like NVidia's DALI.
  • rocal_pybind package has both PyTorch and TensorFlow framework support.
  • Various reader format support including FileReader, COCOReader, and TFRecordReader.
  • example folder contains sample implementations for each reader variation as well as sample training script for PyTorch
  • rocAL is integrated into MLPerf Resnet-50 Pytorch classification example on the ImageNet dataset.

rocAL Python API

amd.rocal.fn

  • Contains the image augmentations & file read and decode operations which are linked to rocAL C++ API
  • All ops (listed below) are supported for the single input image and batched inputs.
Image Augmentation Reader and Decoder Geometric Ops
ColorTwist File Reader CropMirrorNormalize
Brightness ImageDecoder Resize
Gamma Correction ImageDecoderRandomCrop ResizeCrop
Snow COCOReader WarpAffine
Rain TFRecordReader FishEye
Blur LensCorrection
Jitter Rotate
Hue
Saturation
Fog
Contrast
Vignette
SNPNoise
Pixelate
Blend

amd.rocal.pipeline

  • Contains Pipeline class which has all the data needed to build and run the rocAL graph.
  • Contains support for context/graph creation, verify and run the graph.
  • Has data transfer functions to exchange data between frameworks and rocAL
  • define_graph functionality has been implemented to add nodes to build a pipeline graph.

amd.rocal.types

amd.rocal.types are enums exported from C++ API to python. Some examples include CPU, GPU, FLOAT, FLOAT16, RGB, GRAY, etc..

amd.rocal.plugin.pytorch

  • Contains ROCALGenericIterator for Pytorch.
  • ROCALClassificationIterator class implements iterator for image classification and return images with corresponding labels.
  • From the above classes, any hybrid iterator pipeline can be created by adding augmentations.
  • see example PyTorch Simple Example. Requires PyTorch.

installing rocAL python plugin (Python 3.6)

  • Build and install RPP
  • Build and install MIVisionX which installs rocAL c++ lib
  • Go to rocal_pybind folder
  • sudo ./run.sh

Steps to run MLPerf Resnet50 classification training with rocAL on a system with MI50+ and ROCm

  • Step 1: Ensure you have downloaded ILSVRC2012_img_val.tar (6.3GB) and ILSVRC2012_img_train.tar (138 GB) files and unzip into train and val folders
  • Step 2: Build MIVisionX Pytorch docker
  • Step 3: Install rocAL python_pybind plugin as described above
  • Step 4: Clone MLPerf branch and checkout mlperf-v1.1-rocal branch
git clone -b mlperf-v1.1-rocal https://github.com/rrawther/MLPerf-mGPU
  • Step 5: Modify RN50_AMP_LARS_8GPUS_NCHW.sh or RN50_AMP_LARS_8GPUS_NHWC.sh to reflect correct path for imagenet directory
  • Step 8: Run RN50_AMP_LARS_8GPUS_NCHC.sh or RN50_AMP_LARS_8GPUS_NHWC.sh
./RN50_AMP_LARS_8GPUS_NCHW.sh 
(or)
./RN50_AMP_LARS_8GPUS_NHWC.sh

MIVisionX Pytorch Docker

  • Refer to the docker page for prerequisites and information on building the docker
  • Step 1: Run the docker image*
sudo docker run -it -v <Path-To-Data-HostSystem>:/data -v /<Path-to-GitRepo>:/dockerx -w /dockerx --privileged --device=/dev/kfd --device=/dev/dri --group-add video --shm-size=4g --ipc="host" --network=host <docker-name>
  • Optional: Map localhost directory on the docker image
    • option to map the localhost directory with imagenet dataset folder to be accessed on the docker image.
    • usage: -v {LOCAL_HOST_DIRECTORY_PATH}:{DOCKER_DIRECTORY_PATH}