Skip to content

Latest commit

 

History

History
176 lines (147 loc) · 9.46 KB

DEVELOPER_GUIDE.md

File metadata and controls

176 lines (147 loc) · 9.46 KB

CV-CUDA Developer Guide

What is CV-CUDA?

CV-CUDA™ is an open-source, graphics processing unit (GPU)-accelerated library for cloud-scale image processing and computer vision developed jointly by NVIDIA and the ByteDance Applied Machine Learning teams. CV-CUDA helps developers build highly efficient pre- and post-processing pipelines that can improve throughput by more than 10x while lowering cloud computing costs.

CV-CUDA includes:

  • A unified, specialized set of high-performance CV and image processing kernels
  • C, C++, and Python APIs
  • Batching support, with variable shape images
  • Zero-copy interfaces to PyTorch
  • Sample applications: object classification and image segmentation

What Pre- and Post-Processing Operators Are Included?

Pre/Post-Processing Operators Definition
Adaptive Thresholding Computes the threshold value for each fractional region of the image
AverageBlur Reduces image noise using an average filter
BilateralFilter Reduces image noise while preserving strong edges
Bounding Box Draws an overlay 2D rectangular bounding box using the coordinate points
Bounding Box Blur Adds a 2D rectangular blur in the region of interest
(ROI) using the coordinate points
CenterCrop Crops an image at its center
ChannelReorder Shuffles the order of image channels
Composite Composites two images together
Conv2D Convolves an image with a provided kernel
CopyMakeBorder Creates a border around an image
CustomCrop Crops an image with a given region-of-interest
CvtColor Converts an image from one color space to another
DataTypeConvert Converts an image’s data type, with optional scaling
Erase Erases image regions
Flip Flips a 2D image around its axis
GammaContrast Adjusts image contrast based on gamma value
Gaussian Applies a gaussian blur filter to the image
JointBilateralFilter Reduces image noise while preserving strong edges
based on a guidance image
Laplacian Applies a Laplace transform to an image
MedianBlur Reduces an image’s salt-and-pepper noise
Morphology Performs morphological erode and dilate transformations
Non-Max Suppression Selects the best bounding box out of a set of
overlapping boxes based on IOU and confidence thresholds
Normalize Normalizes an image pixel’s range
PadStack Stacks several images into a tensor, with border extension
PillowResize Changes the size and scale of an image using python-pillow algorithm
Reformat Converts a planar image into non-planar and vice versa
Remap Applies a generic geometrical transformation to an image, for
example, to perform fisheye dewarping
Resize Changes the size and scale of an image
Rotate Rotates a 2D array in multiples of 90 degrees
Thresholding Computes the threshold value based on the histogram of the
overall pixel intensity distribution of the image
WarpAffine Applies an affine transformation to an image
WarpPerspective Applies a perspective transformation to an image

Where Are the Release Notes?

An awesome product requires excellent support. CV-CUDA release notes can be found here

Where Can I Get Help?

File requests for enhancements and bug reports here.

We are providing limited, direct, support to select enterprises using CV-CUDA. To apply for direct enterprise developer engagement from NVIDIA , please fill out the early access developer application here.

What Other Computer Vision Products Does NVIDIA Offer?

NVIDIA offers a number of computer vision products

In addition to cloud-scale computer vision and image processing, NVIDIA offers:

  • DALI (Data Loading Library), a portable, holistic framework for accelerated data loading and augmentation in deep learning workflows involving images, videos, and audio data.
  • VPI (Vision Programming Interface), an accelerated computer vision and image processing software library primarily for embedded/edge applications.
  • cuCIM (Compute Unified Device Architecture Clara Image), an open source, accelerated computer vision and image processing library for multidimensional images in biomedical, geospatial, material life science, and remote sensing use cases.
  • NPP (NVIDIA Performance Primitives), an image, signal, and video processing library that accelerates and performs domain-specific functions.

If you want to learn more about what computer vision solutions are available, review the computer vision solutions landing page.


Notice

The information provided in this specification is believed to be accurate and reliable as of the date provided. However, NVIDIA Corporation (“NVIDIA”) does not give any representations or warranties, expressed or implied, as to the accuracy or completeness of such information. NVIDIA shall have no liability for the consequences or use of such information or for any infringement of patents or other rights of third parties that may result from its use. This publication supersedes and replaces all other specifications for the product that may have been previously supplied.

NVIDIA reserves the right to make corrections, modifications, enhancements, improvements, and other changes to this specification, at any time and/or to discontinue any product or service without notice. Customer should obtain the latest relevant specification before placing orders and should verify that such information is current and complete.

NVIDIA products are sold subject to the NVIDIA standard terms and conditions of sale supplied at the time of order acknowledgement, unless otherwise agreed in an individual sales agreement signed by authorized representatives of NVIDIA and customer. NVIDIA hereby expressly objects to applying any customer general terms and conditions with regards to the purchase of the NVIDIA product referenced in this specification.

NVIDIA products are not designed, authorized or warranted to be suitable for use in medical, military, aircraft, space or life support equipment, nor in applications where failure or malfunction of the NVIDIA product can reasonably be expected to result in personal injury, death or property or environmental damage. NVIDIA accepts no liability for inclusion and/or use of NVIDIA products in such equipment or applications and therefore such inclusion and/or use is at customer’s own risk.

NVIDIA makes no representation or warranty that products based on these specifications will be suitable for any specified use without further testing or modification. Testing of all parameters of each product is not necessarily performed by NVIDIA. It is customer’s sole responsibility to ensure the product is suitable and fit for the application planned by customer and to do the necessary testing for the application in order to avoid a default of the application or the product. Weaknesses in customer’s product designs may affect the quality and reliability of the NVIDIA product and may result in additional or different conditions and/or requirements beyond those contained in this specification. NVIDIA does not accept any liability related to any default, damage, costs or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this specification, or (ii) customer product designs.

No license, either expressed or implied, is granted under any NVIDIA patent right, copyright, or other NVIDIA intellectual property right under this specification. Information published by NVIDIA regarding third-party products or services does not constitute a license from NVIDIA to use such products or services or a warranty or endorsement thereof. Use of such information may require a license from a third party under the patents or other intellectual property rights of the third party, or a license from NVIDIA under the patents or other intellectual property rights of NVIDIA. Reproduction of information in this specification is permissible only if reproduction is approved by NVIDIA in writing, is reproduced without alteration, and is accompanied by all associated conditions, limitations, and notices.

ALL NVIDIA DESIGN SPECIFICATIONS, REFERENCE BOARDS, FILES, DRAWINGS, DIAGNOSTICS, LISTS, AND OTHER DOCUMENTS (TOGETHER AND SEPARATELY, “MATERIALS”) ARE BEING PROVIDED “AS IS.” NVIDIA MAKES NO WARRANTIES, EXPRESSED, IMPLIED, STATUTORY, OR OTHERWISE WITH RESPECT TO THE MATERIALS, AND EXPRESSLY DISCLAIMS ALL IMPLIED WARRANTIES OF NONINFRINGEMENT, MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE. Notwithstanding any damages that customer might incur for any reason whatsoever, NVIDIA’s aggregate and cumulative liability towards customer for the products described herein shall be limited in accordance with the NVIDIA terms and conditions of sale for the product.

Trademarks

NVIDIA, the NVIDIA logo, NVIDIA CV-CUDA, and NVIDIA TensorRT are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated.

Copyright

© 2023 NVIDIA CORPORATION & AFFILIATES. All rights reserved.