Skip to content

Latest commit

 

History

History
29 lines (18 loc) · 1.25 KB

preparation-scala.md

File metadata and controls

29 lines (18 loc) · 1.25 KB

Prepare packages and dataset for scala

For simplicity export the location to these jars. All examples assume the packages and dataset will be placed in the /opt/xgboost directory:

Download the jars

  1. Download the RAPIDS Accelerator for Apache Spark plugin jar

    Then download the version of the cudf jar that your version of the accelerator depends on.

Build XGBoost Scala Examples

Following this guide, you can get sample_xgboost_apps-0.2.2-jar-with-dependencies.jar and copy it to /opt/xgboost

Download dataset

You need to download mortgage dataset to /opt/xgboost from this site

Setup environments

export SPARK_XGBOOST_DIR=/opt/xgboost
export CUDF_JAR=${SPARK_XGBOOST_DIR}/cudf-21.08.2-cuda11.jar
export RAPIDS_JAR=${SPARK_XGBOOST_DIR}/rapids-4-spark_2.12-21.08.0.jar
export SAMPLE_JAR=${SPARK_XGBOOST_DIR}/sample_xgboost_apps-0.2.2-jar-with-dependencies.jar