cuDF 0.9.0 (Date TBD)

New Features

PR #2111 IO Readers: Support memory buffer, file-like object, and URL inputs
PR #2012 Add reindex() to DataFrame and Series
PR #2098 Align DataFrame and Series indices before executing binary ops
PR #2160 Merge dask-cudf codebase into cudf repo
PR #2149 CSV Reader: Add hex dtype for explicit hexadecimal parsing
PR #2158 CSV Reader: Support single, non-list/dict argument for dtype
PR #2177 CSV Reader: Add parse_dates parameter for explicit date inference
PR #2171 Add CodeCov integration, fix doc version, make --skip-tests work when invoking with source
PR #2215 type_dispatcher benchmark
PR #2179 Added Java quantiles
PR #2157 Add array_function to DataFrame and Series
PR #2212 Java support for ORC reader

Improvements

PR #2103 Move old column and bitmask files into legacy/ directory
PR #2109 added name to Python column classes
PR #1947 Cleanup serialization code
PR #2125 More aggregate in java API
PR #2127 Add in java Scalar tests
PR #2088 Refactor of Python groupby code
PR #2130 Java serialization and deserialization of tables.
PR #2131 Chunk rows logic added to csv_writer
PR #2129 Add functions in the Java API to support nullable column filtering
PR #2165 made changes to get_dummies api for it to be available in MethodCache
PR #2184 handle remote orc files for dask-cudf
PR #2186 Add getitem and getattr style access to Rolling objects
PR #2168 Use cudf.Column for CategoricalColumn's categories instead of a tuple
PR #2193 Added more docuemtnation to type_dispatcher for specializing dispatched functors
PR #2197 CSV Writer: Expose chunksize as a parameter for to_csv
PR #2199 Better java support for appending strings
PR #2176 Added column dtype support for datetime, int8, int16 to csv_writer
PR #2209 Matching get_dummies & select_dtypes behavior to pandas
PR #2217 Updated Java bindings to use the new groupby API
PR #2214 DOC: Update doc instructions to build/install cudf and dask-cudf
PR #1993 Add iterator driven reduction for mean, var, std
PR #2220 Update Java bindings for reduction rename
PR #2224 implement isna, isnull, notna as dataframe functions
PR #2236 Implement drop_duplicates for Series
PR #2225 refactor to use libcudf for gathering columns in dataframes
PR #2300 Create separate dask codeowners for dask-cudf codebase

Bug Fixes

PR #2086 Fixed quantile api behavior mismatch in series & dataframe
PR #2128 Add offset param to host buffer readers in java API.
PR #2145 Work around binops validity checks for java
PR #2146 Work around unary_math validity checks for java
PR #2151 Fixes bug in cudf::copy_range where null_count was invalid
PR #2139 matching to pandas describe behavior & fixing nan values issue
PR #2161 Implicitly convert unsigned to signed integer types in binops
PR #2154 CSV Reader: Fix bools misdetected as strings dtype
PR #2178 Fix bug in rolling bindings where a view of an ephemeral column was being taken
PR #2180 Fix issue with isort reordering importorskip below imports depending on them
PR #2187 fix to honor dtype when numpy arrays are passed to columnops.as_column
PR #2190 Fix issue in astype conversion of string column to 'str'
PR #2208 Fix issue with calling head() on one row dataframe
PR #2229 Propagate exceptions from Cython cdef functions
PR #2234 Fix issue with local build script not properly building
PR #2223 Fix CUDA invalid configuration errors reported after loading small compressed ORC files
PR #2162 Setting is_unique and is_monotonic-related attributes
PR #2244 Fix ORC RLEv2 delta mode decoding with nonzero residual delta width
PR #2297 Work around var/std unsupported only at debug build
PR #2302 Fixed java serialization corner case

cuDF 0.8.0 (27 June 2019)

New Features

PR #1524 Add GPU-accelerated JSON Lines parser with limited feature set
PR #1569 Add support for Json objects to the JSON Lines reader
PR #1622 Add Series.loc
PR #1654 Add cudf::apply_boolean_mask: faster replacement for gdf_apply_stencil
PR #1487 cython gather/scatter
PR #1310 Implemented the slice/split functionality.
PR #1630 Add Python layer to the GPU-accelerated JSON reader
PR #1745 Add rounding of numeric columns via Numba
PR #1772 JSON reader: add support for BytesIO and StringIO input
PR #1527 Support GDF_BOOL8 in readers and writers
PR #1819 Logical operators (AND, OR, NOT) for libcudf and cuDF
PR #1813 ORC Reader: Add support for stripe selection
PR #1828 JSON Reader: add suport for bool8 columns
PR #1833 Add column iterator with/without nulls
PR #1665 Add the point-in-polygon GIS function
PR #1863 Series and Dataframe methods for all and any
PR #1908 cudf::copy_range and cudf::fill for copying/assigning an index or range to a constant
PR #1921 Add additional formats for typecasting to/from strings
PR #1807 Add Series.dropna()
PR #1987 Allow user defined functions in the form of ptx code to be passed to binops
PR #1948 Add operator functions like Series.add() to DataFrame and Series
PR #1954 Add skip test argument to GPU build script
PR #2018 Add bindings for new groupby C++ API
PR #1984 Add rolling window operations Series.rolling() and DataFrame.rolling()
PR #1542 Python method and bindings for to_csv
PR #1995 Add Java API
PR #1998 Add google benchmark to cudf
PR #1845 Add cudf::drop_duplicates, DataFrame.drop_duplicates
PR #1652 Added Series.where() feature
PR #2074 Java Aggregates, logical ops, and better RMM support

Improvements

PR #1538 Replacing LesserRTTI with inequality_comparator
PR #1703 C++: Added non-aggregating insert to concurrent_unordered_map with specializations to store pairs with a single atomicCAS when possible.
PR #1422 C++: Added a RAII wrapper for CUDA streams
PR #1701 Added unique method for stringColumns
PR #1713 Add documentation for Dask-XGBoost
PR #1666 CSV Reader: Improve performance for files with large number of columns
PR #1725 Enable the ability to use a single column groupby as its own index
PR #1759 Add an example showing simultaneous rolling averages to apply_grouped documentation
PR #1746 C++: Remove unused code: windowed_ops.cu, sorting.cu, hash_ops.cu
PR #1748 C++: Add bool nullability flag to device_table row operators
PR #1764 Improve Numerical column: mean_var and mean
PR #1767 Speed up Python unit tests
PR #1770 Added build.sh script, updated CI scripts and documentation
PR #1739 ORC Reader: Add more pytest coverage
PR #1696 Added null support in Series.replace().
PR #1390 Added some basic utility functions for gdf_column's
PR #1791 Added general column comparison code for testing
PR #1795 Add printing of git submodule info to print_env.sh
PR #1796 Removing old sort based group by code and gdf_filter
PR #1811 Added funtions for copying/allocating cudf::tables
PR #1838 Improve columnops.column_empty so that it returns typed columns instead of a generic Column
PR #1890 Add utils.get_dummies- a pandas-like wrapper around one_hot-encoding
PR #1823 CSV Reader: default the column type to string for empty dataframes
PR #1827 Create bindings for scalar-vector binops, and update one_hot_encoding to use them
PR #1817 Operators now support different sized dataframes as long as they don't share different sized columns
PR #1855 Transition replace_nulls to new C++ API and update corresponding Cython/Python code
PR #1858 Add std::initializer_list constructor to column_wrapper
PR #1846 C++ type-erased gdf_equal_columns test util; fix gdf_equal_columns logic error
PR #1390 Added some basic utility functions for gdf_columns
PR #1391 Tidy up bit-resolution-operation and bitmask class code
PR #1882 Add iloc functionality to MultiIndex dataframes
PR #1884 Rolling windows: general enhancements and better coverage for unit tests
PR #1886 support GDF_STRING_CATEGORY columns in apply_boolean_mask, drop_nulls and other libcudf functions
PR #1896 Improve performance of groupby with levels specified in dask-cudf
PR #1915 Improve iloc performance for non-contiguous row selection
PR #1859 Convert read_json into a C++ API
PR #1919 Rename libcudf namespace gdf to namespace cudf
PR #1850 Support left_on and right_on for DataFrame merge operator
PR #1930 Specialize constructor for cudf::bool8 to cast argument to bool
PR #1938 Add default constructor for column_wrapper
PR #1930 Specialize constructor for cudf::bool8 to cast argument to bool
PR #1952 consolidate libcudf public API headers in include/cudf
PR #1949 Improved selection with boolmask using libcudf apply_boolean_mask
PR #1956 Add support for nulls in query()
PR #1973 Update std::tuple to std::pair in top-most libcudf APIs and C++ transition guide
PR #1981 Convert read_csv into a C++ API
PR #1868 ORC Reader: Support row index for speed up on small/medium datasets
PR #1964 Added support for list-like types in Series.str.cat
PR #2005 Use HTML5 details tag in bug report issue template
PR #2003 Removed few redundant unit-tests from test_string.py::test_string_cat
PR #1944 Groupby design improvements
PR #2017 Convert read_orc() into a C++ API
PR #2011 Convert read_parquet() into a C++ API
PR #1756 Add documentation "10 Minutes to cuDF and dask_cuDF"
PR #2034 Adding support for string columns concatenation using "add" binary operator
PR #2042 Replace old "10 Minutes" guide with new guide for docs build process
PR #2036 Make library of common test utils to speed up tests compilation
PR #2022 Facilitating get_dummies to be a high level api too
PR #2050 Namespace IO readers and add back free-form read_xxx functions
PR #2104 Add a functional sort= keyword argument to groupby
PR #2108 Add find_and_replace for StringColumn for replacing single values

Bug Fixes

PR #1465 Fix for test_orc.py and test_sparse_df.py test failures
PR #1583 Fix underlying issue in as_index() that was causing Series.quantile() to fail
PR #1680 Add errors= keyword to drop() to fix cudf-dask bug
PR #1651 Fix query function on empty dataframe
PR #1616 Fix CategoricalColumn to access categories by index instead of iteration
PR #1660 Fix bug in loc when indexing with a column name (a string)
PR #1683 ORC reader: fix timestamp conversion to UTC
PR #1613 Improve CategoricalColumn.fillna(-1) performance
PR #1642 Fix failure of CSV_TEST gdf_csv_test.SkiprowsNrows on multiuser systems
PR #1709 Fix handling of datetime64[ms] in dataframe.select_dtypes
PR #1704 CSV Reader: Add support for the plus sign in number fields
PR #1687 CSV reader: return an empty dataframe for zero size input
PR #1757 Concatenating columns with null columns
PR #1755 Add col_level keyword argument to melt
PR #1758 Fix df.set_index() when setting index from an empty column
PR #1749 ORC reader: fix long strings of NULL values resulting in incorrect data
PR #1742 Parquet Reader: Fix index column name to match PANDAS compat
PR #1782 Update libcudf doc version
PR #1783 Update conda dependencies
PR #1786 Maintain the original series name in series.unique output
PR #1760 CSV Reader: fix segfault when dtype list only includes columns from usecols list
PR #1831 build.sh: Assuming python is in PATH instead of using PYTHON env var
PR #1839 Raise an error instead of segfaulting when transposing a DataFrame with StringColumns
PR #1840 Retain index correctly during merge left_on right_on
PR #1825 cuDF: Multiaggregation Groupby Failures
PR #1789 CSV Reader: Fix missing support for specifying int8 and int16 dtypes
PR #1857 Cython Bindings: Handle bool columns while calling column_view_from_NDArrays
PR #1849 Allow DataFrame support methods to pass arguments to the methods
PR #1847 Fixed #1375 by moving the nvstring check into the wrapper function
PR #1864 Fixing cudf reduction for POWER platform
PR #1869 Parquet reader: fix Dask timestamps not matching with Pandas (convert to milliseconds)
PR #1876 add dtype=bool for any, all to treat integer column correctly
PR #1875 CSV reader: take NaN values into account in dtype detection
PR #1873 Add column dtype checking for the all/any methods
PR #1902 Bug with string iteration in _apply_basic_agg
PR #1887 Fix for initialization issue in pq_read_arg,orc_read_arg
PR #1867 JSON reader: add support for null/empty fields, including the 'null' literal
PR #1891 Fix bug #1750 in string column comparison
PR #1909 Support of to_pandas() of boolean series with null values
PR #1923 Use prefix removal when two aggs are called on a SeriesGroupBy
PR #1914 Zero initialize gdf_column local variables
PR #1959 Add support for comparing boolean Series to scalar
PR #1966 Ignore index fix in series append
PR #1967 Compute index sizeof only once for DataFrame sizeof
PR #1977 Support CUDA installation in default system directories
PR #1982 Fixes incorrect index name after join operation
PR #1985 Implement GDF_PYMOD, a special modulo that follows python's sign rules
PR #1991 Parquet reader: fix decoding of NULLs
PR #1990 Fixes a rendering bug in the apply_grouped documentation
PR #1978 Fix for values being filled in an empty dataframe
PR #2001 Correctly create MultiColumn from Pandas MultiColumn
PR #2006 Handle empty dataframe groupby construction for dask
PR #1965 Parquet Reader: Fix duplicate index column when it's already in use_cols
PR #2033 Add pip to conda environment files to fix warning
PR #2028 CSV Reader: Fix reading of uncompressed files without a recognized file extension
PR #2073 Fix an issue when gathering columns with NVCategory and nulls
PR #2053 cudf::apply_boolean_mask return empty column for empty boolean mask
PR #2066 exclude IteratorTest.mean_var_output test from debug build
PR #2069 Fix JNI code to use read_csv and read_parquet APIs
PR #2071 Fix bug with unfound transitive dependencies for GTests in Ubuntu 18.04
PR #2089 Configure Sphinx to render params correctly
PR #2091 Fix another bug with unfound transitive dependencies for cudftestutils in Ubuntu 18.04
PR #2115 Just apply --disable-new-dtags instead of trying to define all the transitive dependencies
PR #2106 Fix errors in JitCache tests caused by sharing of device memory between processes
PR #2120 Fix errors in JitCache tests caused by running multiple threads on the same data
PR #2102 Fix memory leak in groupby
PR #2113 fixed typo in to_csv code example

cudf 0.7.2 (16 May 2019)

New Features

PR #1735 Added overload for atomicAdd on int64. Streamlined implementation of custom atomic overloads.
PR #1741 Add MultiIndex concatenation

Bug Fixes

PR #1718 Fix issue with SeriesGroupBy MultiIndex in dask-cudf
PR #1734 Python: fix performance regression for groupby count() aggregations
PR #1768 Cython: fix handling read only schema buffers in gpuarrow reader

cudf 0.7.1 (11 May 2019)

New Features

PR #1702 Lazy load MultiIndex to return groupby performance to near optimal.

Bug Fixes

PR #1708 Fix handling of datetime64[ms] in dataframe.select_dtypes

cuDF 0.7.0 (10 May 2019)

New Features

PR #982 Implement gdf_group_by_without_aggregations and gdf_unique_indices functions
PR #1142 Add GDF_BOOL column type
PR #1194 Implement overloads for CUDA atomic operations
PR #1292 Implemented Bitwise binary ops AND, OR, XOR (&, |, ^)
PR #1235 Add GPU-accelerated Parquet Reader
PR #1335 Added local_dict arg in DataFrame.query().
PR #1282 Add Series and DataFrame.describe()
PR #1356 Rolling windows
PR #1381 Add DataFrame._get_numeric_data
PR #1388 Add CODEOWNERS file to auto-request reviews based on where changes are made
PR #1396 Add DataFrame.drop method
PR #1413 Add DataFrame.melt method
PR #1412 Add DataFrame.pop()
PR #1419 Initial CSV writer function
PR #1441 Add Series level cumulative ops (cumsum, cummin, cummax, cumprod)
PR #1420 Add script to build and test on a local gpuCI image
PR #1440 Add DatetimeColumn.min(), DatetimeColumn.max()
PR #1455 Add Series.Shift via Numba kernel
PR #1441 Add Series level cumulative ops (cumsum, cummin, cummax, cumprod)
PR #1461 Add Python coverage test to gpu build
PR #1445 Parquet Reader: Add selective reading of rows and row group
PR #1532 Parquet Reader: Add support for INT96 timestamps
PR #1516 Add Series and DataFrame.ndim
PR #1556 Add libcudf C++ transition guide
PR #1466 Add GPU-accelerated ORC Reader
PR #1565 Add build script for nightly doc builds
PR #1508 Add Series isna, isnull, and notna
PR #1456 Add Series.diff() via Numba kernel
PR #1588 Add Index astype typecasting
PR #1301 MultiIndex support
PR #1599 Level keyword supported in groupby
PR #929 Add support operations to dataframe
PR #1609 Groupby accept list of Series
PR #1658 Support group_keys=True keyword in groupby method

Improvements

PR #1531 Refactor closures as private functions in gpuarrow
PR #1404 Parquet reader page data decoding speedup
PR #1076 Use type_dispatcher in join, quantiles, filter, segmented sort, radix sort and hash_groupby
PR #1202 Simplify README.md
PR #1149 CSV Reader: Change convertStrToValue() functions to __device__ only
PR #1238 Improve performance of the CUDA trie used in the CSV reader
PR #1245 Use file cache for JIT kernels
PR #1278 Update CONTRIBUTING for new conda environment yml naming conventions
PR #1163 Refactored UnaryOps. Reduced API to two functions: gdf_unary_math and gdf_cast. Added abs, -, and ~ ops. Changed bindings to Cython
PR #1284 Update docs version
PR #1287 add exclude argument to cudf.select_dtype function
PR #1286 Refactor some of the CSV Reader kernels into generic utility functions
PR #1291 fillna in Series.to_gpu_array() and Series.to_array() can accept the scalar too now.
PR #1005 generic reduction and scan support
PR #1349 Replace modernGPU sort join with thrust.
PR #1363 Add a dataframe.mean(...) that raises NotImplementedError to satisfy dask.dataframe.utils.is_dataframe_like
PR #1319 CSV Reader: Use column wrapper for gdf_column output alloc/dealloc
PR #1376 Change series quantile default to linear
PR #1399 Replace CFFI bindings for NVTX functions with Cython bindings
PR #1389 Refactored set_null_count()
PR #1386 Added macros GDF_TRY(), CUDF_TRY() and ASSERT_CUDF_SUCCEEDED()
PR #1435 Rework CMake and conda recipes to depend on installed libraries
PR #1391 Tidy up bit-resolution-operation and bitmask class code
PR #1439 Add cmake variable to enable compiling CUDA code with -lineinfo
PR #1462 Add ability to read parquet files from arrow::io::RandomAccessFile
PR #1453 Convert CSV Reader CFFI to Cython
PR #1479 Convert Parquet Reader CFFI to Cython
PR #1397 Add a utility function for producing an overflow-safe kernel launch grid configuration
PR #1382 Add GPU parsing of nested brackets to cuIO parsing utilities
PR #1481 Add cudf::table constructor to allocate a set of gdf_columns
PR #1484 Convert GroupBy CFFI to Cython
PR #1463 Allow and default melt keyword argument var_name to be None
PR #1486 Parquet Reader: Use device_buffer rather than device_ptr
PR #1525 Add cudatoolkit conda dependency
PR #1520 Renamed src/dataframe to src/table and moved table.hpp. Made types.hpp to be type declarations only.
PR #1492 Convert transpose CFFI to Cython
PR #1495 Convert binary and unary ops CFFI to Cython
PR #1503 Convert sorting and hashing ops CFFI to Cython
PR #1522 Use latest release version in update-version CI script
PR #1533 Remove stale join CFFI, fix memory leaks in join Cython
PR #1521 Added row_bitmask to compute bitmask for rows of a table. Merged valids_ops.cu and bitmask_ops.cu
PR #1553 Overload hash_row to avoid using intial hash values. Updated gdf_hash to select between overloads
PR #1585 Updated cudf::table to maintain own copy of wrapped gdf_column*s
PR #1559 Add except + to all Cython function definitions to catch C++ exceptions properly
PR #1617 has_nulls and column_dtypes for cudf::table
PR #1590 Remove CFFI from the build / install process entirely
PR #1536 Convert gpuarrow CFFI to Cython
PR #1655 Add Column._pointer as a way to access underlying gdf_column* of a Column
PR #1655 Update readme conda install instructions for cudf version 0.6 and 0.7

Bug Fixes

PR #1233 Fix dtypes issue while adding the column to str dataframe.
PR #1254 CSV Reader: fix data type detection for floating-point numbers in scientific notation
PR #1289 Fix looping over each value instead of each category in concatenation
PR #1293 Fix Inaccurate error message in join.pyx
PR #1308 Add atomicCAS overload for int8_t, int16_t
PR #1317 Fix catch polymorphic exception by reference in ipc.cu
PR #1325 Fix dtype of null bitmasks to int8
PR #1326 Update build documentation to use -DCMAKE_CXX11_ABI=ON
PR #1334 Add "na_position" argument to CategoricalColumn sort_by_values
PR #1321 Fix out of bounds warning when checking Bzip2 header
PR #1359 Add atomicAnd/Or/Xor for integers
PR #1354 Fix fillna() behaviour when replacing values with different dtypes
PR #1347 Fixed core dump issue while passing dict_dtypes without column names in cudf.read_csv()
PR #1379 Fixed build failure caused due to error: 'col_dtype' may be used uninitialized
PR #1392 Update cudf Dockerfile and package_versions.sh
PR #1385 Added INT8 type to _schema_to_dtype for use in GpuArrowReader
PR #1393 Fixed a bug in gdf_count_nonzero_mask() for the case of 0 bits to count
PR #1395 Update CONTRIBUTING to use the environment variable CUDF_HOME
PR #1416 Fix bug at gdf_quantile_exact and gdf_quantile_appox
PR #1421 Fix remove creation of series multiple times during add_column()
PR #1405 CSV Reader: Fix memory leaks on read_csv() failure
PR #1328 Fix CategoricalColumn to_arrow() null mask
PR #1433 Fix NVStrings/categories includes
PR #1432 Update NVStrings to 0.7.* to coincide with 0.7 development
PR #1483 Modify CSV reader to avoid cropping blank quoted characters in non-string fields
PR #1446 Merge 1275 hotfix from master into branch-0.7
PR #1447 Fix legacy groupby apply docstring
PR #1451 Fix hash join estimated result size is not correct
PR #1454 Fix local build script improperly change directory permissions
PR #1490 Require Dask 1.1.0+ for is_dataframe_like test or skip otherwise.
PR #1491 Use more specific directories & groups in CODEOWNERS
PR #1497 Fix Thrust issue on CentOS caused by missing default constructor of host_vector elements
PR #1498 Add missing include guard to device_atomics.cuh and separated DEVICE_ATOMICS_TEST
PR #1506 Fix csv-write call to updated NVStrings method
PR #1510 Added nvstrings fillna() function
PR #1507 Parquet Reader: Default string data to GDF_STRING
PR #1535 Fix doc issue to ensure correct labelling of cudf.series
PR #1537 Fix undefined reference link error in HashPartitionTest
PR #1548 Fix ci/local/build.sh README from using an incorrect image example
PR #1551 CSV Reader: Fix integer column name indexing
PR #1586 Fix broken scalar_wrapper::operator==
PR #1591 ORC/Parquet Reader: Fix missing import for FileNotFoundError exception
PR #1573 Parquet Reader: Fix crash due to clash with ORC reader datasource
PR #1607 Revert change of column.to_dense_buffer always return by copy for performance concerns
PR #1618 ORC reader: fix assert & data output when nrows/skiprows isn't aligned to stripe boundaries
PR #1631 Fix failure of TYPES_TEST on some gcc-7 based systems.
PR #1641 CSV Reader: Fix skip_blank_lines behavior with Windows line terminators (\r\n)
PR #1648 ORC reader: fix non-deterministic output when skiprows is non-zero
PR #1676 Fix groupby as_index behaviour with MultiIndex
PR #1659 Fix bug caused by empty groupbys and multiindex slicing throwing exceptions
PR #1656 Correct Groupby failure in dask when un-aggregable columns are left in dataframe.
PR #1689 Fix groupby performance regression
PR #1694 Add Cython as a runtime dependency since it's required in setup.py

cuDF 0.6.1 (25 Mar 2019)

Bug Fixes

PR #1275 Fix CentOS exception in DataFrame.hash_partition from using value "returned" by a void function

cuDF 0.6.0 (22 Mar 2019)

New Features

PR #760 Raise FileNotFoundError instead of GDF_FILE_ERROR in read_csv if the file does not exist
PR #539 Add Python bindings for replace function
PR #823 Add Doxygen configuration to enable building HTML documentation for libcudf C/C++ API
PR #807 CSV Reader: Add byte_range parameter to specify the range in the input file to be read
PR #857 Add Tail method for Series/DataFrame and update Head method to use iloc
PR #858 Add series feature hashing support
PR #871 CSV Reader: Add support for NA values, including user specified strings
PR #893 Adds PyArrow based parquet readers / writers to Python, fix category dtype handling, fix arrow ingest buffer size issues
PR #867 CSV Reader: Add support for ignoring blank lines and comment lines
PR #887 Add Series digitize method
PR #895 Add Series groupby
PR #898 Add DataFrame.groupby(level=0) support
PR #920 Add feather, JSON, HDF5 readers / writers from PyArrow / Pandas
PR #888 CSV Reader: Add prefix parameter for column names, used when parsing without a header
PR #913 Add DLPack support: convert between cuDF DataFrame and DLTensor
PR #939 Add ORC reader from PyArrow
PR #918 Add Series.groupby(level=0) support
PR #906 Add binary and comparison ops to DataFrame
PR #958 Support unary and binary ops on indexes
PR #964 Add rename method to DataFrame, Series, and Index
PR #985 Add Series.to_frame method
PR #985 Add drop= keyword to reset_index method
PR #994 Remove references to pygdf
PR #990 Add external series groupby support
PR #988 Add top-level merge function to cuDF
PR #992 Add comparison binaryops to DateTime columns
PR #996 Replace relative path imports with absolute paths in tests
PR #995 CSV Reader: Add index_col parameter to specify the column name or index to be used as row labels
PR #1004 Add from_gpu_matrix method to DataFrame
PR #997 Add property index setter
PR #1007 Replace relative path imports with absolute paths in cudf
PR #1013 select columns with df.columns
PR #1016 Rename Series.unique_count() to nunique() to match pandas API
PR #947 Prefixsum to handle nulls and float types
PR #1029 Remove rest of relative path imports
PR #1021 Add filtered selection with assignment for Dataframes
PR #872 Adding NVCategory support to cudf apis
PR #1052 Add left/right_index and left/right_on keywords to merge
PR #1091 Add indicator= and suffixes= keywords to merge
PR #1107 Add unsupported keywords to Series.fillna
PR #1032 Add string support to cuDF python
PR #1136 Removed gdf_concat
PR #1153 Added function for getting the padded allocation size for valid bitmask
PR #1148 Add cudf.sqrt for dataframes and Series
PR #1159 Add Python bindings for libcudf dlpack functions
PR #1155 Add array_ufunc for DataFrame and Series for sqrt
PR #1168 to_frame for series accepts a name argument

Improvements

PR #1218 Add dask-cudf page to API docs
PR #892 Add support for heterogeneous types in binary ops with JIT
PR #730 Improve performance of gdf_table constructor
PR #561 Add Doxygen style comments to Join CUDA functions
PR #813 unified libcudf API functions by replacing gpu_ with gdf_
PR #822 Add support for __cuda_array_interface__ for ingest
PR #756 Consolidate common helper functions from unordered map and multimap
PR #753 Improve performance of groupby sum and average, especially for cases with few groups.
PR #836 Add ingest support for arrow chunked arrays in Column, Series, DataFrame creation
PR #763 Format doxygen comments for csv_read_arg struct
PR #532 CSV Reader: Use type dispatcher instead of switch block
PR #694 Unit test utilities improvements
PR #878 Add better indexing to Groupby
PR #554 Add empty method and is_monotonic attribute to Index
PR #1040 Fixed up Doxygen comment tags
PR #909 CSV Reader: Avoid host->device->host copy for header row data
PR #916 Improved unit testing and error checking for gdf_column_concat
PR #941 Replace numpy call in Series.hash_encode with numba
PR #942 Added increment/decrement operators for wrapper types
PR #943 Updated count_nonzero_mask to return num_rows when the mask is null
PR #952 Added trait to map C++ type to gdf_dtype
PR #966 Updated RMM submodule.
PR #998 Add IO reader/writer modules to API docs, fix for missing cudf.Series docs
PR #1017 concatenate along columns for Series and DataFrames
PR #1002 Support indexing a dataframe with another boolean dataframe
PR #1018 Better concatenation for Series and Dataframes
PR #1036 Use Numpydoc style docstrings
PR #1047 Adding gdf_dtype_extra_info to gdf_column_view_augmented
PR #1054 Added default ctor to SerialTrieNode to overcome Thrust issue in CentOS7 + CUDA10
PR #1024 CSV Reader: Add support for hexadecimal integers in integral-type columns
PR #1033 Update fillna() to use libcudf function gdf_replace_nulls
PR #1066 Added inplace assignment for columns and select_dtypes for dataframes
PR #1026 CSV Reader: Change the meaning and type of the quoting parameter to match Pandas
PR #1100 Adds CUDF_EXPECTS error-checking macro
PR #1092 Fix select_dtype docstring
PR #1111 Added cudf::table
PR #1108 Sorting for datetime columns
PR #1120 Return a Series (not a Column) from Series.cat.set_categories()
PR #1128 CSV Reader: The last data row does not need to be line terminated
PR #1183 Bump Arrow version to 0.12.1
PR #1208 Default to CXX11_ABI=ON
PR #1252 Fix NVStrings dependencies for cuda 9.2 and 10.0

Bug Fixes

PR #821 Fix flake8 issues revealed by flake8 update
PR #808 Resolved renamed d_columns_valids variable name
PR #820 CSV Reader: fix the issue where reader adds additional rows when file uses \r\n as a line terminator
PR #780 CSV Reader: Fix scientific notation parsing and null values for empty quotes
PR #815 CSV Reader: Fix data parsing when tabs are present in the input CSV file
PR #850 Fix bug where left joins where the left df has 0 rows causes a crash
PR #861 Fix memory leak by preserving the boolean mask index
PR #875 Handle unnamed indexes in to/from arrow functions
PR #877 Fix ingest of 1 row arrow tables in from arrow function
PR #876 Added missing <type_traits> include
PR #889 Deleted test_rmm.py which has now moved to RMM repo
PR #866 Merge v0.5.1 numpy ABI hotfix into 0.6
PR #917 value_counts return int type on empty columns
PR #611 Renamed gdf_reduce_optimal_output_size() -> gdf_reduction_get_intermediate_output_size()
PR #923 fix index for negative slicing for cudf dataframe and series
PR #927 CSV Reader: Fix category GDF_CATEGORY hashes not being computed properly
PR #921 CSV Reader: Fix parsing errors with delim_whitespace, quotations in the header row, unnamed columns
PR #933 Fix handling objects of all nulls in series creation
PR #940 CSV Reader: Fix an issue where the last data row is missing when using byte_range
PR #945 CSV Reader: Fix incorrect datetime64 when milliseconds or space separator are used
PR #959 Groupby: Problem with column name lookup
PR #950 Converting dataframe/recarry with non-contiguous arrays
PR #963 CSV Reader: Fix another issue with missing data rows when using byte_range
PR #999 Fix 0 sized kernel launches and empty sort_index exception
PR #993 Fix dtype in selecting 0 rows from objects
PR #1009 Fix performance regression in to_pandas method on DataFrame
PR #1008 Remove custom dask communication approach
PR #1001 CSV Reader: Fix a memory access error when reading a large (>2GB) file with date columns
PR #1019 Binary Ops: Fix error when one input column has null mask but other doesn't
PR #1014 CSV Reader: Fix false positives in bool value detection
PR #1034 CSV Reader: Fix parsing floating point precision and leading zero exponents
PR #1044 CSV Reader: Fix a segfault when byte range aligns with a page
PR #1058 Added support for DataFrame.loc[scalar]
PR #1060 Fix column creation with all valid nan values
PR #1073 CSV Reader: Fix an issue where a column name includes the return character
PR #1090 Updating Doxygen Comments
PR #1080 Fix dtypes returned from loc / iloc because of lists
PR #1102 CSV Reader: Minor fixes and memory usage improvements
PR #1174: Fix release script typo
PR #1137 Add prebuild script for CI
PR #1118 Enhanced the DataFrame.from_records() feature
PR #1129 Fix join performance with index parameter from using numpy array
PR #1145 Issue with .agg call on multi-column dataframes
PR #908 Some testing code cleanup
PR #1167 Fix issue with null_count not being set after inplace fillna()
PR #1184 Fix iloc performance regression
PR #1185 Support left_on/right_on and also on=str in merge
PR #1200 Fix allocating bitmasks with numba instead of rmm in allocate_mask function
PR #1213 Fix bug with csv reader requesting subset of columns using wrong datatype
PR #1223 gpuCI: Fix label on rapidsai channel on gpu build scripts
PR #1242 Add explicit Thrust exec policy to fix NVCATEGORY_TEST segfault on some platforms
PR #1246 Fix categorical tests that failed due to bad implicit type conversion
PR #1255 Fix overwriting conda package main label uploads
PR #1259 Add dlpack includes to pip build

cuDF 0.5.1 (05 Feb 2019)

Bug Fixes

PR #842 Avoid using numpy via cimport to prevent ABI issues in Cython compilation

cuDF 0.5.0 (28 Jan 2019)

New Features

PR #722 Add bzip2 decompression support to read_csv()
PR #693 add ZLIB-based GZIP/ZIP support to read_csv_strings()
PR #411 added null support to gdf_order_by (new API) and cudf_table::sort
PR #525 Added GitHub Issue templates for bugs, documentation, new features, and questions
PR #501 CSV Reader: Add support for user-specified decimal point and thousands separator to read_csv_strings()
PR #455 CSV Reader: Add support for user-specified decimal point and thousands separator to read_csv()
PR #439 add DataFrame.drop method similar to pandas
PR #356 add DataFrame.transpose method and DataFrame.T property similar to pandas
PR #505 CSV Reader: Add support for user-specified boolean values
PR #350 Implemented Series replace function
PR #490 Added print_env.sh script to gather relevant environment details when reporting cuDF issues
PR #474 add ZLIB-based GZIP/ZIP support to read_csv()
PR #547 Added melt similar to pandas.melt()
PR #491 Add CI test script to check for updates to CHANGELOG.md in PRs
PR #550 Add CI test script to check for style issues in PRs
PR #558 Add CI scripts for cpu-based conda and gpu-based test builds
PR #524 Add Boolean Indexing
PR #564 Update python sort_values method to use updated libcudf gdf_order_by API
PR #509 CSV Reader: Input CSV file can now be passed in as a text or a binary buffer
PR #607 Add __iter__ and iteritems to DataFrame class
PR #643 added a new api gdf_replace_nulls that allows a user to replace nulls in a column

Improvements

PR #426 Removed sort-based groupby and refactored existing groupby APIs. Also improves C++/CUDA compile time.
PR #461 Add CUDF_HOME variable in README.md to replace relative pathing.
PR #472 RMM: Created centralized rmm::device_vector alias and rmm::exec_policy
PR #500 Improved the concurrent hash map class to support partitioned (multi-pass) hash table building.
PR #454 Improve CSV reader docs and examples
PR #465 Added templated C++ API for RMM to avoid explicit cast to void**
PR #513 .gitignore tweaks
PR #521 Add assert_eq function for testing
PR #502 Simplify Dockerfile for local dev, eliminate old conda/pip envs
PR #549 Adds -rdynamic compiler flag to nvcc for Debug builds
PR #472 RMM: Created centralized rmm::device_vector alias and rmm::exec_policy
PR #577 Added external C++ API for scatter/gather functions
PR #500 Improved the concurrent hash map class to support partitioned (multi-pass) hash table building
PR #583 Updated gdf_size_type to int
PR #500 Improved the concurrent hash map class to support partitioned (multi-pass) hash table building
PR #617 Added .dockerignore file. Prevents adding stale cmake cache files to the docker container
PR #658 Reduced JOIN_TEST time by isolating overflow test of hash table size computation
PR #664 Added Debuging instructions to README
PR #651 Remove noqa marks in __init__.py files
PR #671 CSV Reader: uncompressed buffer input can be parsed without explicitly specifying compression as None
PR #684 Make RMM a submodule
PR #718 Ensure sum, product, min, max methods pandas compatibility on empty datasets
PR #720 Refactored Index classes to make them more Pandas-like, added CategoricalIndex
PR #749 Improve to_arrow and from_arrow Pandas compatibility
PR #766 Remove TravisCI references, remove unused variables from CMake, fix ARROW_VERSION in Cmake
PR #773 Add build-args back to Dockerfile and handle dependencies based on environment yml file
PR #781 Move thirdparty submodules to root and symlink in /cpp
PR #843 Fix broken cudf/python API examples, add new methods to the API index

Bug Fixes

PR #569 CSV Reader: Fix days being off-by-one when parsing some dates
PR #531 CSV Reader: Fix incorrect parsing of quoted numbers
PR #465 Added templated C++ API for RMM to avoid explicit cast to void**
PR #473 Added missing include
PR #478 CSV Reader: Add api support for auto column detection, header, mangle_dupe_cols, usecols
PR #495 Updated README to correct where cffi pytest should be executed
PR #501 Fix the intermittent segfault caused by the thousands and compression parameters in the csv reader
PR #502 Simplify Dockerfile for local dev, eliminate old conda/pip envs
PR #512 fix bug for on parameter in DataFrame.merge to allow for None or single column name
PR #511 Updated python/cudf/bindings/join.pyx to fix cudf merge printing out dtypes
PR #513 .gitignore tweaks
PR #521 Add assert_eq function for testing
PR #537 Fix CMAKE_CUDA_STANDARD_REQURIED typo in CMakeLists.txt
PR #447 Fix silent failure in initializing DataFrame from generator
PR #545 Temporarily disable csv reader thousands test to prevent segfault (test re-enabled in PR #501)
PR #559 Fix Assertion error while using applymap to change the output dtype
PR #575 Update print_env.sh script to better handle missing commands
PR #612 Prevent an exception from occuring with true division on integer series.
PR #630 Fix deprecation warning for pd.core.common.is_categorical_dtype
PR #622 Fix Series.append() behaviour when appending values with different numeric dtype
PR #603 Fix error while creating an empty column using None.
PR #673 Fix array of strings not being caught in from_pandas
PR #644 Fix return type and column support of dataframe.quantile()
PR #634 Fix create DataFrame.from_pandas() with numeric column names
PR #654 Add resolution check for GDF_TIMESTAMP in Join
PR #648 Enforce one-to-one copy required when using numba>=0.42.0
PR #645 Fix cmake build type handling not setting debug options when CMAKE_BUILD_TYPE=="Debug"
PR #669 Fix GIL deadlock when launching multiple python threads that make Cython calls
PR #665 Reworked the hash map to add a way to report the destination partition for a key
PR #670 CMAKE: Fix env include path taking precedence over libcudf source headers
PR #674 Check for gdf supported column types
PR #677 Fix 'gdf_csv_test_Dates' gtest failure due to missing nrows parameter
PR #604 Fix the parsing errors while reading a csv file using sep instead of delimiter.
PR #686 Fix converting nulls to NaT values when converting Series to Pandas/Numpy
PR #689 CSV Reader: Fix behavior with skiprows+header to match pandas implementation
PR #691 Fixes Join on empty input DFs
PR #706 CSV Reader: Fix broken dtype inference when whitespace is in data
PR #717 CSV reader: fix behavior when parsing a csv file with no data rows
PR #724 CSV Reader: fix build issue due to parameter type mismatch in a std::max call
PR #734 Prevents reading undefined memory in gpu_expand_mask_bits numba kernel
PR #747 CSV Reader: fix an issue where CUDA allocations fail with some large input files
PR #750 Fix race condition for handling NVStrings in CMake
PR #719 Fix merge column ordering
PR #770 Fix issue where RMM submodule pointed to wrong branch and pin other to correct branches
PR #778 Fix hard coded ABI off setting
PR #784 Update RMM submodule commit-ish and pip paths
PR #794 Update rmm::exec_policy usage to fix segmentation faults when used as temprory allocator.
PR #800 Point git submodules to branches of forks instead of exact commits

cuDF 0.4.0 (05 Dec 2018)

New Features

PR #398 add pandas-compatible DataFrame.shape() and Series.shape()
PR #394 New documentation feature "10 Minutes to cuDF"
PR #361 CSV Reader: Add support for strings with delimiters

Improvements

PR #436 Improvements for type_dispatcher and wrapper structs
PR #429 Add CHANGELOG.md (this file)
PR #266 use faster CUDA-accelerated DataFrame column/Series concatenation.
PR #379 new C++ type_dispatcher reduces code complexity in supporting many data types.
PR #349 Improve performance for creating columns from memoryview objects
PR #445 Update reductions to use type_dispatcher. Adds integer types support to sum_of_squares.
PR #448 Improve installation instructions in README.md
PR #456 Change default CMake build to Release, and added option for disabling compilation of tests

Bug Fixes

PR #444 Fix csv_test CUDA too many resources requested fail.
PR #396 added missing output buffer in validity tests for groupbys.
PR #408 Dockerfile updates for source reorganization
PR #437 Add cffi to Dockerfile conda env, fixes "cannot import name 'librmm'"
PR #417 Fix map_test failure with CUDA 10
PR #414 Fix CMake installation include file paths
PR #418 Properly cast string dtypes to programmatic dtypes when instantiating columns
PR #427 Fix and tests for Concatenation illegal memory access with nulls

cuDF 0.3.0 (23 Nov 2018)

New Features

PR #336 CSV Reader string support

Improvements

PR #354 source code refactored for better organization. CMake build system overhaul. Beginning of transition to Cython bindings.
PR #290 Add support for typecasting to/from datetime dtype
PR #323 Add handling pyarrow boolean arrays in input/out, add tests
PR #325 GDF_VALIDITY_UNSUPPORTED now returned for algorithms that don't support non-empty valid bitmasks
PR #381 Faster InputTooLarge Join test completes in ms rather than minutes.
PR #373 .gitignore improvements
PR #367 Doc cleanup & examples for DataFrame methods
PR #333 Add Rapids Memory Manager documentation
PR #321 Rapids Memory Manager adds file/line location logging and convenience macros
PR #334 Implement DataFrame __copy__ and __deepcopy__
PR #271 Add NVTX ranges to pygdf
PR #311 Document system requirements for conda install

Bug Fixes

PR #337 Retain index on scale() function
PR #344 Fix test failure due to PyArrow 0.11 Boolean handling
PR #364 Remove noexcept from managed_allocator; CMakeLists fix for NVstrings
PR #357 Fix bug that made all series be considered booleans for indexing
PR #351 replace conda env configuration for developers
PRs #346 #360 Fix CSV reading of negative numbers
PR #342 Fix CMake to use conda-installed nvstrings
PR #341 Preserve categorical dtype after groupby aggregations
PR #315 ReadTheDocs build update to fix missing libcuda.so
PR #320 FIX out-of-bounds access error in reductions.cu
PR #319 Fix out-of-bounds memory access in libcudf count_valid_bits
PR #303 Fix printing empty dataframe

cuDF 0.2.0 and cuDF 0.1.0

These were initial releases of cuDF based on previously separate pyGDF and libGDF libraries.

Files

CHANGELOG.md

Latest commit

History

CHANGELOG.md

File metadata and controls

cuDF 0.9.0 (Date TBD)

New Features

Improvements

Bug Fixes

cuDF 0.8.0 (27 June 2019)

New Features

Improvements

Bug Fixes

cudf 0.7.2 (16 May 2019)

New Features

Bug Fixes

cudf 0.7.1 (11 May 2019)

New Features

Bug Fixes

cuDF 0.7.0 (10 May 2019)

New Features

Improvements

Bug Fixes

cuDF 0.6.1 (25 Mar 2019)

Bug Fixes

cuDF 0.6.0 (22 Mar 2019)

New Features

Improvements

Bug Fixes

cuDF 0.5.1 (05 Feb 2019)

Bug Fixes

cuDF 0.5.0 (28 Jan 2019)

New Features

Improvements

Bug Fixes

cuDF 0.4.0 (05 Dec 2018)

New Features

Improvements

Bug Fixes

cuDF 0.3.0 (23 Nov 2018)

New Features

Improvements

Bug Fixes

cuDF 0.2.0 and cuDF 0.1.0