v0.2.3

What's Changed

• Fuzzy dedup by @Kibnelson in #699
• Doc Quality Transform: update readme and add sample notebook by @dtsuzuku-ibm in #790
• Fix for inability to read some parquet files (issue #816) by @daw3rd in #817
• Updated Resources webpage with latest talks and links by @agoyal26 in #846
• HAP transform: Update README.md and add sample notebook by @ian-cho in #821
• publish transforms==0.2.3.dev0 pre-release to pypi with dependency on toolkit==0.2.2 by @touma-I in #837
• Semantic profiler and report generation module integration by @pankajskku in #824
• Update doc for doc_id and ededup to follow template in issue #753 by @cmadam in #836
• Update README.md for check-marking the table with Python and Spark versions of fdedup by @shahrokhDaijavad in #855
• Added links to example notebooks - issue #848 fix by @cmadam in #861
• Hap score - Example Notebook by @AishaDarga in #840
• Simplified fix for issue 803 by @cmadam in #839
• Html rag 1 -- Crawl a website / process HTML / run RAG queries by @sujee in #838
• fix usage of pandas 2.1.x by @dolfim-ibm in #867
• Bug fix for Agda language in code profiler transform by @pankajskku in #865
• Release 0.2.3.dev1 per Constantin's request by @touma-I in #875
• Create pre-release wheels for code_profiler using transform 0.2.3.dev1 and toolkit 0.2.3.dev0 by @touma-I in #857
• Grant non-root users the necessary permissions to the ray directory by @revit13 in #881
• Start of a new release cycle with 1.0.0 by @matouma in #885

New Contributors

• @Kibnelson made their first contribution in #699
• @agoyal26 made their first contribution in #846
• @AishaDarga made their first contribution in #840

Full Changelog: v0.2.2...v0.2.3

v0.2.2

What's Changed

• Update all transforms to use single package library with [extra] by @touma-I in #735
• Fix metadata logging even when actors crash by @shivdeep-singh-ibm in #721
• fix multilock with default parameters by @dolfim-ibm in #757
• Update resources.md by @shahrokhDaijavad in #755
• allow the user to customize crawler settings by @hmtbr in #738
• updating RAG example to use IBM granite model by @sujee in #745
• fixed URLs and fixed ray download error by @sujee in #744
• Update pdf2parquet to Docling v2 by @dolfim-ibm in #756
• Fixing code sample-notebook by @santoshborse in #749
• Create new dev2 pre-releases for both tansforms and library with latest from docling 2.0 by @touma-I in #765
• small fixes by @roytman in #771
• Bump streamlit from 1.36.0 to 1.37.0 in /transforms/code/code_profiler/python by @dependabot in #766
• bump connector version by @hmtbr in #769
• Fix License select kfp by @revit13 in #781
• Modify superpipeline params type. by @revit13 in #773
• set kuberay apiserver version by @roytman in #713
• add new talks to resources.md by @dtsuzuku-ibm in #789
• Bump certifi from 2024.6.2 to 2024.7.4 in /transforms/code/code_profiler/python by @dependabot in #787
• Bump tornado from 6.4 to 6.4.1 in /transforms/code/code_profiler/python by @dependabot in #775
• Increase recursion limit and add error handling for deep recursion of… by @pankajskku in #747
• fix uint64 hash to pyarrow by @dolfim-ibm in #793
• use str as document_hash by @dolfim-ibm in #798
• update doc_chunk md results by @dolfim-ibm in #799
• Crawler transform by @touma-I in #797
• Update Kuberay api server version in requirements.env. by @revit13 in #808
• Fix set_s3_env_vars_to_component in kfp v2. by @revit13 in #806
• A few changes in the root README by @shahrokhDaijavad in #810
• Update README.md by @Padarn in #805
• Update README docs for language transforms by @dolfim-ibm in #800
• Html2Parquet Updated README and Added Sample Notebook by @sungeunan-ibm in #815
• Update web2parquet.ipynb by @shahrokhDaijavad in #823
• relax hap denpendencies on torch to overcome error on MacOS I7 with python 3.11 by @matouma in #830
• Pending version change/0.2.3 by @matouma in #832

New Contributors

• @dependabot made their first contribution in #766
• @Padarn made their first contribution in #805

Full Changelog: v0.2.2-connector...v0.2.2

Release 0.2.2 data-connector-lib to pypi

What's Changed

• Restructure the repository to distinguish/separate runtime libraries by @daw3rd in #140
• Move transform code into ray subdirectory - towards splitting transform runtimes. by @daw3rd in #143
• restore lost transforms/universal/noop/ray content by @daw3rd in #144
• New Readme file created for memory and endurance tests by @shahrokhDaijavad in #145
• LAB to Kit by @shahrokhDaijavad in #147
• Update ray/README.md by @eltociear in #148
• kfp multi jobs by @blublinsky in #142
• small fix in the init file by @blublinsky in #150
• rename make targets to be ray-specific by @daw3rd in #146
• Naming, docs and fix for recent binary file processing changes by @daw3rd in #153
• bug fixes by @blublinsky in #155
• Binary by @blublinsky in #141
• update kfp image version by @roytman in #159
• Update README.md for Broken links by @shahrokhDaijavad in #160
• adding multi_launcher tests by @blublinsky in #164
• Enable kfp in GH action for testing workflows by @revit13 in #149
• Fix paths in examples scripts. by @revit13 in #180
• Fail workflow if input size is empty. by @revit13 in #181
• library versions update by @blublinsky in #186
• Handle empty input parameter. by @Mohammad-nassar10 in #158
• Moving kfp workflows transform_workflows to transform directory. by @revit13 in #151
• update KFP docs by @roytman in #189
• Dev2 by @roytman in #191
• Modified ingress config (#130) by @D-Sai-Venkatesh in #156
• fixed flush in transform_file_processor.py by @blublinsky in #190
• added PLI related language extensions by @jitendrasinghibm in #177
• more fixes to the transform file processor by @blublinsky in #195
• Spark runtime by @cmadam in #183
• Fix white check marks in top readme. by @daw3rd in #199
• Minor fixes to kind/README.md. by @revit13 in #208
• Add utils functions to kfp support lib. by @Mohammad-nassar10 in #209
• Add Super pipeline for code transforms. by @revit13 in #172
• Tutorial README files fixes by @shahrokhDaijavad in #214
• Added copyright to the Spark files by @cmadam in #207
• Fix dependabot alert on tqdm in fdedup. by @daw3rd in #218
• Update filter_local.py by @shahrokhDaijavad in #217
• Split data-processing-lib/ray into python and ray. by @daw3rd in #213
• Enhanced the default 'make clean' rule to delete python leftovers and… by @daw3rd in #219
• small fixes by @roytman in #220
• Fixes after testing. by @revit13 in #223
• Change kfp_v1_workflow_support. by @revit13 in #227
• Split noop ray transform into ray and python runtimes. by @daw3rd in #221
• Fix tqdm security issue in ededup by @daw3rd in #224
• Tansform project conventions doc and makefile fix… by @daw3rd in #229
• Fixes after testing. by @revit13 in #232
• Runtime reorg by @daw3rd in #230
• Auto generate kfp pipelines. by @Mohammad-nassar10 in #193
• ingest to parquet rewrite by @blublinsky in #231
• KFPv2 support step 1 by @roytman in #226
• Rename of ingest_2_parquet file. by @daw3rd in #241
• Make all top level make targets pass w/o error by @daw3rd in #247
• Readme, pyproject metadata and makefile fixes in noop and filter. by @daw3rd in #240
• add retries counter to data processing by @blublinsky in #245
• Initial split of tokenization transform into ray and python by @daw3rd in #243
• add language identification transform module by @dtsuzuku-ibm in #256
• small changes to get ready for pdf by @blublinsky in #261
• Combine the common KFP support code in a shared library by @roytman in #253
• Fix tasks tags in kfp workflows. by @revit13 in #236
• Adjust ingest_2_parquet workflow. by @revit13 in #248
• Repo Root README and CONTRIBUTING clarifications by @shahrokhDaijavad in #264
• add build-language job to build-images workflow by @dtsuzuku-ibm in #268
• remove the artifactory settings by @roytman in #280
• update docs for KFPv2 by @roytman in #279
• Enhancing some README files by @shahrokhDaijavad in #278
• extended logging to print % and number processed files by @blublinsky in #272
• Updated transform readmes to reference correct runtime when describing cli params. by @daw3rd in #284
• Update advanced-transform-tutorial.md by @shahrokhDaijavad in #287
• add test-language job by @dtsuzuku-ibm in #286
• Change execution log file name. by @Mohammad-nassar10 in #251
• Update tests for KFP v2. by @revit13 in #255
• remove entire pipeline timeouts by @roytman in #270
• Randomly choose workflow to run in GH action. by @revit13 in #281
• Change the docker user as root by @takuyagt in #291
• Initial version of profiler by @blublinsky in #269
• Minimum explanation for VS Code by @shahrokhDaijavad in #290
• move logger to ensure Ray logging is correct by @blublinsky in #301
• Use dpk user for malware python image by @takuyagt in #304
• Move hack dirs to scripts dir by @revit13 in #295
• Fix issue #274 for venv corruption via make -n venv by @daw3rd in #302
• Installation of minio added to the transform README files by @shahrokhDaijavad in #303
• Minor fixes to profiler workflow by @revit13 in #308
• Ray version update by @blublinsky in #305
• update notebook by @shivdeep-singh-ibm in #310
• Split code quality, malware and proglang select transforms into python and ray. by @daw3rd in #288
• renaming of ingest_2_parquet by @blublinsky in #316
• move transform exceptions doc out of ray runtime to overview by @daw3rd in #319
• Inputcode2parquet rename by @daw3rd in #320
• fault tolerance by @blublinsky in #321
• Makefile rules updates by @revit13 in #323
• updated pyarrow version by @blublinsky in #325
• Fix make run-cli-sample for code2parquet by @daw3rd in #328
• Updated generate (simple pipeline) pipeline by @D-Sai-Venkatesh in #311
• Some new thoughts on cutting a release, especially scripts/release.sh by @daw3rd in #309
• Corrected Readme to update file path, added more detail signoff steps by @santoshborse in #330
• improve doc on transform design/expectations by @daw3rd in #331
• fix a typo by @roytman in #333
• Improvements to code2parquet transform by @daw3rd in https:...

v0.2.1

Key capabilities added in this release:

1. A number of new transforms
2. RAG notebook and other examples
3. Packaged transforms for pip install
4. Improved CI/CD

Details of What's Changed

• Restructure the repository to distinguish/separate runtime libraries by @daw3rd in #140
• Move transform code into ray subdirectory - towards splitting transform runtimes. by @daw3rd in #143
• restore lost transforms/universal/noop/ray content by @daw3rd in #144
• New Readme file created for memory and endurance tests by @shahrokhDaijavad in #145
• LAB to Kit by @shahrokhDaijavad in #147
• Update ray/README.md by @eltociear in #148
• kfp multi jobs by @blublinsky in #142
• small fix in the init file by @blublinsky in #150
• rename make targets to be ray-specific by @daw3rd in #146
• Naming, docs and fix for recent binary file processing changes by @daw3rd in #153
• bug fixes by @blublinsky in #155
• Binary by @blublinsky in #141
• update kfp image version by @roytman in #159
• Update README.md for Broken links by @shahrokhDaijavad in #160
• adding multi_launcher tests by @blublinsky in #164
• Enable kfp in GH action for testing workflows by @revit13 in #149
• Fix paths in examples scripts. by @revit13 in #180
• Fail workflow if input size is empty. by @revit13 in #181
• library versions update by @blublinsky in #186
• Handle empty input parameter. by @Mohammad-nassar10 in #158
• Moving kfp workflows transform_workflows to transform directory. by @revit13 in #151
• update KFP docs by @roytman in #189
• Dev2 by @roytman in #191
• Modified ingress config (#130) by @D-Sai-Venkatesh in #156
• fixed flush in transform_file_processor.py by @blublinsky in #190
• added PLI related language extensions by @jitendrasinghibm in #177
• more fixes to the transform file processor by @blublinsky in #195
• Spark runtime by @cmadam in #183
• Fix white check marks in top readme. by @daw3rd in #199
• Minor fixes to kind/README.md. by @revit13 in #208
• Add utils functions to kfp support lib. by @Mohammad-nassar10 in #209
• Add Super pipeline for code transforms. by @revit13 in #172
• Tutorial README files fixes by @shahrokhDaijavad in #214
• Added copyright to the Spark files by @cmadam in #207
• Fix dependabot alert on tqdm in fdedup. by @daw3rd in #218
• Update filter_local.py by @shahrokhDaijavad in #217
• Split data-processing-lib/ray into python and ray. by @daw3rd in #213
• Enhanced the default 'make clean' rule to delete python leftovers and… by @daw3rd in #219
• small fixes by @roytman in #220
• Fixes after testing. by @revit13 in #223
• Change kfp_v1_workflow_support. by @revit13 in #227
• Split noop ray transform into ray and python runtimes. by @daw3rd in #221
• Fix tqdm security issue in ededup by @daw3rd in #224
• Tansform project conventions doc and makefile fix… by @daw3rd in #229
• Fixes after testing. by @revit13 in #232
• Runtime reorg by @daw3rd in #230
• Auto generate kfp pipelines. by @Mohammad-nassar10 in #193
• ingest to parquet rewrite by @blublinsky in #231
• KFPv2 support step 1 by @roytman in #226
• Rename of ingest_2_parquet file. by @daw3rd in #241
• Make all top level make targets pass w/o error by @daw3rd in #247
• Readme, pyproject metadata and makefile fixes in noop and filter. by @daw3rd in #240
• add retries counter to data processing by @blublinsky in #245
• Initial split of tokenization transform into ray and python by @daw3rd in #243
• add language identification transform module by @dtsuzuku-ibm in #256
• small changes to get ready for pdf by @blublinsky in #261
• Combine the common KFP support code in a shared library by @roytman in #253
• Fix tasks tags in kfp workflows. by @revit13 in #236
• Adjust ingest_2_parquet workflow. by @revit13 in #248
• Repo Root README and CONTRIBUTING clarifications by @shahrokhDaijavad in #264
• add build-language job to build-images workflow by @dtsuzuku-ibm in #268
• remove the artifactory settings by @roytman in #280
• update docs for KFPv2 by @roytman in #279
• Enhancing some README files by @shahrokhDaijavad in #278
• extended logging to print % and number processed files by @blublinsky in #272
• Updated transform readmes to reference correct runtime when describing cli params. by @daw3rd in #284
• Update advanced-transform-tutorial.md by @shahrokhDaijavad in #287
• add test-language job by @dtsuzuku-ibm in #286
• Change execution log file name. by @Mohammad-nassar10 in #251
• Update tests for KFP v2. by @revit13 in #255
• remove entire pipeline timeouts by @roytman in #270
• Randomly choose workflow to run in GH action. by @revit13 in #281
• Change the docker user as root by @takuyagt in #291
• Initial version of profiler by @blublinsky in #269
• Minimum explanation for VS Code by @shahrokhDaijavad in #290
• move logger to ensure Ray logging is correct by @blublinsky in #301
• Use dpk user for malware python image by @takuyagt in #304
• Move hack dirs to scripts dir by @revit13 in #295
• Fix issue #274 for venv corruption via make -n venv by @daw3rd in #302
• Installation of minio added to the transform README files by @shahrokhDaijavad in #303
• Minor fixes to profiler workflow by @revit13 in #308
• Ray version update by @blublinsky in #305
• update notebook by @shivdeep-singh-ibm in #310
• Split code quality, malware and proglang select transforms into python and ray. by @daw3rd in #288
• renaming of ingest_2_parquet by @blublinsky in #316
• move transform exceptions doc out of ray runtime to overview by @daw3rd in #319
• Inputcode2parquet rename by @daw3rd in #320
• fault tolerance by @blublinsky in #321
• Makefile rules updates by @revit13 in #323
• updated pyarrow version by @blublinsky in #325
• Fix make run-cli-sample for code2parquet by @daw3rd in #328
• Updated generate (simple pipeline) pipeline by @D-Sai-Venkatesh in #311
• Some new thoughts on cutting a release, especially scripts/release.sh by @daw3rd in #309
• Corrected Readme to update file path, added more detail signoff steps by @santoshborse in #330
• improve doc on transform design/expectations by @daw3rd in...

v0.2.0

What's Changed

• Restructure the repository to distinguish/separate runtime libraries by @daw3rd in #140
• Move transform code into ray subdirectory - towards splitting transform runtimes. by @daw3rd in #143
• restore lost transforms/universal/noop/ray content by @daw3rd in #144
• New Readme file created for memory and endurance tests by @shahrokhDaijavad in #145
• LAB to Kit by @shahrokhDaijavad in #147
• Update ray/README.md by @eltociear in #148
• kfp multi jobs by @blublinsky in #142
• small fix in the init file by @blublinsky in #150
• rename make targets to be ray-specific by @daw3rd in #146
• Naming, docs and fix for recent binary file processing changes by @daw3rd in #153
• bug fixes by @blublinsky in #155
• Binary by @blublinsky in #141
• update kfp image version by @roytman in #159
• Update README.md for Broken links by @shahrokhDaijavad in #160
• adding multi_launcher tests by @blublinsky in #164
• Enable kfp in GH action for testing workflows by @revit13 in #149
• Fix paths in examples scripts. by @revit13 in #180
• Fail workflow if input size is empty. by @revit13 in #181
• library versions update by @blublinsky in #186
• Handle empty input parameter. by @Mohammad-nassar10 in #158
• Moving kfp workflows transform_workflows to transform directory. by @revit13 in #151
• update KFP docs by @roytman in #189
• Dev2 by @roytman in #191
• Modified ingress config (#130) by @D-Sai-Venkatesh in #156
• fixed flush in transform_file_processor.py by @blublinsky in #190
• added PLI related language extensions by @jitendrasinghibm in #177
• more fixes to the transform file processor by @blublinsky in #195
• Spark runtime by @cmadam in #183
• Fix white check marks in top readme. by @daw3rd in #199
• Minor fixes to kind/README.md. by @revit13 in #208
• Add utils functions to kfp support lib. by @Mohammad-nassar10 in #209
• Add Super pipeline for code transforms. by @revit13 in #172
• Tutorial README files fixes by @shahrokhDaijavad in #214
• Added copyright to the Spark files by @cmadam in #207
• Fix dependabot alert on tqdm in fdedup. by @daw3rd in #218
• Update filter_local.py by @shahrokhDaijavad in #217
• Split data-processing-lib/ray into python and ray. by @daw3rd in #213
• Enhanced the default 'make clean' rule to delete python leftovers and… by @daw3rd in #219
• small fixes by @roytman in #220
• Fixes after testing. by @revit13 in #223
• Change kfp_v1_workflow_support. by @revit13 in #227
• Split noop ray transform into ray and python runtimes. by @daw3rd in #221
• Fix tqdm security issue in ededup by @daw3rd in #224
• Tansform project conventions doc and makefile fix… by @daw3rd in #229
• Fixes after testing. by @revit13 in #232
• Runtime reorg by @daw3rd in #230
• Auto generate kfp pipelines. by @Mohammad-nassar10 in #193
• ingest to parquet rewrite by @blublinsky in #231
• KFPv2 support step 1 by @roytman in #226
• Rename of ingest_2_parquet file. by @daw3rd in #241
• Make all top level make targets pass w/o error by @daw3rd in #247
• Readme, pyproject metadata and makefile fixes in noop and filter. by @daw3rd in #240
• add retries counter to data processing by @blublinsky in #245
• Initial split of tokenization transform into ray and python by @daw3rd in #243
• add language identification transform module by @dtsuzuku-ibm in #256
• small changes to get ready for pdf by @blublinsky in #261
• Combine the common KFP support code in a shared library by @roytman in #253
• Fix tasks tags in kfp workflows. by @revit13 in #236
• Adjust ingest_2_parquet workflow. by @revit13 in #248
• Repo Root README and CONTRIBUTING clarifications by @shahrokhDaijavad in #264
• add build-language job to build-images workflow by @dtsuzuku-ibm in #268
• remove the artifactory settings by @roytman in #280
• update docs for KFPv2 by @roytman in #279
• Enhancing some README files by @shahrokhDaijavad in #278
• extended logging to print % and number processed files by @blublinsky in #272
• Updated transform readmes to reference correct runtime when describing cli params. by @daw3rd in #284
• Update advanced-transform-tutorial.md by @shahrokhDaijavad in #287
• add test-language job by @dtsuzuku-ibm in #286
• Change execution log file name. by @Mohammad-nassar10 in #251
• Update tests for KFP v2. by @revit13 in #255
• remove entire pipeline timeouts by @roytman in #270
• Randomly choose workflow to run in GH action. by @revit13 in #281
• Change the docker user as root by @takuyagt in #291
• Initial version of profiler by @blublinsky in #269
• Minimum explanation for VS Code by @shahrokhDaijavad in #290
• move logger to ensure Ray logging is correct by @blublinsky in #301
• Use dpk user for malware python image by @takuyagt in #304
• Move hack dirs to scripts dir by @revit13 in #295
• Fix issue #274 for venv corruption via make -n venv by @daw3rd in #302
• Installation of minio added to the transform README files by @shahrokhDaijavad in #303
• Minor fixes to profiler workflow by @revit13 in #308
• Ray version update by @blublinsky in #305
• update notebook by @shivdeep-singh-ibm in #310
• Split code quality, malware and proglang select transforms into python and ray. by @daw3rd in #288
• renaming of ingest_2_parquet by @blublinsky in #316
• move transform exceptions doc out of ray runtime to overview by @daw3rd in #319
• Inputcode2parquet rename by @daw3rd in #320
• fault tolerance by @blublinsky in #321
• Makefile rules updates by @revit13 in #323
• updated pyarrow version by @blublinsky in #325
• Fix make run-cli-sample for code2parquet by @daw3rd in #328
• Updated generate (simple pipeline) pipeline by @D-Sai-Venkatesh in #311
• Some new thoughts on cutting a release, especially scripts/release.sh by @daw3rd in #309
• Corrected Readme to update file path, added more detail signoff steps by @santoshborse in #330
• improve doc on transform design/expectations by @daw3rd in #331
• fix a typo by @roytman in #333
• Improvements to code2parquet transform by @daw3rd in https:...

Version 0.1.0 of data-prep-kit

What's Changed

• pure-python implementation by @blublinsky in #55
• add mkdocs hook to update relative links by @shivdeep-singh-ibm in #87
• Add super pipeline sample by @revit13 in #68
• Fix malware and code_quality workflows. by @revit13 in #92
• Change name to data prep kit by @daw3rd in #91
• Misc. typos and suggested edits. by @deanwampler in #97
• Fix python definition by @roytman in #102
• Core library refactorings and transform adjustments by @daw3rd in #100
• moved binary/arrow conversion to the utils for better reuse by @blublinsky in #104
• Add RayTransformConfiguration to a capture runtime_class by @daw3rd in #105
• rename launch package to runtime by @daw3rd in #106
• Add instructions to deploy and execute the project on a real Kubernet… by @blublinsky in #103
• Fix kfp_ray_components publish. by @revit13 in #99
• run pre-commit on all files to pass by @daw3rd in #108
• Update docs for refactoring by @daw3rd in #110
• top readme, mac readme and transform readme launcher options by @daw3rd in #111
• installation scripts and instructions for a real K8s installation by @roytman in #116
• update RHEL requirements by @roytman in #118
• Updated code quality readmes and docs by @Param-S in #121
• add new lines in markdown documents before lists/bullets by @shivdeep-singh-ibm in #119
• Documentation Changes to Demo notebook from Rebased notebook branch by @Bytes-Explorer in #89
• Doc fixes by @deanwampler in #109
• Add clarity to the Readme file for running on Apple silicon Macs by @shahrokhDaijavad in #122
• Fixing a couple of Readme files by @shahrokhDaijavad in #124
• Update README.md by @Bytes-Explorer in #125
• update notebook with new api by @shivdeep-singh-ibm in #126
• removed unnecessary classes by @blublinsky in #112
• Add helper-functions.sh file to kind/hack folder. by @revit13 in #117
• Add missing functions to data_prep_toolkit_kfp lib by @revit13 in #113
• transform multi_launcher by @blublinsky in #131
• Library refactoring/renaming for clarity by @daw3rd in #132
• ingest2parquet updates by @sapthasurendran in #74
• fix make help target on gnu awk by @daw3rd in #135
• Update README.md for Ingest2parquet tool by @shahrokhDaijavad in #133
• small fix by @roytman in #136
• adding additional KubeRay support by @blublinsky in #120
• Build kfp component image using libs from sources. by @revit13 in #137
• updated PyPi versions by @blublinsky in #138

New Contributors

• @deanwampler made their first contribution in #97

Full Changelog: v0.1.6-dpl...v0.1.0-dpk

v0.1.6-dpl

What's Changed

• Various fixes to readmes and other mds. by @daw3rd in #2
• readme and makefile fixes by @blublinsky in #3
• Update the kfp part in the README file by @roytman in #4
• Upgrade secrets file by @daw3rd in #5
• adding minio info to readme by @blublinsky in #8
• Secrets baseline again by @daw3rd in #6
• Remove super pipeline references by @roytman in #11
• add ci workflows for github actions by @shivdeep-singh-ibm in #14
• Multiple doc fixes by @daw3rd in #10
• Ingest2parquet fixes by @sapthasurendran in #13
• enable mkdocs based documentation by @shivdeep-singh-ibm in #15
• data factory fixes by @blublinsky in #9
• fix docs by @shivdeep-singh-ibm in #18
• update mkdocs to include kfp tutorial by @shivdeep-singh-ibm in #17
• Updated code quality test data to include relevant columns by @Param-S in #19
• put readme cross-reference by @blublinsky in #21
• Enable doc id test in ci by @shivdeep-singh-ibm in #20
• Remove references to missing transformers by @ykoyfman in #26
• update gh-action workflows by @shivdeep-singh-ibm in #22
• Added references for Code Quality and fixed a typo by @shahrokhDaijavad in #24
• boto version update by @blublinsky in #16
• Updated license header for code_quality filter by @Param-S in #30
• add maintainer by @roytman in #29
• Sample script for code quality local by @Param-S in #37
• fix mkdocs documentation links by @shivdeep-singh-ibm in #36
• updated docs to correspond to the code by @blublinsky in #31
• fix link to overview.md in top readme by @daw3rd in #41
• Make run samples by @daw3rd in #12
• remove GUF porting references by @daw3rd in #48
• readme changes for recent makefile sample runs by @daw3rd in #45
• Readme updates nirmit by @nirmdesai in #44
• Minor grammatical changes to the root README.md by @shahrokhDaijavad in #51
• update tokenization readme to add recommended memory for demo running by @dangxuanhong in #49
• remove unused parameters by @roytman in #50
• Update issue templates by @daw3rd in #42
• enable emojis for mkdocs by @shivdeep-singh-ibm in #54
• Add feature request template and clean up pull request template by @daw3rd in #56
• Update README.md for a broken link in GitHub Pages by @shahrokhDaijavad in #57
• fix minio loading bug on input/ path by @daw3rd in #58
• fix s3 sample data input path (again) by @daw3rd in #59
• Update transformer version to address issue dependabot/1 by @dangxuanhong in #64
• fix template's Python and OS options by @roytman in #69
• more descriptive text in bug template by @daw3rd in #70
• Removing issues and PR counters till we figure a better solution for it by @Bytes-Explorer in #28
• Automate workflow testing. by @revit13 in #38
• add EXTRA_INDEX_URL support to makefiles and fix issue with DOCKER_IM… by @daw3rd in #53
• Preventing nginx controller errors by @roytman in #81
• fixed local files checkpointing by @blublinsky in #83
• Data sets arg format and testing for DataAccessFactory local by @daw3rd in #75
• Add mc installation instructions by @roytman in #82
• Updated Makefile comment and make minio-start target extendible. by @daw3rd in #61
• Update README.md in the transforms directory by @shahrokhDaijavad in #88
• Dpl 0.1.6 version by @daw3rd in #90

New Contributors

• @daw3rd made their first contribution in #2
• @blublinsky made their first contribution in #3
• @roytman made their first contribution in #4
• @shivdeep-singh-ibm made their first contribution in #14
• @sapthasurendran made their first contribution in #13
• @Param-S made their first contribution in #19
• @ykoyfman made their first contribution in #26
• @shahrokhDaijavad made their first contribution in #24
• @nirmdesai made their first contribution in #44
• @dangxuanhong made their first contribution in #49
• @Bytes-Explorer made their first contribution in #28
• @revit13 made their first contribution in #38

Full Changelog: https://github.com/IBM/data-prep-lab/commits/v0.1.6-dpl