We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
KFP workflows, Transforms/Other
The s3 creds are printed to the logs:
23:32:13 INFO - request to execute: python -m dpk_lang_id.ray.transform --data_max_files=-1 --data_num_samples=-1 --data_s3_config="{'input_folder': 'test/lang_id/input/', 'output_folder': 'test/lang_id/output/'}" --lang_id_content_column_name="text" --lang_id_model_kind="fasttext" --lang_id_model_url="facebook/fasttext-language-identification" --lang_id_output_lang_column_name="lang" --lang_id_output_score_column_name="score" --runtime_code_location="{'commit_hash': '12345', 'github': 'github', 'path': 'path'}" --runtime_job_id="c9dd2933-b05b-4b3d-81fe-cf9af770eb91" --runtime_num_workers="2" --runtime_pipeline_id="pipeline_id" --runtime_worker_options="{'num_cpus': 0.8}" --data_s3_cred="{'access_key': 'minio', 'secret_key': 'minio123', 'url': ' http://minio-service.kubeflow.svc.cluster.local:9000/ '}"
cd transforms/language/lang_id/ and run make workflow-test command
transforms/language/lang_id/
make workflow-test
No response
Ubuntu
Other, 3.11.x
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Search before asking
Component
KFP workflows, Transforms/Other
What happened + What you expected to happen
The s3 creds are printed to the logs:
Reproduction script
cd
transforms/language/lang_id/
and runmake workflow-test
commandAnything else
No response
OS
Ubuntu
Python
Other, 3.11.x
Are you willing to submit a PR?
The text was updated successfully, but these errors were encountered: