Examples Control Service

Examples of use cases solved with Versatile Data Kit Control Service:

Deployment examples

• Scheduling a Data Job for automatic execution
• Deploying using different python versions

Orchestration examples

• Using DAGs to orchestrate Data Jobs
• Using DAGs to orchestrate Data Jobs with arguments
• Workflow of Data Jobs using Airflow

Job Operations

• Installation and Getting Started with Operations UI
• VDK Operations User Interface Walkthrough
• Using Data Job Properties vs Secrets

Scenarios

• Ingest, process, and publish using VDK & Streamlit Vincent Van Gogh's paintings
• Ingest, process, and publish using VDK & Streamlit American states life expectancy
• Ingest, process, and publish using VDK & Streamlit analysis of relationship between Natural Gas prices and the temperature

Jupyter tutorials

• Create a Data Job through the Jupyter UI
• Develop a Data Job through the Jupyter UI
• Deploy Data Job through the Jupyter UI
• Convert Data Job to Jupyter Notebook

Infrastructure operators

• Install VDK Control Service with custom SDK
• Data anonymization ingestion plugin
• Supported Python Versions - Control Service Setup
• Configuring Hashicorp Vault Instance for storing Secrets

The source code for the examples can be found in git at https://github.com/vmware/versatile-data-kit/tree/main/examples

➡️ Next Section Control Service: Python Dependencies