Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes

There are three major components to know in Airbyte:

The connector catalog

• 350+ pre-built connectors: Airbyte’s connector catalog comes “out-of-the-box” with over 350 pre-built connectors. These connectors can be used to start replicating data from a source to a destination in just a few minutes.
• No-Code Connector Builder: You can easily extend Airbyte’s functionality to support your custom use cases through tools like the No-Code Connector Builder.
• The platform: Airbyte’s platform provides all the horizontal services required to configure and scale data movement operations, available as cloud-managed or self-managed.
• The user interface: Airbyte features a UI, PyAirbyte (Python library), API, and Terraform Provider to integrate with your preferred tooling and approach to infrastructure management. Airbyte is suitable for a wide range of data integration use cases, including AI data infrastructure and EL(T) workloads. Airbyte is also embeddable within your own application or platform to power your product.

Products:

• Airbyte Cloud - A hosted service that allows you to focus on moving data while we take care of managing the infrastructure
• Airbyte Enterprise - Run Airbyte in your own infrastructure with added security and team features.
• Airbyte Open-Source - Deploy on your own infrastructure and start moving data

Main Repositories:

• Airbyte - all Airbyte connectors (Python and Java), Airbyte CDK and Airbyte CI tools.
• abctl - CI tool to deploy Airbyte anywhere anytime.
• Airbyte Platform - the core platform and Helm Charts.
• Airbyte Protocol - describes a series of standard components and all the interactions between them in order to declare an ELT pipeline.

Extensions:

• Terraform - declaratively version Airbyte Connectors as code.
• Helm Charts - run Airbyte at scale on Kubernetes.
• pyAirbyte - use Airbyte connectors directly in Python without the Airbyte Platform.
• Airbyte API Python SDK - control the Airbyte Platform using Python.
• Airbyte API Java SDK - control the Airbyte Platform using Java.