This repository contains the source code for all Elastic connectors, developed by the Search team at Elastic. Use connectors to sync data from popular data sources to Elasticsearch.
These connectors are available as:
- Connector clients to be self-managed on your own infrastructure
- Native connectors using our fully managed service on Elastic Cloud
ℹ️ For an overview of the steps involved in deploying connector clients refer to Connector clients. You can get started quickly with Docker, using these instructions. We also have an end-to-end tutorial using the PostgreSQL connector client.
The main documentation for using connectors lives in the Search solution's docs. Here are the main pages:
You'll also find the individual references for each connector there. For everything to do with developing connectors, you'll find that here in this repo.
In addition to the source code for individual connectors, this repo also contains the connector service code, which is used for tasks like running connectors, and managing scheduling, syncs, and cleanup. This is shared code that is not used by individual connectors, but helps to coordinate and run a deployed instance/process.
This repo is also the home of the Elastic Python connector framework. This framework enables developers to build Elastic-supported connector clients. The framework implements common functionalities out of the box, so developers can focus on the logic specific to integrating their chosen data source.
The framework ensures compatibility, makes it easier for our team to review PRs, and help out in the development process. When you build using our framework, we provide a pathway for the connector to be officially supported by Elastic.
The framework serves two distinct, but related use cases:
- Customizing an existing Elastic connector client
- Building a new connector client