Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multi tier nodes with different PVC sizes (#106) #152

Merged
merged 1 commit into from
Apr 9, 2024

Conversation

FarhadF
Copy link
Contributor

@FarhadF FarhadF commented Apr 4, 2024

Fixes #106 .

Description

Multi tier historicals:

  • Cold
  • Hot
    as shown in the screenshot below can have different storage sizes for the PVC.
    image

This PR has:

  • been tested on a real K8S cluster to ensure creation of a brand new Druid cluster works.
  • been tested for backward compatibility on a real K*S cluster by applying the changes introduced here on an existing Druid cluster. If there are any backward incompatible changes then they have been noted in the PR description.
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added documentation for new or modified features or behaviors.

@AdheipSingh
Copy link
Contributor

LGTM. I haven't tested it.
@itamar-marom @cyril-corbon will wait for your reviews too.

@itamar-marom
Copy link
Collaborator

LGTM

@AdheipSingh AdheipSingh merged commit 7f60698 into datainfrahq:master Apr 9, 2024
1 check passed
TessaIO pushed a commit to TessaIO/druid-operator that referenced this pull request Jul 24, 2024
AdheipSingh added a commit that referenced this pull request Jul 28, 2024
* Ingestion Controller (#53)

* ingestion spec acc to v3

* task creation

* supprt native batch

* fix router url

* revert license change

* revert go mod change

* fix main

* fix: made some changes as per review comments

* fix: removed unused package from ingestion reconciler

* rebase 1

* add example

* add review

* update dockerfile

---------

Co-authored-by: avtarOPS <[email protected]>

* Update Docs and Tutorials (#138)

* docs and tutorials

* Refactor/ordering (#123)

* (ordering): refactor code

* (ordering): refactor code

* (ordering): testing

* chore(branch): rebase branch with master

* fix(tests): validate nodes order by regex

* Bump controller-tools version (#140)

* Utilize the DruidIngestion controller in e2e tests (#146)

* adds needed volumes to eks deployment spec and improves getting started documentation by noting minio dependency (#149)

* Add support for annotations on Deployment/StatefulSet resources in DruidNodeSpec (#145)

* Add support for annotations on Deployment/StatefulSet resources

* Support setting ReplicationControllerAnnotations at the cluster-level

* rename replicationControllerAnnotations to workloadAnnotations

* suggestions from code review

* Add support for multi tier nodes with different PVC sizes (#106) (#152)

Co-authored-by: Farhad Farahi <[email protected]>

* fix: put Druid crds in the appropriate folder specified by Helm (#162)

Signed-off-by: ahmed.g <[email protected]>
Signed-off-by: TessaIO <[email protected]>

* Adds service account name to each druid node optionally (#164)

* Adds service account to each druid node optionally

* Use controller-gen v0.11.2

---------

Signed-off-by: ahmed.g <[email protected]>
Signed-off-by: TessaIO <[email protected]>
Co-authored-by: AdheipSingh <[email protected]>
Co-authored-by: avtarOPS <[email protected]>
Co-authored-by: Itamar Marom <[email protected]>
Co-authored-by: Jesper Larsson <[email protected]>
Co-authored-by: Sam Wheating <[email protected]>
Co-authored-by: Evan Jones <[email protected]>
Co-authored-by: Farhad Farahi <[email protected]>
Co-authored-by: Farhad Farahi <[email protected]>
Co-authored-by: Sadananda Aithal <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Scale PVC for multi-tier component is broken
3 participants