Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(cijenkinsio-agents-2): adding the new kubernetes cluster to infra.ci management #6020

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

smerle33
Copy link
Contributor

@smerle33 smerle33 commented Dec 16, 2024

as per jenkins-infra/helpdesk#4319 (comment)

starting adding the new EKS cluster to infra.ci kubernetes-management

kubeconfig added as secrets here https://github.com/jenkins-infra/charts-secrets/commit/a24b1ec79f738ab2b2d01b46ea3111feec1abcb0
and datadog api key here https://github.com/jenkins-infra/charts-secrets/commit/c7505e8517376fd712cea6673d06c0191e5d24a9

need #6021

⚠️ BEFORE merging this PR we need to create the datadog namespace
using :

kubectl config use-context arn:aws:eks:us-east-2:326712726440:cluster/cijenkinsio-agents-2
kubectl create ns datadog

@smerle33 smerle33 force-pushed the cijenkinsio-agents-2/add/kubmanagement branch from 94b3579 to 9a73c19 Compare December 16, 2024 13:53
Copy link
Contributor

@dduportal dduportal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A first set of quick review feedbacks

clusters/cijioagents2.yaml Outdated Show resolved Hide resolved
clusters/cijioagents2.yaml Outdated Show resolved Hide resolved
clusters/cijioagents2.yaml Outdated Show resolved Hide resolved
config/artifact-caching-proxy_aws.yaml Outdated Show resolved Hide resolved
Comment on lines 17 to 9
nodeSelector:
kubernetes.io/arch: arm64
jenkins: ci.jenkins.io
role: applications
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have node pools with these settings?

Comment on lines 55 to 47
# replicaCount: 2

# proxy:
# dnsResolver: "kube-dns.kube-system.svc.cluster.local 9.9.9.9"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why commenting out these (mandatory) elements?

aks:
enabled: true
datadog:
clusterName: 'cijioagents2'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
clusterName: 'cijioagents2'
clusterName: 'cijenkinsio-agents-2'

Ref. https://github.com/jenkins-infra/terraform-aws-sponsorship/blob/main/eks-cijenkinsio-agents-2.tf#L16

We use diminutives for helmfiles but we must keep full FQDNs

Comment on lines 6 to 10
env:
- name: DD_HOSTNAME
valueFrom:
fieldRef:
fieldPath: spec.nodeName
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it needed in the case of EKS? Or is it only AKS?

config/datadog_cijioagents2.yaml Outdated Show resolved Hide resolved
Comment on lines 23 to 49
nodeSelector:
kubernetes.io/arch: arm64
role: applications
tolerations:
- key: "ci.jenkins.io/applications"
operator: "Equal"
value: "true"
effect: "NoSchedule"
agents:
tolerations:
# These tolerations are needed to run the agents on the bom node pool
- key: "ci.jenkins.io/bom"
operator: "Equal"
value: "true"
effect: "NoSchedule"
- key: "ci.jenkins.io/applications"
operator: "Equal"
value: "true"
effect: "NoSchedule"
- key: "ci.jenkins.io/agents"
operator: "Equal"
value: "true"
effect: "NoSchedule"
- key: "CriticalAddonsOnly"
operator: "Equal"
value: "true"
effect: "NoSchedule"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have the aforementionned node pools/group/whatever?

@smerle33 smerle33 force-pushed the cijenkinsio-agents-2/add/kubmanagement branch from b5c59aa to eb38fb9 Compare December 17, 2024 15:08
@smerle33 smerle33 force-pushed the cijenkinsio-agents-2/add/kubmanagement branch from b4f7206 to d85f56c Compare December 17, 2024 16:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants