0.17.0-rc1

Changelog for ShortLink Project

Main

• docker: new type - registry 62f8b853f9
  • Added support for Docker registry type.
• archi: update 931f8a34c6
  • Updated architecture diagrams and documentation.
• gitlab: move to .gitlab/ci folder 15562a3828
  • Restructured GitLab CI configurations into a dedicated folder.
• metadata: init grafana dashboard 3def4e73dd
  • Initialized Grafana dashboards for metadata services.
• proxy: use standard name for argocd - shortlink-link-proxy 9c1470d02a
  • Standardized naming conventions for Argocd proxies.
• argocd: enable scylla cff9f9ed0c
  • Enabled ScyllaDB in Argocd configuration.
• temporal: move to shop boundary b4a01bd47e
  • Moved Temporal service within the shop boundary context.

DevOps

Observability

• shop: init UI e2ff99dbae
  • Launched the initial user interface for the shop service.
• docs: add Accounting Boundary 77692bfe04
  • Added documentation for the Accounting Boundary.
• docs: simplify docs eb42686f30
  • Streamlined and simplified existing documentation.
• docs: new adr 'Background Job Processing' f1d9169128
  • Introduced a new Architecture Decision Record (ADR) for background job processing.
• grafana-operator: add to draft f1b35de271
  • Added Grafana operator configuration to draft stage.
• grafana-operator: try use f2a849159e
  • Experimental use of Grafana operator.
• grafana: 11.0.0 d18ef7fec7
  • Upgraded Grafana to version 11.0.0.
• grafana-loki: enable limits_config.volume_enabled 196373e09f
  • Enabled volume limits configuration in Grafana Loki.
• grafana-agent: deprecated & drop 4d7ae3a793
  • Deprecated and removed Grafana agent.

CI/CD

• gitlab: add DAST 5a96e29901
  • Added Dynamic Application Security Testing (DAST) to CI pipeline.
• gitlab: build image with lazy pulling stargz/eStargz base images 5448d8aeed
  • Improved Docker image building with lazy pulling stargz/eStargz base images.
• gitlab-ci: use buildx 2d3fbce7b8
  • Integrated Docker buildx for multi-platform builds.
• gitlab: disable cache for UI 89bfc11a0e
  • Disabled cache for UI builds to resolve issues.
• gitlab: debug problem with ENV 3d899c1a37
  • Debugged and fixed environment variable issues in CI pipeline.

Infrastructure

• argocd: enable dex ac2e50d4d0
  • Enabled Dex for authentication in Argocd.
• argocd: disable temporal cae5d11b24
  • Temporarily disabled Temporal integration in Argocd.
• argocd: add temporal 3cd86a28e8
  • Re-added Temporal service configuration to Argocd.
• argocd: add grafana-alloy 4d6bbe2503
  • Added Grafana Alloy integration to Argocd.
• argocd: rename auth -> kratos 7808225a3c
  • Renamed authentication service from Auth to Kratos in Argocd.

Backend

• link: recovery e2e tests for CRUD 3af1744083
  • Recovered end-to-end tests for CRUD operations in link service.
• billing: use decimal 527e479114
  • Updated billing calculations to use decimal data type.
• openlemetry: init bridge for logger bda42f5d18
  • Initialized OpenTelemetry bridge for enhanced logging.
• raft: step by step 3ef59d41e5
  • Implemented step-by-step RAFT consensus algorithm.
• raft: add rpc a3a2a3077e
  • Added RPC communication for RAFT protocol.
• billing: add test for account use case 64e655bf40
  • Added tests for billing account use cases to improve coverage.

UI

• ui-next: use new Sidebar component b811d0b433
  • Integrated new Sidebar component into UI-next.
• ui-kit: add Sidebar 722f345c51
  • Added Sidebar component to the UI kit library.
• storybook: set version 8.0.0-beta.4 7284d60278
  • Upgraded Storybook to version 8.0.0-beta.4 for better testing.
• ui: use tailwindcss v4 8f781984f7
  • Updated the UI to use TailwindCSS version 4 for styling.
• ui: migration to new version deps 0ea80b44c9
  • Migrated UI dependencies to the latest versions.

Security

• security: disable falco, kubescape, kyverno 09524f6873
  • Disabled Falco, Kubescape, and Kyverno security tools.
• kyverno: disabled f5c77b8bd8
  • Disabled Kyverno policies due to conflicts.
• kyverno: add policy enforce-service-type-clusterip 32677b58ab
  • Added new policy in Kyverno to enforce ClusterIP service type.

Documentation

• docs: add icons 7948f95103
  • Added icons to enhance documentation visuals.
• docs: add logo 5e3a55a649
  • Added logo to the project's documentation.
• docs: update readme for platform boundary 3f7bb5c63d
  • Updated README to reflect changes in platform boundary.
• docs: add info about license to readme 80c2ab6c25
  • Added detailed license information to the README.
• docs: add ubiquitous language 58f697e594
  • Added a section on ubiquitous language to the documentation.

Miscellaneous

• protoc-gen-rich-model: publish to buf 47e23a1620
  • Published protoc-gen-rich-model to Buf repository.
• protoc-gen-go-orm: update docs 9c384b7bd2
  • Updated documentation for protoc-gen-go-orm.
• protoc-gen-rich-model: work version 9349202fc8
  • Released working version of protoc-gen-rich-model plugin.
• protoc: add plugin protoc-gen-rich-model 5db65b3f1c
  • Added protoc-gen-rich-model plugin for enhanced model generation.
• k8s: min support version 1.29 53b14c3d91
  • Updated minimum Kubernetes support version to 1.29.
• open-feature-operator: enable 46d41b996d
  • Enabled open-feature-operator for feature flag management.

New Year 🥳 2024

Main

• Migration K8S to Talos and Cilium.
• Split services by boundary context
• Integration with SpiceDB (permission service)

Docs

• ADR
  • adr: update adr "20. Research summary of PostgreSQL Operators"
  • adr: new 26. Pattern: database per service
  • adr: Transition to Cloudflare Apps
  • merch: add ADR's - init, use dapr
  • ADR-0014: add article about RED method
  • ADR: 27 Local Kubernetes Development Tools
  • docs: add separate ADR for ops
  • docs: add ADR - Cache System
• GitHub
  • github: improve template for PR

DevOps

• GitLab
  • gitlab: setting eslint
  • flutter: upgrade docker image for gitlab CI
  • gitlab: add metrics-server
  • gitlab: improve helm deploy's job
• GitHub
  • github: fix renovate
• ArgoCD
  • argocd: set resources limit
  • argocd: add postgres-operator
  • argocd: add grafana-oncall
  • argocd-shortlink: init kargo
  • argocd: add kubeshark
  • argocd: add signadot
  • argocd: move don't used application to draft
• Observability
  • postgres-operator: add grafana dashboard
  • postgres-operator: enable exporter metrics
  • postgres-operator: add podmonitor
  • postgres-operator: add grafana dashboard and prometheus rules
  • grafana: setting oncall
  • shortlink: add livenessProbe
  • kubescape: setting dashboard
  • testkube: upd executor for cypress
  • rabbitmq: enable metrics
  • grafana-beyla: init docker-compose
  • istio: setting opentracing
  • opentelemetry-operator: add helm chart
• Security
  • ipd deps
• Other
  • cockroachdb: add dockerfile
  • helm: add spark-operator
  • docker-compose: use include
  • helm: set resources for pgo, nginx, prometheus
  • kubernetes: set a minimal version to 1.28 because it needs for istio
  • docker-compose: set IPv6 suubnet for default network
  • docker-compose: set IPv6 suubnet for default network

Back-End

• API
  • api-gateways: global refactoring
  • shortlink-api-ws: improve logger about start service
• backstage
  • [backstage](backstage: fix ingress tls)backstage: fix ingress tls
• support
  • support: add deploy setting
  • support: setting helm chart
  • support: add to argocd
• Auth
  • auth: init service
  • spicedb: refactoring permission
  • spicedb: add tests
  • spicedb: improve auth module
  • kratos: enable totp
• merch
  • merch: init first two services
• bot
  • bot: add archunit
• pkg
  • pkd: add Kube Secret Reader
  • concurrency: add rate limiter
  • pkg: rename handle_signal to graceful_shutdown
  • pkg: rabbitmq use context for consume
  • grpc: improve logging for go
  • rpc: refactoring client
  • rpc: refactoring server
  • GOEXPERIMENT: add cgocheck2,loopvar

UI

• ui-kit
  • ui-kit: add Timeline component
  • ui-kit: add Spotlight component
  • ui-kit: add PriceTable component
• next
  • next: improve dark mode for pricing page
  • next: improve dark mode for error page
  • next: refactoring contact page
• landing
  • landing: improve work with mobile device
• expo
  • expo: init application
  • expo: add first ADR and improve docs
• Common
  -...

April-May

shortlnik-link: refactoring migration

Signed-off-by: Victor Login <[email protected]>

Improve observability, docs

Main

• Improve observability
• Use C4 for docs

Docs

• ADR
  • adr: add microservice structure
  • keto: add init ADR
  • keto: add ADR - Implementing Permissions using ORY Keto
  • adr: improve observability
  • ADR-0007: check sonic-json for go
  • referral: add docs
• C4
  • docs: improve C4 docs
  • c4: add service billing
  • c4: add services
  • c4: add boundaries
  • c4: add preset
  • c4: add tags and import icons
  • c4: add service bff-web
  • c4: add cloudflare as service

DevOps

• UI
  • nginx: path support mjs is required for the new ES6 modules
  • ui: add Cache-Control
• ShortLink
  • shortlink-notify: use kafka
  • shortlink-link: setting kafka topic
  • Add OCI labels to docker images
  • dockerfile: add tini as init for containers
  • helm: add HELM_EXPERIMENTAL_OCI=1 to gitlab
  • shortlink-namespace: enabled istio-injection
  • shortlink-common: add hostUsers for pods
  • shortlink-common: add istio telemetry for namespace - shortlink
  • shortlink: use PodDisruptionBudget in base.yaml
• Local
  • hydra: add docker-compose
  • keto: add docker-compose
• Kubernetes
  • kubernetes: set minimal version 1.24.0
  • kafka: setting topicOperator
  • crunchydata: try use as default postgres-operator
  • prometheus-operator: enable alertmanager
  • kafka: use useServiceDnsDomain
• Istio
  • istio: enable istio-injection for database, grafana, auth, mq
  • helm: add istio sidecar for optimization use memory
  • istio: add ServiceEntry for firestore
• ArgoCD
  • argocd: v2.7.0-rc2
  • argocd: dragonfly to draft
  • argocd: elasticsearch -> elasticsearch-operator
  • helm: move kyverno and kubescape to security folder
  • argocd: add notify to grafana
  • argocd: enable kiali
  • argocd: add shortlink-billing
  • argocd: add redis for cache
  • pyroscope: to draft
  • testkube: to draft
  • external-secrets: to draft
  • elasticsearch: to draft
  • argocd: disable argo-events, argo-workflows, argocd-image-updater
  • chaos-mesh: add to argocd, update
• Grafana
  • grafana: add sidecar dashboard for rabbitmq, istio
  • grafana: add sidecar dashboard for cert-manager, istio
  • grafana: fix dashboard for cert-manager
  • grafana: refactoring dashboard
  • grafana: refactoring datasources
  • grafana: add folder for dashboard
  • grafana: add plugin flant-statusmap-panel
  • grafana: add k8s dashboards
  • grafana-loki: skipCrds
  • grafana: add plugin grafana-polystat-panel
  • redis: add grafana dashboard
  • etcd: add dashboard
• GitHub
  • Rename PULL_REQUEST_TEMPLATE.md to PULL_REQUEST_TEMPLATE_FOR_HUMAN.md
  • Create PULL_REQUEST_TEMPLATE.md
  • github: delete codeball, link-check
  • github: add link to chat for issue request
• GitLab
  • gitlab: improve job gotest
  • gitlab: fix docker version

Back-End

• ShortLink
  • go: return exit code 143: Graceful Termination (SIGTERM)
  • auth: enable metrics
  • shortlink-link: improve test
  • shortlink-link: improve tracing
  • proxy: use Protobuf-ES from buf
  • [shortlink-api: improve docs](8d829ddd82cb...

Job stabilization

Main

Docs

• ADR
  • ADR: add Profile-guided optimization
  • ADR: kubernetes network
  • adr: new adr - front-end testing

DevOps

• ShortLink
  • shortlink-landing: use exact link
  • ui-kit: fix helm
  • shortlink-proxy: enable ingress
  • shortlink-notify: setting store
  • shortlink-landing: fix network-policy
  • shortlink-common: fix work with env
  • shortlink-common: fix jobLabel for service-monitor
• ArgoCD
  • argocd: add pyroscope
  • argocd: move grafana stack from infrastructure to observability
  • pyroscope: add github sso
  • pyroscope: add k8s scrape-configs
  • kratos: add config for github
  • argocd: split phlare and grafana
  • cilium: add to draft
  • argocd: enable monitoring
  • grafana: delete problem dashboard go-runtime
  • helm: clean template
  • argocd: add falco
  • falco: add prometheus-exporter
  • external-secrets: v0.8.0
  • argocd: setting project - ignore istio and kyverno resources
  • argocd-image-updater: to draft
  • argocd: set level - warn
  • argocd: set ApplyOutOfSyncOnly -> true
  • argocd: use regex for targetRevision by SemVer
  • spiffe: add resource and servicemonitor -> true
• Local
  • pyroscope: add docker-compose and datasource for grafana
  • redpanda: add UI console
  • dragonfly: add db to argocd/helm/docker-compose
• GitHub
  • Update ossar.yml
  • github: fix codeball action
  • github: add action to check for broken links in Markdown, HTML
• GitLab
  • gitlab: improve code-quality
  • gitlab: improve check secret_detection job
  • gitlab: add cypress for landing

Back-End

• ShortLink
  • golang: enable observability services
  • pyroscope: add go tools
  • golang: use stable version 1.20
  • support: add deps for opentelemetry
  • proxy: fix dotenv
  • backstage: add healthcheck
  • next: use turbopack
  • ui-kit: upgrade rollup config
  • golangci: v1.52.0
• Package
  • raft: improve base interfaces

Support release

Main

Docs

• docs: add ci/cd schema
• knative: improve docs for functions
• ADR
  • ADR: improve security
  • adr: add observability common
  • adr: add decision about authentication
  • adr: add scheme authentification
  • ADR: improve observability
  • ADR: add lifecycle deploy

DevOps

• Argo
  • argocd: fix config for GitHub SSO
  • argoccd: set resources limit
  • argocd: add mongodb-operator
  • argocd: add nats
  • argocd: add minio-operator
    • minio-operator: add JWT cred
  • argocd: add kubecost
  • argocd: add kubescape
  • argocd: enable statusbadge
  • argocd: rook -> local-path-provisioner
  • argocd: separated grafana and grafana-loki
• GitHub
  • Delete proof-html.yml
  • Delete codacy.yml
  • Delete label.yml
• Grafana
  • grafana: add github SSO
  • grafana: Map roles using teams
  • kubescape: add grafana dashboard
  • grafana: enabled loki
  • tempo: upgrade to v2
• Security
  • docker: use SLSA Provenance
  • docker: use SBOM
  • k8s: fix automountServiceAccountToken
  • kubescape: readOnlyRootFilesystem - true
  • Improper Authentication in Kubernetes #169
• shortlink-common
  • shortlink-common: Egress Network Policies #351
• draft
  • argocd: add testkube
  • keda: improve chart
  • draft: add keycloak
  • argocd: teleport to draft
  • argocd: add rook-ceph
  • argocd: add caretta
• other
  • kustomization: use hash commit for security
  • helm: drop .Capabilities.APIVersions.Has "monitoring.coreos.com/v1"
  • keycloak: add docker-compose

Back-End

• Backstage
  • backstage: add todo-plugin
  • backstage: add prometheus
  • add techradar
  • backstage: add opencost
  • backstage: add dockerfile, helm, argocd
  • backstage: add plugin lighthouse
• other
  • improve tracing for golang and fix di

Front-End

Add teleport and backstage

Main

• Improve docs
• Add a new service - teleport - SSO
• Add a new service Backstage - docs platform for developer

Docs

• docs: add Governance
• Update README.md
• Update SECURITY.md
• docs: add ADOPTERS
• csi: fix and improve docs
• docs: add archi with 4C model
• ADR
  • ADR: use monorepository
  • ADR: add security

DevOps

• GitHub
  • Create scorecard.yml
  • StepSecurity: Apply security best practices
  • Create label.yml
  • Create dependabot.yml
  • github: add codecov
  • Update codeql-analysis.yml
  • Create ossar.yml
• Argo Rollout
  • shortlink-api: try canary deploy
• Argo CD
  • argo-cd: move ory/kratos to new appplication/helm chart
  • argo-cd: setting ory/hydra
  • argocd: upgrade elasticsearch
  • argocd-cd: add idp - teleport
  • argo-cd: upgrade to v2.6.0-rc2
  • kiali: setting
• Teleport
  • teleport: add users - admin, guest
  • teleport: enable acme
  • teleport: add ingress
• Nginx
  • nginx-ingress: enable enable-ssl-passthrough
• Cert-manager
  • cert-manager: enable spiffe
  • cert-manager: use DNS cloudflare
• shortlink-common
  • shortlink-common: fix work with env
  • shortlink-common: add support nginx-ingress for canary update
  • canary: add dynamicStableScale
  • shortlink-common: add VPA
  • shortlink-common: add custom spec
• GitLab
  • docker: enable SBOM
  • docker: fix DOCKER_CONTENT_TRUST for gitlab
  • docker: use 23.0.0-rc.1 for cli and dind
  • gitlab: add helm-secret
  • gitlab: change rule for run jons
• Other
  • kafka: fix helm chart

Back-End

• Backstage
  • backstage: init
  • backstage: add k8s
  • backstage: add ADR
  • backstage: add argo-cd
  • backstage: add shortlink-org
• support
  • support: init behat and composer
  • support: add rector
• other
  • use conc.WaitGroup
  • shortlink-proxy: improve tracing

Front-End

• ui-kit
  • ui-kit: fix routing
  • ui-kit: deploy storybook
• other
  • nextjs: use next-export-optimize-images
  • Create robots.txt

Other

Move to shortink-org/shortlink

Main

• Move to shortlink-org/shortlink
• Improve shortlink-common helm chart

DevOps

• github: add setting for release changelog
• shortlink-next: fix ing
• helm: setting serviceAccount
• helm: delete duplicate _helpers
• helm: fix base templates
• istio: fix configuration
• redis: argocd -> gitlab
• ingress-nginx: disable opentracing
• nginx-ingress: disabled rate-limit
• nginx-ingress: disabled rate-limit
• shortlink-common
  • shortlink-common: add ServiceAccount

New Year 🥳

Main

• Improve observability
• Refactoring docs
• Improve shortlink-common helm chart

Docs

• ADR
  • ADR: add point about strategies update ADR
  • ADR: add context for 0002 ADR
  • ADR: improve decision docs for 0003 ADR
  • add thoughtworks radar
  • adr: fix name 0005 story
  • adr: add product metrics by each services on grafana
  • adr: add new 'naming spans and attributes'
  • adr: add new 'logger format'
• Other
  • docs: improve docs
  • ui: improve README (add stack)
  • Create FUNDING.yml
  • improve pull request template
  • idea: refactoring .run
  • docs: add stackshare.io badge

DevOps

• GitLab
  • Update .gitlab-ci.yml
  • gitlab-ci: use postman collection for DAST
  • gitlab-ci: refactoring build for ui-kit
  • gitlab: workflow:name
  • gitlab: drop addon - prometheus operator
• GitHub
  • github: improve issue for add a new store
• local
  • docker-compose: update grafana to 2.39
  • minikube: change params RAM, CPU
  • nifi: init docker-compose
  • nats: add docker-compose and enable websocket
  • devops: refactoring getaway dcoker-compose
  • clickhouse: add
  • tarantool: add
  • kind: add features for work with HPA
• Grafana
  • grafana-phlare: init
  • grafana: add phlare for k8s
  • grafana-oncall: init
  • grafana: loki use tsdb index
• shortlink-common
  • shortlink-common: add _probe template
  • shortlink-common: use template for metadata
  • helm: add type deploy
  • shortlink-common: labels, selector
  • shortlink-common: add deployment
  • shortlink-common: add argocd for deployment
  • shortlink-common: deployment work with ports
  • shortlink-common: add service
  • argo-rollout: add canary deploy
  • argo-cd: improve shortlink-common - add priority-class
  • Kubernetes 1.26: Introducing Validating Admission Policies
  • shortlink-common: add strategy for volumes
  • shortlink-common: setting retries policy for nginx-ingress
  • shortlink-common: add istio ingress
  • shortlink-common: add HPA
• ArgoCD
  • argocd: add velero
  • argocd: add security-profiles-operator
  • sops: update GPG key
  • argocd: add istio
  • argocd: fix CRD problem
  • argocd: add custom extension
  • argocd: add rollout-extension
  • argocd: grafana split by values
• Istio
  • istio: HTTP-Based Overlay Network Environment (HBONE) support in side…
  • istio: add kiali-operator as dependencie
  • istio: meerge istio-gateway to istio
• Other
  • helm: update deps
  • k6: add extension for distributed tracing
  • example: Zero downtime restarts and deploys for Go using systemd
  • cert-manager: add approve and spiffe addons

Back-End

• Wallet - a new service for billing
  • Go Ethereum
• Newsletter
  • newsletter: cargo lint
  • newsletter: add idea config
• API
  • grpc-web: add an annotation for openAPI
  • grpc-gateway: improve docs
  • refactoring: new package for http server
  • http_server: use http.TimeoutHandler
  • grahql: add tracing
• Shortctl
  • refactoring: fix shortctl
• Stats
  • stats: add bazel for build stats service
  • stats: integrate bazel and conan
  • stats: add prometheus exporter :9090/metrics
  • stats: imporove docs
• Referall
  • [referral: use flask and opentelemetry](360...

ArgoCD, SOPS, ADR

Main

• Security
  • The ultimate guide to SBOMs
• ADR
  • add ADR by observability

DevOps

• observability
  • add ADR and HEALTHCHECK for all dockerfiles
• argocd
  • integration with sops
  • add gitlab-runner
  • add grafana
  • add chaos-mesh chart repository
  • argocd: use for api, link, logger, metadata, next, notify, proxy
  • argocd: add prometheus-operator
  • argocd: add kyverno
  • argocd: add a rule for correct work with kyverno
  • argocd-image-updater: improve dashboard
• gitlab
  • fix workflow
  • run gitlab ci by manual
  • sops: add gitlab secret-job
• helm: update deps
• golangci: set timeout to 10m
• coredns: upgrade to 1.10.0
• rabbitmq
  • use declarative exchanges
  • fix work with prometheus-operator
• istio: add Prometheus integration
• grafana: add istio dashboards
• helm: delete k8s dashboard chart

BackEnd

• opentelemetry: add for MySQL migration

UI

• add themeColor for next-seo
• next-ui
  • fix url
  • add an active item for sidebar

Other

• update dependencies for all projects (renovate bot)
• vscode: add recommendations extensions
• idea: add running kafka-to-elasticsearch