v1.4.0

What's Changed

• Retry file downloader pipeline on lxplus authentication timeout + minor cli fixes by @gabrielmscampos in #57
• Commit mocked dbs example and minor fixes to local development documentation by @gabrielmscampos in #58
• fix: remove old lines from documentation by @gabrielmscampos in #59
• Update documentation for local development by @LukaLambrecht in #60
• fix: check user e-groups against confidential token instead of public token by @gabrielmscampos in #61
• refactor: persist current selected workspace whenever the root component re-mounts by @gabrielmscampos in #62
• chore: update frontend's oidc client id by @gabrielmscampos in #63
• Improve file_downloader error handling + disable warnings/messages from third-party libraries by @gabrielmscampos in #64

New Contributors

• @LukaLambrecht made their first contribution in #60

Full Changelog: v1.3.0...v1.4.0

v1.3.0

What's Changed

• chore: replace $APP_HOME from production frontend dockerfile with /usr/src/app/ by @gabrielmscampos in #53
• feat: add new mes to tracker workspace by @gabrielmscampos in #54
• feat: add egamma workspace by @gabrielmscampos in #55
• feat: add muon_staging workspace by @gabrielmscampos in #56

Full Changelog: v1.2.0...v1.3.0

v1.2.0

This release contains the following PRs:

• #38: Update repository to make sure generated docker-compose file works on Mac
• #39: Update documentation
• #40: Remove unused code from backend
• #41: Add script to re-schedule files marked as COPY_ERROR or ROOTFILE_ERROR by worskpace
• #42: chore: remove restart: always from postgres and redis in gencompose-self-contained.py
• #43: fix: plots width and height style in lumisection view
• #44: fix: set err_trace to None after pre_extract and post_load steps in file_downloader and file_ingesting pipelines
• #45: refactor: add automatic retry to file_ingesting pipeline for PipelineCopyError or PipelineRootfileError custom exceptions
• #46: fix: catch jwcrypto ValueError and raise InvalidToken when trying to load access token
• #47: refactor: support re-ingesting files that were successfully ingested but specify different MEs not present in etl.config.json
• #48: fix: issue_device_token raising KeycloakPostError unecessarily
• #49: refactor: update cache ttl default value to fix redis memory requests exceeded issue
• #50: refactor: enable sql queries logging using DJANGO_ENABLE_SQL_LOGS env var
• #51: refactor: update gunicorn deployment
• #52: Refactor ETL to automatically create partitions based on dataset_id

v1.1.0

This release contains the following PRs:

• #33: Make plotly charts truly resizable using builtin useResizeHandler
• #34: Fix general backend and frontend security issues reported by dependabot
• #35: Replace python-jose with jwcrypto and upgrade python-keycloak to get rid of ecdsa and python-jose security issues
• #36: Fix generate compose script and update docs

v1.0.1

Hotfix release with PR #27.

v1.0.0

First stable release of DIALS containing the following features:

ETL

• Automated indexing, downloading and ingestion of DQMIO files per-workspace;
• Support for multi-dataset ingestion;
• Leverages the power of Celery + Redis to implement highly-performance + memory-efficiency ETL routines splitted across several job queues with workspace-level isolation.

API

• Using django restframework to serve data trough strongly typed models;
• Bultin swaggerUI static files served trough nginx sidecar container;
• Implemented custom dynamic multi-ordering cursor pagination to efficiently server big tables data;
• Integration with CERN SSO;
• Singleton rest-api capable of serving multi-database data configurable via workspace header or automatically assigned given user roles;

Frontend

• React single page application (SPA) to communicate with backend rest-api and serve data in a dashboard-style enabling users to do data exploration on the web.

Infrastructure

• Complete set of kubernetes-compatible files currently deployed on CERN's Openshift.