Skip to content

v1.0.0
Compare
Choose a tag to compare
@gabrielmscampos gabrielmscampos released this 30 Apr 23:26
· 382 commits to develop since this release
v1.0.0
This tag was signed with the committer’s verified signature.
gabrielmscampos Gabriel Moreira
SSH Key Fingerprint: 91Q17db4FQsaMEI4mwoFaAc2PIUXcKT7+zxtL3IMMcM Learn about vigilant mode.
b15a0fa
This commit was signed with the committer’s verified signature.
gabrielmscampos Gabriel Moreira
SSH Key Fingerprint: 91Q17db4FQsaMEI4mwoFaAc2PIUXcKT7+zxtL3IMMcM Learn about vigilant mode.

First stable release of DIALS containing the following features:

ETL

  • Automated indexing, downloading and ingestion of DQMIO files per-workspace;
  • Support for multi-dataset ingestion;
  • Leverages the power of Celery + Redis to implement highly-performance + memory-efficiency ETL routines splitted across several job queues with workspace-level isolation.

API

  • Using django restframework to serve data trough strongly typed models;
  • Bultin swaggerUI static files served trough nginx sidecar container;
  • Implemented custom dynamic multi-ordering cursor pagination to efficiently server big tables data;
  • Integration with CERN SSO;
  • Singleton rest-api capable of serving multi-database data configurable via workspace header or automatically assigned given user roles;

Frontend

  • React single page application (SPA) to communicate with backend rest-api and serve data in a dashboard-style enabling users to do data exploration on the web.

Infrastructure

  • Complete set of kubernetes-compatible files currently deployed on CERN's Openshift.
Assets 2
Loading