ODPi Egeria Weekly Meeting 8th October 2020

ODPi Egeria Weekly Meeting - 8th October 2020

Attendees

• Mandy Chessell
• Chris Replogle
• Nigel Jones
• Ernie Ostic
• Lena Woolf
• Billy Bittles
• Graham Wallis
• David Radley

Agenda

• Integration Daemon and Integration Services status

  • Waiting in pull request #3707
  • Plan to merge 9th or 10th October
    • Waiting on fixed to Lab Notebooks and regression test for Open Lineage.
  • What is delivered:
    • Integration Daemon OMAG Server (admin services, runtime services)
    • Integration Service (OMIS) implementations for
      • Database Integrator
      • Files Integrator
      • Catalog Integrator (Stub only)
      • Organization Integrator (Stub only)
    • Integration services defined the interface for their integration connector and the implementation of the abstract classes to plug it into the Integration Daemon
  • What is next ...
    • Fix to the event clients to use own consumer group identifier with Kafka (See #3702)
    • Add support for Asset Manager OMAS
    • Fill out stub content in Catalog Integrator OMIS to support Asset MAnager OMAS API.
  • Initial priority ordering of supported open metadata types for Asset Manager OMAS/Catalog Integrator (will add iteratively)
    1. Asset (plus subtypes)
    2. Connection (plus Endpoint/ConnectorType and relationships between) and relationship to asset
    3. Software Server Capability
    4. SchemaElement (plus sub types) and relationship to asset
    5. Glossary, GlossaryCategory, GlossaryTerm, relationships between them plus term relationships and semantic assignment relationship. (Open question as to whether Area 3 classifications are needed.)
    6. Lineage relationships
    7. Governance Classifications
    8. Policies and Rules
    9. Reference Data and Valid Values
    10. Annotations
    11. Collaboration
    • What else?
  • Plan for supported integration connectors
    1. PostgreSQL and other open source relational DBs
    2. File system
    3. IBM Watson Knowledge Catalog
    4. Hive
    5. HDFS
    6. Atlas
    7. LFAI Amundsen
    8. SAS V9 Technologies
    • What else?

• AOB

Notes