RANGER-4978: Synchronize Tags From Open Metadata Table Entities

[darshanik]

What changes were proposed in this pull request?

• This PR details the extension of tagsync to extract the tagged table entities from openmetadata and sync to ranger.

• Created new package openmetadatarest under tagsync source.

• Developed following class files under openmetadatarest package:

1. OpenmetadataRESTTagSource.java
2. RangerOpenmetadataEntity.java
3. RangerOpenmetadataEntityWithTags.java
4. OpenmetadataTableMapper.java
5. OpenmetadataResourceMapper.java
6. OpenmetadataResourceMapperUtil.java
7. OpenmetadataMappingHelper.java

• Added openmetadata properties for openmetadata and get methods in TagSyncConfig.java
• Added openmetadata properties in "installprop2xml.properties"
• Added openmetadata properties in ranger-tagsync-template.xml
• Added openmetadata properties in ranger-tagsync-site.xml
• Added dependencies of Openmetadata java client and openmetadata spec in tag sync pom xml
• Added openmetadata version in project's root pom.xml file

How was this patch tested?

This feature tested through unit tests and a practical simulation of a scenario involving tag synchronization from openmetadata into ranger.

More details can be found in the pdf document attached to this PR.

The document details all the class files, provides a code walkthrough and test results to reinforce the PR

Apache_Ranger_Tagsync_And_Openmetadata_Synchronization.pdf

[darshanik]

Hi @kumaab @mneethiraj, just want to check if I can contribute this PR?

Thank you so much

[darshanik]

Hi @mneethiraj @kumaab .

I tried to build the project with JDK 8 and 11 but the dependencies(openmetadata-java-client-1.6.4.jar and openmetadata-spec-1.6.4.jar) that are being used by my extended code for tagsync can only be compiled with JDK 17 and above.

Problem:
Existing JDK-8 and JDK-11 versions are having dependency conflict with my Changes(sync tags from openmetadata as source) because the openmetadata jars are compiled on JDk 17 and above

Suggested Solution:

I have spent sometime and was able to successfully build ranger along with my changes on open JDK 17 in my local machine.

Following is the snap for your reference.

So I have added additional stages of build-17 and docker build-17 in the "maven.yml" file to test the build in my bracnh as part of PR workflow before asking you.

However, I'm facing the following errors. I'm not sure if these errors are related to my changes.

If its not too much trouble, could you please guide me or suggest if there is any way that I can contribute my changes to Apache Ranger?

Thank you so much for your patience and consideration.

Please let me know if you need further details

my email: [email protected]

[darshanik]

Found one more way. it is to build a java -8 compatible proxy for openmetadata.

So that I can separate open metadata interaction (runs on java 17) using REST API calls to call or make use of JDK methods primitive to openmetadata SDK while ranger and other plugins can be compatible with jdk8 and 11.