PD-257019 Changes for emodb stabilization, kafka integration and stepfunction firing (#844)

* PD-257019 Stabilization emodb queue service changes (#831)

* PD-249429: integrated emodb with datastorage-media-service for getting the metadata from s3.

* PD-249429: refactored code.

* PD-249428: DELETE blob with blob id.

* PD-249428: Implemented upload blob from byte array.

* PD-249428: Implemented upload blob from byte array.

* PD-249428: Fixed failing ITs.

* PD-249428: Fixed failing ITs.

* PD-249428: Changed the snapshot version.

* PD-249428: Refactored code.

* PD-249428: changed the version to 172.

* PD-249428: commented tests.

* branch admin -prepare release emodb-6.5.172

* PD-249428: changed snapshot versions.

* PD-249428: changed snapshot versions.

* branch admin -prepare release emodb-6.5.173

* branch admin -prepare for next development iteration

* changed the BASE_URL

* PD-256742: fixed all bugs.

* PD-256742: changed snapshot version.

* PD-256742: changed snapshot version.

* branch admin -prepare release emodb-6.5.176

* branch admin -prepare for next development iteration

* for testing

* feat: integrate kafka to emodb

* Create kafka producer and admin service

* Overload the sendAll method to reroute messages to kafka

* Make the required changes in Clients like jersey2

* feat: include logic for separation  of queue and dedupq

* feat: include guava dependency injection for emodb

* fix: seperation of producer and admin service and proper injection

* fix: fix DI wiring issue

* feat: integrate triggering step function execution on creation of new topic

* feat: merge changes for stepfunction

* branch admin -prepare release emodb-6.5.175

* branch admin -prepare for next development iteration

* feat: add parameter store

* fix:add aws core dependency

* fix:remove credentialProvider

* fix: changes for ci deployment

* fix: pom changes for blob

* chore: update tags to 177 for deployment

* branch admin -prepare release emodb-6.5.177

* branch admin -prepare for next development iteration

* chore: update msk servers

* fix: include msk server url

* chore: snapshot update to 181

* branch admin -prepare release emodb-6.5.181

* branch admin -prepare for next development iteration

* feat: include working parameter store and stepfn changes

* add proper exception handling in parameter store and stepfn

* make abstractqueue service code modular and organized

* branch admin -prepare release emodb-6.5.182

* branch admin -prepare for next development iteration

* feat: fetch kafka configs from ssm and dependency injection for stepfn

* fetch aws configs from ssm parameter store

* introduce dependency injection for stepfunction service

* branch admin -prepare release emodb-6.5.183

* branch admin -prepare for next development iteration

* feat: feature flag implementation for queue migrations

* include the proper naming for each stepfn execution

* include all required contracts for stepfn

* include the feature flag logic, fetch params from parameter store and based on the allowed queues migrate

* fix: fix param for allowedQueues

* branch admin -prepare release emodb-6.5.184

* branch admin -prepare for next development iteration

* fix: remove blob changes

* chore: add comments and fix  start.sh

* fix: changed logic for feature flag
* add changed logic for feature flag implementation

* wrap the payload for stepfn around a executionInput parameter

* fix: fixed exception handling and code refactoring

* throw back exceptions after logging

* include create topic and checktopic in one function

* add comments for better description

---------

Co-authored-by: vikram-vikram_bveng <[email protected]>
Co-authored-by: jenkins <[email protected]>
Co-authored-by: nabajyotiDash-hub <[email protected]>

* update pom version

* branch admin -prepare release emodb-6.5.192

* branch admin -prepare for next development iteration

* modify producer properties (#834)

* PD-257019 Add universe fetching and bug fixes (#835)

* feat: add universe fetching and bug fixes

* fix: remove debug logs

* branch admin -prepare release emodb-6.5.193

* branch admin -prepare for next development iteration

* uncached_size for dedupq (#837)

* PD-257019 Producer send and logging changes (#838)

* fix: fix send logic and exception handling changes

* added exception handling

* changed producer send logic to be synchronous

* removed redundant logs

* uncached_size for dedupq (#837)

* chore: rename queuetype as per convention

* chore: fix naming issue

---------

Co-authored-by: nabajyotiDash-hub <[email protected]>

* branch admin -prepare release emodb-6.5.194

* branch admin -prepare for next development iteration

* branch admin -prepare release emodb-6.5.195

* branch admin -prepare for next development iteration

* branch admin -prepare release emodb-6.5.196

* branch admin -prepare for next development iteration

* chore: snapshot updates

* branch admin -prepare release emodb-6.5.194

* branch admin -prepare for next development iteration

* [PD-258160] added dd metrics for queue name and queue size (#836)

* branch admin -prepare release emodb-6.5.195

* alter pom version for bvengineering deployment

* branch admin -prepare release emodb-6.5.196

* update pom to 6.5.197-SNAPSHOT

* branch admin -prepare release emodb-6.5.197

* branch admin -prepare for next development iteration

* branch admin -prepare release emodb-6.5.198

* branch admin -prepare for next development iteration

* add cache

* add allowedQueues cache

* feat: producer future logic and caching changes

* chore: clear out unused code

* PD-257019 Producer send and logging changes (#838)

* fix: fix send logic and exception handling changes

* added exception handling

* changed producer send logic to be synchronous

* removed redundant logs

* uncached_size for dedupq (#837)

* chore: rename queuetype as per convention

* chore: fix naming issue

---------

Co-authored-by: nabajyotiDash-hub <[email protected]>

* fix: fix the config changes

* Revert "Merge branch 'master' into PD-257019-producer-async-fixes"

This reverts commit 93f5a76, reversing
changes made to 15ce863.

* chore: snapshot updates for deployement

* chore: clear up testing logs

* fix: remove default servers

* branch admin -prepare release emodb-6.5.202

* branch admin -prepare for next development iteration

* chore: caching logs refactoring

* branch admin -prepare release emodb-6.5.203

* branch admin -prepare for next development iteration

---------

Co-authored-by: vikram-vikram_bveng <[email protected]>
Co-authored-by: jenkins <[email protected]>
Co-authored-by: nabajyotiDash-hub <[email protected]>
Co-authored-by: nabajyotiDash-hub <[email protected]>
Co-authored-by: Anurag Dubey <[email protected]>

Author: 5 people

abc.txt

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

auth/auth-client/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

auth/auth-core/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

auth/auth-store/pom.xml

@@ -3,7 +3,7 @@
     <parent>
         <artifactId>emodb</artifactId>
         <groupId>com.bazaarvoice.emodb</groupId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../pom.xml</relativePath>
     </parent>
     <modelVersion>4.0.0</modelVersion>

auth/auth-util/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

blob-api/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

blob-clients/blob-client-common/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

blob-clients/blob-client-jersey2/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../../parent/pom.xml</relativePath>
     </parent>
 

blob-clients/blob-client/pom.xml

@@ -6,7 +6,7 @@
     <parent>
         <groupId>com.bazaarvoice.emodb</groupId>
         <artifactId>emodb-parent</artifactId>
-        <version>6.5.171-SNAPSHOT</version>
+        <version>6.5.204-SNAPSHOT</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>