Skip to content

Commit

Permalink
ci: prod (#4638)
Browse files Browse the repository at this point in the history
* chore: use Transfer type, move to interfaces

* fix: sdk core imports

* fix: unused imports, ordering, types

* redis allow from anywhere + bigger nodes (#4349)

* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix lambda

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: kristohberg <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931d2405f9fd073704b81b5980a47dadc99b.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef463ae6baf22a65bddf973017f6771c76be.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: wanglonghong <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: kristohberg <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>

* chore: add relayer

* fix: mockable import and pool test added

* chore: sdk server startup and config to match other agents

* chore: server config tests

* chore: update config example

* ci: update ops config

* chore: add deps, update yarn lock

* chore: use exact version of dep

* fix: env var typos

* feat: add optional provider params to relevant methods

* fix: optional

* fix: added nycrc config

* feat: add new subgraphs (#4424)

* fix: env config

* chore: proper import from core

* chore: add transferId to the requestcontext (#4427)

* testnet prod (#4428)

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* feat: add redis plugin to server

* feat: make cache options configurable

* chore: add yarn.lock

* ci: remove deprecated commands (#4385)

* ci: fix job

* chore: yarn lock update

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: change variadic listen signature

* fix: use config file only if env var not supplied

* feat: staging redis for sdk server

* feat: prod redis for sdk server

* fix: redis config in backend

* redis allow from anywhere + bigger nodes (#4349)

* redis allow from anywhere + bigger nodes

* ci: redis allow from anywhere + bigger nodes

* fix vpc id

* chore: improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* fix: paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* fix: commitlint

* Testnet prod (#4258)

* feat: update swapandxcall addresses

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* Change to pending-reboot

* Increase mem

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix lambda

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: kristohberg <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: remove gelato temporarily

* fix: reenable gelato

* fix: merge

* fix: build

* fix: lint

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: fix tf var name

* ci: add linea rpc

* ci: bump sequencer CPU

* Prod Sync (#4339)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* feat: update swapandxcall addresses

* put back yarn release and yarnrc

* Add router

* Prep release

* tf configs for prover read replica

* fix typo

* feat: create utility to find asset record in chain data

* refactor: use created utility in all cases to ensure string mismatch doesnt happen

* fix: handle checksum failures

* chore: add unit tests for helper

* fix: build

* Install pg_cron

* Create cron jobs

* Fix name and tweak apply method

* fix: remaining .only

* ops: match mainnet prod prover memory

* Docker container for postgres with pg_cron

* Schema update

* Local DB image with pg_cron

* Use custom pg image with pg_cron

* Readme update

* Fix query

* Fix query

* Build db

* Change postgres image

* Database image

* Fix conf

* Fix package.json

* bump chain-abstraction sdk version

* bump chain-abstraction sdk - 18

* Mirror to mainnet

* Use module output for parameter group name

* Revert carto image env vars

* Use explicit parameter group dependency

* Ops readme update

* Mirror the param group change to mainnet

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* Change to pending-reboot

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* Increase mem

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* testnet prod sync (#4257)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Testnet sync (#4259)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix lambda

* Bump DB

* Add logging

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* Testnet-prod (#4261)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* feat: implement cache

* refactor: spokeSMT and hubSMT creation

* fix: queue limit setup

* Testnet (#4264)

* feat: do not cache the sdks to make it possible to have different client configs in one runtime

* put back yarn release and yarnrc

* v2.0.3: stable version release

* v2.0.3-alpha.1 alpha release

* v2.0.4-alpha.1 alpha release
fix: release version

* v2.0.4-alpha.2 alpha release

* Add ERD for reference

* WIP: sdk-server

* fix: handle empty chainData cases.

* Update fastpath.ts

* rmv: mnemonic (#4230)

* remove mnemonic

* increase timeouts (#4226)

* Sequencer cache persists (#4245)

* feat: add expiry time for executor cache

* fix test

* Batch pulling from the rabbitmq using amqplib  (#4216)

* feat: pull data from the queue in batch

* revert

* feat: move executor params to config

* fix: integration config

* rm

* fix: test

* Lint

* ci(test): no need to include it

* fix: queue limit setup

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: sanchaymittal <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix pending transfers query

* chore: add try/catch for database calls.

* chore: add try/catch for database for error status

* chore: add try/catch for database for saveTransfers

* chore: add try/catch for database for simulation

* feat: batchProverSize per domain

* chore: remove console logs

* feat: pick up the available aggregate roots

* fix: compare

* ci: batchsize

* ci(test): coverage

* ci: remove older dupe publish action

* ci: subpackages can differ in version tags

* ci(test): fix

* ci: typo

* ci(test): coverage

* fix: create external swap template

* fix: lpTokenAmount of removeOneToken

* fix: remove local setup

* Testnet prod sync (#4273)

* feat: staging subgraph for lp token

* fix:  LpToken subgraph

* feat: add snapshot to lp transfer events

* feat: v0 stableswap subgraph

* feat: graph-client build

* Revert "feat: graph-client build"

This reverts commit da0c931d2405f9fd073704b81b5980a47dadc99b.

* feat: rebuild graph-client

* feat: migration for lp transfers

* feat: database for lp transfers

* feat: subgraph for lp transfers

* feat: poller for lp transfer

* Cache completed subtrees

* fix: add more unit tests to database

* Hot Fix: Bump up testnet LH prover mem

* Hot Fix: Bump up testnet LH prover mem (#4279)

* Hot Fix: Remove read replica for testnet LH Prover

* Add concurrency to LH Prover

* Remove logs.

* fix: add unit tests for poller

* chore: lint

* Use concurrency also within a transfer path.

* Fix var name

* Convert env var to number

* Bump batch concurrency to 100

* Revert "Bump batch concurrency to 100"

This reverts commit 7d28ef463ae6baf22a65bddf973017f6771c76be.

* chore: logging

* Testnet Prod (#4300)

* fix: bump memory

* Testnet Prod (#4329)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* fix: mem

* fix: bump mem

* Testnet Prod (#4333)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>

* ci: don't commitlint testnet-prod and prod

* ci: fix job

* Testnet Prod Sync (#4334)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: commitlint

* Testnet sync (#4338)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* fix: commitlint

* fix: merge

* fix: build

* fix: lint

* fix: unit tests of poller (#4341)

* fix: commitlint

* ci: fix ci

* ci: testnet prod sync (#4343)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

---------

Co-authored-by: Liu <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: fix tf var name

* ci: add linea rpc

* Bump sequencer CPU

---------

Co-authored-by: kristohberg <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>

* ci: fix commitlint

* ci: fix ci

* ci: redis allow from anywhere + bigger nodes

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* ci: fix commitlint

* fix: commitlint

* ci: commitlint

* feat: query if processed root message exists in db

* fix: increase unprocessed root message limit to 100

* feat: check root message status on db

* fix: message status query

* test: add more unit tests for poller

* test: add unit tests for database

* fix: 4362 save transferid in the messages table (#4364)

* feat: add transfer_id to migration

* feat: zapatos

* fix: convert functions

* fix: unit tests for database

* chore: update graph packages

* ci: lint

* ci: testnet prod sync (#4360)

* feat: separate router and sequencer admin keys (#4316)

* feat: add nonce to stableswap staging events

* feat: add nonce to v0 stableswap events

* fix: event id

* feat: add nonce field to types

* feat: add nonce to stableswap db migration

* fix: database adapter for stableswap nonce

* chore: add commitlint local setup

* ci: update ci workflow for commitlint

* feat: update subgraph & poller logic with nonce

* feat: rebuild graph-client

* fix: query with bigInt params

* fix: carto poller unit tests

* fix: remove unused checkpoint for asset updates

* fix(test): unit tests for poller

* chore: add code owners (#4318)

* chore: add code owners

* (chore) testing gpg sign

* (chore) test signed commit

* (chore) testing signed commit

* ci: fix syntax

* ci: try different install

* ci: fix commitlint

* ci: validate commit

* feat: graph-client build

* Don't commitlint testnet-prod and prod

* Hot Fix: Update Linea goerli RPC

* Fix: Disable commitlint in testnet-prod

* feat: getSupportedAssets and tests added (#4324)

* feat: getSupportedAssets and tests added

* chore: use a mockable method

* fix(lint): auto fix order problems

* test(fix):  expect

* refactor: renaming

---------

Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* Fix aggregate root no exist (#4335)

* fix: use received aggregate root

* fix: lint

* feat: should ack and reject (#4336)

* chore: change comparison (#4330)

* Improve logging and refactor (#4337)

* feat: expose nonce api and refactors

* fix(utils):  mock

* test(fix): make optional

* Paginate reading pending txs from the redis cache (#4342)

* feat: implement pagination in the cache

* fix: random sort and keep the first timestamp

* fix: no need to retry within a execution window

* fix: commitlint

* chore: remove console logs

* ci: fix batch size

* feat: refactor sequencer subscriber (#4352)

* feat: dequeued

* feat: try without child process

* chore: remove and refactor

* chore: add dequeued check

* chore: remove conf

* fix: lint

* feat: dont scale with load (#4354)

* feat: dont scale with load

* chore: increase default size

* fix: resolve testnet prod sync conflicts (#4356)

* Testnet prod (#4353)

* ci: commitlint

* ci: db engine

* ci: fix

---------

Co-authored-by: Rahul Sethuram <[email protected]>

* ci: commitlint

* fix: expire data check (#4357)

* feat: should not handle transfer status here

* Fix commitlint

* fix: commitlint

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: wanglonghong <[email protected]>

* ci: commitlint

* ci: fix db

* ci: set proverBatchSize per chain (#4375)

* chore: update (#4378)

* feat: 4326 scale sequencer http server (#4363)

* Implement new pub and sub tasks for http messages.

* Tune the http pub-sub setup

* Add server to seq TF configs

* Add seq server to build and test config

* Refactor helpers for seq server

* Update seq mq config to add http queue

* fix: Update config handling

* feat: Update unit tests

* fix : correct config

* fix : remove todo

* refactor : Validate http post as per schema

* tests : Update unit tests

* tests : update exclusions

* fix : remove unused imports

* fix: Use fastify body schema validation

* fix: update default ports

* fix: update sequencer url in smoke tests

* fix: sequencer exec data not found in the cache (#4383)

* fix: remove unecessary prefetch config setup

* ci: better rpcs

* ci: bigger prover

* fix: sequencer exec data not found in the cache (#4383)

* fix: wait until none (#4386)

* fix: wait until none

* fix: slowpath cache issue

* ci: fix tests

* ci: fix smoke test config

* fix: update tf config for sequncer cname

* chore: bump chain abstraction

* fix: sequencer http queue config update

* fix: add auto scaling to seq publisher

* fix: typo and seq health port config change

* fix vpc id

* feat: prod

* feat: pass full images

* feat: enable alarms in testnet staging

* feat: testnet prod alarms

* fix: typos

* chore: update docker build command for mac

* chore: update docker settings for mac

* fix: use the correct server package

* ci: remove deprecated commands (#4385)

* ci: fix job

* fix: add proper types (#4401)

* fix: add proper types

* fix: add extra params

* fix: build

* chore: update from other branch

* fix sg name

---------

Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: wanglonghong <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: kristohberg <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Rahul Sethuram <[email protected]>

* chore: add relayer

* feat: add new subgraphs (#4424)

* chore: add transferId to the requestcontext (#4427)

---------

Co-authored-by: carlomazzaferro <[email protected]>
Co-authored-by: just-a-node <[email protected]>
Co-authored-by: wanglonghong <[email protected]>
Co-authored-by: Liu <[email protected]>
Co-authored-by: Layne Haber <[email protected]>
Co-authored-by: Sanchay Mittal <[email protected]>
Co-authored-by: kristohberg <[email protected]>
Co-authored-by: preethamr <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>
Co-authored-by: Prathmesh Khandelwal <[email protected]>

* feat: providerSanityCheck

* feat: providerSanityCheck tests

* chore: validation test

* fix: optional providers now

* fix: added few more test

* fix: import order and remove explicit cast

* chore: add .nycrc.json

* chore: fresh yarn.lock update

* chore: another yarn lock update

* ci: add yarn version check in workflow

* ci: add comment about network and environment

* fix: another yarn lock …
  • Loading branch information
15 people authored Jul 11, 2023
1 parent aa6118c commit 04ca8a9
Show file tree
Hide file tree
Showing 370 changed files with 150,843 additions and 108,711 deletions.
2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,6 @@
/packages/agents/ @preethamr @liu-zhipeng @wanglonghong @sanchaymittal @rhlsthrm
/packages/agents/sdk/ @just-a-node @sanchaymittal @rhlsthrm
/packages/deployments/ @LayneHaber @rhlsthrm @liu-zhipeng
/packages/examples/ @just-a-node @rhlsthrm @sanchaymittal
/packages/examples/ @just-a-node @rhlsthrm @sanchaymittal @preethamr
/packages/integration/ @LayneHaber @preethamr @rhlsthrm
/packages/utils/ @preethamr @liu-zhipeng @wanglonghong @rhlsthrm
70 changes: 65 additions & 5 deletions .github/workflows/build-test-deploy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -61,9 +61,14 @@ jobs:
node-version: "18"
cache: "yarn"

# - name: Validate using commitlint
# if: github.ref != 'refs/heads/testnet-prod' || github.ref != 'refs/heads/prod'
# uses: wagoid/commitlint-github-action@v5
- name: Check Yarn version
run: yarn --version

- name: Validate using commitlint
if: github.ref != 'refs/heads/testnet-prod' || github.ref != 'refs/heads/prod'
uses: wagoid/commitlint-github-action@v5
with:
commitDepth: 1

- name: Yarn install
run: yarn install
Expand Down Expand Up @@ -102,7 +107,8 @@ jobs:
"packages/adapters/txservice:@connext/nxtp-txservice"
"packages/adapters/subgraph:@connext/nxtp-adapters-subgraph"
"packages/adapters/cache:@connext/nxtp-adapters-cache"
"packages/agents/sdk:@connext/sdk"
"packages/agents/sdk:@connext/sdk-core"
"packages/agents/sdk-wrapper:@connext/sdk"
)
for entry in "${workspaces[@]}"; do
Expand Down Expand Up @@ -609,10 +615,52 @@ jobs:
- name: Build, tag, and push docker image to Amazon ECR Public

run: |
DOCKER_BUILDKIT=1 docker build -f docker/lighthouse/Dockerfile -t $REGISTRY/$REPOSITORY:$IMAGE_TAG -t ghcr.io/connext/lighthouse:$IMAGE_TAG .
DOCKER_BUILDKIT=1 docker build -f docker/lighthouse/lambda/Dockerfile -t $REGISTRY/$REPOSITORY:$IMAGE_TAG -t ghcr.io/connext/lighthouse:$IMAGE_TAG .
docker push $REGISTRY/$REPOSITORY:$IMAGE_TAG
docker push ghcr.io/connext/lighthouse:$IMAGE_TAG
build-and-push-lighthouse-prover-subscriber-image:
if: github.ref == 'refs/heads/main' || github.ref == 'refs/heads/staging' || github.ref == 'refs/heads/testnet-prod' || github.ref == 'refs/heads/prod'
env:
REGISTRY: ghcr.io
IMAGE_NAME: connext/lighthouse-subscriber
runs-on: ubuntu-latest
permissions:
contents: read
packages: write

steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Log in to the Container registry
uses: docker/login-action@f054a8b539a109f9f41c372932f1ae047eff08c9
with:
registry: ${{ env.REGISTRY }}
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}

- name: Extract metadata (tags, labels) for Docker
id: meta
uses: docker/metadata-action@98669ae865ea3cffbcbaa878cf57c20bbf1c6c38
with:
images: ${{ env.REGISTRY }}/${{ env.IMAGE_NAME }}
tags: |
type=sha,format=short
type=semver,pattern={{raw}}
- name: Build and push Docker image
uses: docker/build-push-action@ad44023a93711e3deb337508980b4b5e9bcdc5dc
with:
context: .
push: true
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
file: docker/lighthouse/subscriber/Dockerfile

outputs:
json: ${{ steps.meta.outputs.json }}

build-and-push-relayer-image:
if: github.ref == 'refs/heads/main' || github.ref == 'refs/heads/staging' || github.ref == 'refs/heads/testnet-prod' || github.ref == 'refs/heads/prod'
env:
Expand Down Expand Up @@ -773,6 +821,7 @@ jobs:
build-and-push-sequencer-subscriber-image,
build-and-push-cartographer-image,
build-and-push-lighthouse-image,
build-and-push-lighthouse-prover-subscriber-image,
build-and-push-relayer-image,
build-and-push-watcher-image,
build-and-push-sdk-server-image,
Expand All @@ -786,6 +835,7 @@ jobs:
SEQUENCER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-subscriber-image.outputs.json).tags[0] }}
CARTOGRAPHER_IMAGE: ghcr.io/connext/cartographer:${{ github.sha }}
LIGHTHOUSE_IMAGE: ghcr.io/connext/lighthouse:${{ github.sha }}
LIGHTHOUSE_PROVER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json).tags[0] }}
RELAYER_IMAGE: ${{ fromJSON(needs.build-and-push-relayer-image.outputs.json).tags[0] }}
WATCHER_IMAGE: ${{ fromJSON(needs.build-and-push-watcher-image.outputs.json).tags[0] }}
SDK_SERVER_IMAGE: ${{ fromJSON(needs.build-and-push-sdk-server-image.outputs.json).tags[0] }}
Expand Down Expand Up @@ -814,6 +864,7 @@ jobs:
sequencer-server-tags: ${{ needs.build-and-push-sequencer-server-image.outputs.json }}
sequencer-publisher-tags: ${{ needs.build-and-push-sequencer-publisher-image.outputs.json }}
sequencer-subscriber-tags: ${{ needs.build-and-push-sequencer-subscriber-image.outputs.json }}
lighthouse-prover-subscriber-tags: ${{ needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json }}
relayer-tags: ${{ needs.build-and-push-relayer-image.outputs.json }}
watcher-tags: ${{ needs.build-and-push-watcher-image.outputs.json }}
sdk-server-tags: ${{ needs.build-and-push-sdk-server-image.outputs.json }}
Expand All @@ -832,6 +883,7 @@ jobs:
build-and-push-sequencer-subscriber-image,
build-and-push-cartographer-image,
build-and-push-lighthouse-image,
build-and-push-lighthouse-prover-subscriber-image,
build-and-push-relayer-image,
build-and-push-watcher-image,
build-and-push-sdk-server-image,
Expand All @@ -844,6 +896,7 @@ jobs:
SEQUENCER_PUBLISHER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-publisher-image.outputs.json).tags[0] }}
SEQUENCER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-sequencer-subscriber-image.outputs.json).tags[0] }}
LIGHTHOUSE_IMAGE: ghcr.io/connext/lighthouse:${{ github.sha }}
LIGHTHOUSE_PROVER_SUBSCRIBER_IMAGE: ${{ fromJSON(needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json).tags[0] }}
RELAYER_IMAGE: ${{ fromJSON(needs.build-and-push-relayer-image.outputs.json).tags[0] }}
WATCHER_IMAGE: ${{ fromJSON(needs.build-and-push-watcher-image.outputs.json).tags[0] }}
WEB3_SIGNER_PRIVATE_KEY_ROUTER: "0xc87509a1c067bbde78beb793e6fa76530b6382a4c0241e5e4a9ec0a0f44dc0d3"
Expand Down Expand Up @@ -878,6 +931,7 @@ jobs:
sequencer-server-tags: ${{ needs.build-and-push-sequencer-server-image.outputs.json }}
sequencer-publisher-tags: ${{ needs.build-and-push-sequencer-publisher-image.outputs.json }}
sequencer-subscriber-tags: ${{ needs.build-and-push-sequencer-subscriber-image.outputs.json }}
lighthouse-prover-subscriber-tags: ${{ needs.build-and-push-lighthouse-prover-subscriber-image.outputs.json }}
relayer-tags: ${{ needs.build-and-push-relayer-image.outputs.json }}
watcher-tags: ${{ needs.build-and-push-watcher-image.outputs.json }}
sdk-server-tags: ${{ needs.build-and-push-sdk-server-image.outputs.json }}
Expand Down Expand Up @@ -989,6 +1043,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.smoke-tests.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.smoke-tests.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.smoke-tests.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.smoke-tests.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down Expand Up @@ -1045,6 +1100,7 @@ jobs:
sequencer-server-tags: ${{ needs.smoke-tests.outputs.sequencer-server-tags }}
sequencer-publisher-tags: ${{ needs.smoke-tests.outputs.sequencer-publisher-tags }}
sequencer-subscriber-tags: ${{ needs.smoke-tests.outputs.sequencer-subscriber-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.smoke-tests.outputs.lighthouse-prover-subscriber-tags }}
router-publisher-tags: ${{ needs.smoke-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.smoke-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.smoke-tests.outputs.router-executor-tags }}
Expand All @@ -1063,6 +1119,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.e2e-tests.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.e2e-tests.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.e2e-tests.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down Expand Up @@ -1117,6 +1174,7 @@ jobs:
sequencer-server-tags: ${{ needs.e2e-tests.outputs.sequencer-server-tags }}
sequencer-publisher-tags: ${{ needs.e2e-tests.outputs.sequencer-publisher-tags }}
sequencer-subscriber-tags: ${{ needs.e2e-tests.outputs.sequencer-subscriber-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags }}
router-publisher-tags: ${{ needs.e2e-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.e2e-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.e2e-tests.outputs.router-executor-tags }}
Expand Down Expand Up @@ -1188,6 +1246,7 @@ jobs:
router-publisher-tags: ${{ needs.e2e-tests.outputs.router-publisher-tags }}
router-subscriber-tags: ${{ needs.e2e-tests.outputs.router-subscriber-tags }}
router-executor-tags: ${{ needs.e2e-tests.outputs.router-executor-tags }}
lighthouse-prover-subscriber-tags: ${{ needs.e2e-tests.outputs.lighthouse-prover-subscriber-tags }}
relayer-tags: ${{ needs.e2e-tests.outputs.relayer-tags }}
watcher-tags: ${{ needs.e2e-tests.outputs.watcher-tags }}
sdk-server-tags: ${{ needs.e2e-tests.outputs.sdk-server-tags }}
Expand Down Expand Up @@ -1262,6 +1321,7 @@ jobs:
TF_VAR_full_image_name_sequencer_subscriber: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.sequencer-subscriber-tags).tags[0] }}
TF_VAR_full_image_name_relayer: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.relayer-tags).tags[0] }}
TF_VAR_full_image_name_watcher: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.watcher-tags).tags[0] }}
TF_VAR_full_image_name_lighthouse_prover_subscriber: ${{ fromJSON(needs.terraform-services-backend-prod-testnet.outputs.lighthouse-prover-subscriber-tags).tags[0] }}
TF_VAR_lighthouse_image_tag: ${{ github.sha }}

runs-on: ubuntu-latest
Expand Down
2 changes: 0 additions & 2 deletions .husky/commit-msg
Original file line number Diff line number Diff line change
@@ -1,4 +1,2 @@
#!/usr/bin/env sh
. "$(dirname -- "$0")/_/husky.sh"

yarn dlx commitlint --edit $1
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@

## Connext Architecture

The Connext architecture can be seen as a layered system, as follows:
The Connext architecture can be seen as a layered system, as follows.

| Layer | Protocol/Stakeholders |
| -------------------------------- | -------------------------------------- |
Expand Down
File renamed without changes.
85 changes: 85 additions & 0 deletions docker/lighthouse/subscriber/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
FROM node:18-alpine as node

# ----------------------------------------
# Builds Docker container for nxtp-router package.
# @dev configuraion located ./config.json (relative to this file)


# ----------------------------------------

FROM node as build
RUN apk update
RUN apk add git

ENV HOME=/tmp/build \
PATH=/tmp/build/node_modules/.bin:./node_modules/.bin:${PATH}

WORKDIR /tmp/build

ARG TEMP_DEPS_DIR

# ----- Copy only the files that affect yarn install -----
# Allows docker to use cache and skip install if dependencies are unchanged.
# Assumes that ./packages/*/package.json files have been copied to TEMP_DEPS_DIR
# with that same directory structure. build.sh does this.
COPY .yarn /tmp/build/.yarn/
COPY .yarnrc.yml /tmp/build/
COPY package.json /tmp/build/
COPY packages/agents/lighthouse/package.json /tmp/build/packages/agents/lighthouse/
COPY packages/agents/relayer/package.json /tmp/build/packages/agents/relayer/
COPY packages/adapters/txservice/package.json /tmp/build/packages/adapters/txservice/
COPY packages/adapters/cache/package.json /tmp/build/packages/adapters/cache/
COPY packages/adapters/web3signer/package.json /tmp/build/packages/adapters/web3signer/
COPY packages/deployments/contracts/package.json /tmp/build/packages/deployments/contracts/
COPY packages/adapters/database/package.json /tmp/build/packages/adapters/database/
COPY packages/adapters/relayer/package.json /tmp/build/packages/adapters/relayer/
COPY packages/adapters/subgraph/package.json /tmp/build/packages/adapters/subgraph/
COPY packages/adapters/web3signer/package.json /tmp/build/packages/adapters/web3signer/
COPY packages/utils/package.json /tmp/build/packages/utils/
COPY yarn.lock /tmp/build/

# ----- Install dependencies -----
# Install dependencies exactly as in the yarn.lock file - no updates.
RUN yarn install

# ----- Copy source and all other files that affect lint, test, build -----
COPY config config/
COPY packages/agents/lighthouse/ /tmp/build/packages/agents/lighthouse/
COPY packages/agents/relayer /tmp/build/packages/agents/relayer
COPY packages/adapters/txservice /tmp/build/packages/adapters/txservice
COPY packages/adapters/cache /tmp/build/packages/adapters/cache
COPY packages/adapters/web3signer /tmp/build/packages/adapters/web3signer
COPY packages/deployments/contracts /tmp/build/packages/deployments/contracts/
COPY packages/adapters/database /tmp/build/packages/adapters/database
COPY packages/adapters/relayer /tmp/build/packages/adapters/relayer
COPY packages/adapters/subgraph /tmp/build/packages/adapters/subgraph
COPY packages/utils /tmp/build/packages/utils
COPY .eslintignore /tmp/build/
COPY .eslintrc.js /tmp/build/

# ----- Lint, test and build -----
RUN yarn build

# ----------------------------------------
# Copy files to the deployment image.
# ----------------------------------------

FROM node as runtime

ENV NODE_ENV=production \
PORT=8081

ARG COMMIT_HASH
ENV COMMIT_HASH ${COMMIT_HASH:-unknown}

# ----- Copy files required at runtime by the app -----
COPY --from=build --chown=node:node /tmp/build /home/node

# This user is created in the base image with uid and gid = 1000.
USER node

WORKDIR /home/node/packages/agents/lighthouse

EXPOSE 8081

CMD ["node", "--trace-warnings", "dist/tasks/run.js"]
8 changes: 5 additions & 3 deletions ops/env/testnet/core/secrets.prod.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
"optgoerli_alchemy_key_1": "ENC[AES256_GCM,data:IKvEQW3u/ShLXgt90ZyvbwSgaoWSVjNKucefr1ZUOks=,iv:KNkyaDV+MoVJ4GmQDwxn/drHeTNXAtJ+IdXkh5r1UxY=,tag:7stNWMB0nmWqOrqZwsOENw==,type:str]",
"arbgoerli_alchemy_key_0": "ENC[AES256_GCM,data:FznvthayCWL5gQrBs4GSyRkZrXg1fAXTpuvHoZ0Brmw=,iv:h/Ln5MiegVXtUgCWB65hwfCVhRht9cr2Fw4QbUO4ZPg=,tag:r1ueHnIDTKcQBxVRmirvfg==,type:str]",
"arbgoerli_alchemy_key_1": "ENC[AES256_GCM,data:AoJEiPuHviI14XuFJP7/GFTbEd5UfLHXq3OefHwV3BQ=,iv:tvvt76MHKvXcsVOl+Lk2t6PjazzhS/tBXbVWuJ1JL8w=,tag:KS9pom1Fz9o7DLsPuxLrRQ==,type:str]",
"mumbai_alchemy_key_0": "ENC[AES256_GCM,data:VolMxEjn8+QnY13VzDpEWenyv1CBjvyjcLMb1l/xlrw=,iv:BWvw9p/3JYsLpqdszm5JIasoxjypghjaff/BJ2QIOtM=,tag:M/AN6XyOJoAL7/RNWy7SuQ==,type:str]",
"blast_key": "ENC[AES256_GCM,data:aOV48KWCE0L4tjHc+Tdt4oQBFGbTRKeb+2DMFI4Y7LGjYNke,iv:wv3W/M2ZKTFpj28WAUZIvPKOc4kvsWqabDd+qoVTdg4=,tag:gWHQBWTVIjT0PymIHOROnQ==,type:str]",
"infura_key": "ENC[AES256_GCM,data:xLJ5hNQ15pRWC7HwEX478tkJBv1czUM7LGufL+wIgsI=,iv:ZWrq2/0iXMTe+V6+0owJ4A3WczTMUYANEM6mUV/b8II=,tag:Uw8BBlJg6LkaVPMya9fMrA==,type:str]",
"admin_token_router": "ENC[AES256_GCM,data:V0FuvFfMBS0=,iv:MW6eOYjcM8xgMGpr3204tYvFsm3IVXNTAUjBmcs2YRc=,tag:lLfG206oCZvEUn7jeWTEyw==,type:str]",
Expand All @@ -13,14 +14,15 @@
"sequencer_web3_signer_private_key": "ENC[AES256_GCM,data:LKvTW3OXzOuoPCUcHSTzhJ9GUYZk1wXLZGeILQRI6Rby6F/uRzANeSRqlYQScpZFPWQsHP4kr4w0CAN87YKb+gBC,iv:FNTTCOjwsVNhq+aBY6wvciDMDC/k0me36OVueVg0KKc=,tag:HZZwkikhZvthv+NaegYaFA==,type:str]",
"rmq_mgt_password": "ENC[AES256_GCM,data:Oi9s0fu4N/f7fAfOrOzT,iv:dPo0CPlK/jW++lrvn8BXvBEUFYM1/zR/wQ18IbLFB1Y=,tag:S2poo/5rwURMmflFGkVFaQ==,type:str]",
"dd_api_key": "ENC[AES256_GCM,data:rIb32o+5nSbWcnlP2Mh809lyUX9YBPmdiLb2sMZjlKU=,iv:7FEHx2G+2f0DDXkpJbhg22olEFi84MJ5wGae7AWymLw=,tag:Uw30LcE7I6gSHpoOkHkkMw==,type:str]",
"gelato_api_key": "ENC[AES256_GCM,data:hO9Iu+2/P9VvjKdAD2bPUo3umAo40H8o4znXHjmU/eYRSoQeValKPQ6XYHE=,iv:e2wzAorK7Xi74ZjcseV7MXMYpzyZbshjTda26OCOCoE=,tag:6kJTtFFbGGX1Lp6eX1oRow==,type:str]",
"gelato_api_key": "ENC[AES256_GCM,data:4OclSfsgqoUaLlP2VCPHuBWHjyNhqacfcHSVIuITTT+3MS472H+/cDAD/Jo=,iv:FQxUG/iDcRYJfJ9+HmGKqVmMzQj2q+jYl97Ilk39iBM=,tag:P4P8+9T6NhKy/Le3tnlaPg==,type:str]",
"postgres_password": "ENC[AES256_GCM,data:B1oNgHFUYpPq0yW0nQ8g,iv:+S3cX5vplDOG6E7lOoP9i5gxZNImoJa15Lpq1hTt0lY=,tag:kz712HJLrstZJms8zwbHZA==,type:str]",
"lighthouse_prover_heartbeat": "ENC[AES256_GCM,data:oK1YZySKHGLzEQK1c9lIXV8+tSr7xUcE,iv:AbmAilQ6OKgsULAhf7FKPQnx+t7qhT16JKScfgx73c8=,tag:AGxzf4RhHF8KK3w/+aEPxw==,type:str]",
"lighthouse_processor_heartbeat": "ENC[AES256_GCM,data:jP4KFfz+YlpcDsV+RzyHpskYyUGppfyy,iv:VcyoHBwSvsN/hiZ5S44euEjjbJXOEX0/PwqGpy1IJMw=,tag:oatM6EgA5fU2zfZz2KPm5A==,type:str]",
"lighthouse_propagate_heartbeat": "ENC[AES256_GCM,data:ngWH/ENDrnuZWThozPT+NO1DWZ4eFgKH,iv:MJDorgIdm4o+vm1wgpwgqk9783sHi95sgfd0XXzStSM=,tag:3lCtngMWTyUf27+fz8yQRQ==,type:str]",
"lighthouse_send_outbound_root_heartbeat": "ENC[AES256_GCM,data:rK5ImySl4pZdI6Ag4sAZ84cECd/NTz1k,iv:450J2HvaXXf3p4fN1GAGFMQWRjBWKQI4KfqsiZh9gug=,tag:EE6dpf0QRLw7Z4c/RvVFSA==,type:str]",
"relayer_web3_signer_private_key": "ENC[AES256_GCM,data:zUtd3IiSb3GWERzM5aRQG0WInleSduWFkg6NJb/oIAJ4o4nMp1q+hWhPC2dEpma1lppbX9tkmydxAgrzr16u7MAa,iv:exruQBT5UsbagQiibyS88od/nmWHRs5wCPWetuFY4QY=,tag:G8QhkoxQYpqf0SioA/NBCQ==,type:str]",
"linea_node": "ENC[AES256_GCM,data:I1fqRfyk3iF0xsSd2OuyxCBdF2odFVRjYJg=,iv:sZlgP202Q7Q2gPGmefezi+8XNqWo8qV7SQzlGUHl1Ig=,tag:m7yczphoaziyedJMAL6AAg==,type:str]",
"optgoerli_alchemy_key_for_lh": "ENC[AES256_GCM,data:is7Xn79cWf8JIQEu5MPbdpy7kGKXmMDGbqnq5xxMinE=,iv:6UpjIqrMb0PNytb37aOH5clr4/GMVSIFGtO3T0NfYr8=,tag:JKhE5xQLR5wpMxOMscXvVQ==,type:str]",
"sops": {
"kms": [
{
Expand All @@ -34,8 +36,8 @@
"azure_kv": null,
"hc_vault": null,
"age": null,
"lastmodified": "2023-05-05T15:11:36Z",
"mac": "ENC[AES256_GCM,data:7QVkpinkhx3R1gwdTKmVRFZ5E9Yfvsgx5vHfnl/B4F5xiL2RPD+gglPqVP41h5i03VfltSsQtRaOzw4Bw935Eq/8Tr5ypr2vIb9hnMys4yq5lQDXEj2/dXsRRRp1EHAMwD2lFFa8OBJdqUwFQ3Ocl1Nj6UNtvPGohaEx6frctME=,iv:rKID/71rb1/Pg9YvoCIakkFgchvF9MCs9pqUUMS7B20=,tag:vkYdru8bzYNk93Cd++Vkew==,type:str]",
"lastmodified": "2023-06-20T08:53:00Z",
"mac": "ENC[AES256_GCM,data:03ff0KH7+dCzZrc/SHwl4DdInbZ5ArBveoDKQRRWStKX8r5aYxoVNGVLRv5GtJvg/sWRBodUxJfpXXr/C2N2TseMAbCcFeQz23LmJgQwljSvq9hC33Seupf5MUl0EX1+ibFkpLAmxYyhTKCiLMKNh7GvjTKxF6jt5CcOW+b1RyI=,iv:g9XXrnV7+SCwJT87RzIIGa+woRlhpLTAnUq46mCGfZk=,tag:8/1fuUCINRamsbQRpKyXTQ==,type:str]",
"pgp": null,
"unencrypted_suffix": "_unencrypted",
"version": "3.7.3"
Expand Down
Loading

0 comments on commit 04ca8a9

Please sign in to comment.