Feat/gateway integration #89

cardosofede · 2025-10-13T21:27:44Z

No description provided.

rapcmia · 2025-10-14T09:00:37Z

commit b5f63ad

Run sh [setup.sh](http://setup.sh) ✅

Run ./run.sh --dev, ModuleNotFoundError: No module named 'models.gateway_trading' ❌

### Intiate ./run.sh --dev
Running API from source...
[+] Running 2/2
 ✔ Container hummingbot-postgres  Running                                                                                                                                                                                                 0.0s
 ✔ Container hummingbot-broker    Running                                                                                                                                                                                                 0.0s
INFO:     Will watch for changes in these directories: ['/home/yawnyunehh/hummingbot/hummingbot-api/89']
INFO:     Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
INFO:     Started reloader process [183598] using WatchFiles
Process SpawnProcess-1:
Traceback (most recent call last):
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/_subprocess.py", line 80, in subprocess_started
    target(sockets=sockets)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 67, in run
    return asyncio_run(self.serve(sockets=sockets), loop_factory=self.config.get_loop_factory())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "uvloop/loop.pyx", line 1518, in uvloop.loop.Loop.run_until_complete
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 71, in serve
    await self._serve(sockets)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 78, in _serve
    config.load()
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/config.py", line 438, in load
    self.loaded_app = import_from_string(self.app)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/importer.py", line 22, in import_from_string
    raise exc from None
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/importer.py", line 19, in import_from_string
    module = importlib.import_module(module_str)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 999, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89/main.py", line 35, in <module>
    from services.bots_orchestrator import BotsOrchestrator
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89/services/__init__.py", line 3, in <module>
    from .docker_service import DockerService
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89/services/docker_service.py", line 16, in <module>
    from models import V2ScriptDeployment
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89/models/__init__.py", line 132, in <module>
    from .gateway_trading import (
ModuleNotFoundError: No module named 'models.gateway_trading'

rapcmia · 2025-10-15T18:18:01Z

Commit e5b04d8

Use ./run —dev
- (optional) Had to use uvicorn main:app --reload --host 0.0.0.0 --port 8000 to test on diff machine ✅
- User must have a gateway instance running on the background, else it will not work ✅
  - Tested on both source and docker build ✅

Tested with hummingbot-mcp

Created generic.arbitrage_controller config successfully
Gateway stop/start ✅
Added gateway solana wallet and check balance ok
Change rpcProvider for both solana and ethereum
- Does not completely change url to {helius, infura} but instead udpate the rpc url and add apiKey
- Updated the nodeURL successfully and logs shows same as with hummingbot+gateway approach
Able to call configs and updates in progress

However im not able to deploy v2 controller with gateway yet getting error that format jupiter/router is not yet supported ❌

Same when we use POST /bot-orchestration/deploy-v2-controllers

curl -X 'POST' \
  'http://192.168.1.11:8000/bot-orchestration/deploy-v2-controllers' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "instance_name": "arb01",
  "credentials_profile": "master_account",
  "controllers_config": [
    "arbitrage_jup_kucoin.yml"
  ],
  "max_global_drawdown_quote": 0,
  "max_controller_drawdown_quote": 0,
  "image": "hummingbot/hummingbot:dev",
  "headless": false
}'

incase needed, here are the recorded logs of tests with mcp: test-gateway-endpoints.log

rapcmia · 2025-10-21T14:38:22Z

Commit 49f5c84

Purged everything and start from scrach to finalize the test

Test with humingbot-api + hummingbot-mcp + gateway

Successfully connected with source and docker
gateway start and stop is used with docker only

update nodeURL POST /gateway/networks/{network_id} ❗

curl -X 'POST' \
  'http://localhost:8000/gateway/networks/solana-mainnet-beta' \
  -u "admin:admin" \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "nodeURL": "https://wandering-chaotic-firefly.solana-mainnet.quiknode.pro/4fe376aa40a47aeaaa935036b56d33504e51dffb"
}'

# response
{
  "success": true,
  "message": "Updated 1 config parameter(s) for solana-mainnet-beta. Restart Gateway for changes to take effect.",
  "restart_required": true,
  "restart_endpoint": "POST /gateway/restart",
  "results": [
    {
      "message": "Configuration updated successfully: 'solana-mainnet-beta.nodeURL' set to \"https://wandering-chaotic-firefly.solana-mainnet.quiknode.pro/4fe376aa40a47aeaaa935036b56d33504e51dffb\""
    }
  ]
}

Commit still does not have the restart_endpoint": "POST /gateway/restart" ❌
- Had to manually restart or use the gateway stop/start endpoint so changes take effect

Test gateway trading:
- POST /gateway/swap/quote ✅
  - prices matched between endpoint and exchange
- POST /gateway/swap/execute
  - observed failing when using free node, response “No transaction hash returned from Gateway”
  - changed to paid node ✅
    - stop/start gateway to apply changes
  - sell https://solscan.io/tx/5zvBLubt7JY7Vi4hJ9RGd4VENN65iHFL4oR7hRen1dG1DDKbf7M3qmtFQ6yduS4dS231icYhorKtXWrBFyPUdGyt
  - buy https://solscan.io/tx/3Qd487U43KMDsZBVP5xxWkJEm9xv2erLCUixdYZhMGjKsn83wy5KbvQBDD5uKmz1peUxpeM2yzpqfTpdKnoLFdMP

Test generic.arbitrage_controller

Create generic.arbitrage_controller POST /controllers/configs/{config_name} ✅

curl -X 'POST' \
  'http://localhost:8000/controllers/configs/arb01' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
      "id": "test1",
      "controller_name": "arbitrage_controller",
      "controller_type": "generic",
      "total_amount_quote": "6",
      "manual_kill_switch": false,
      "candles_config": [],
      "initial_positions": [],
      "exchange_pair_1": {
        "connector_name": "jupiter/router",
        "trading_pair":"JUP-USDC"
       },
      "exchange_pair_2": {
        "connector_name": "kucoin",
        "trading_pair":"JUP-USDT"
       },
      "min_profitability": "-0.0015",
      "delay_between_executors": 30,
      "max_executors_imbalance": 1,
      "rate_connector": "binance",
      "quote_conversion_asset": "USDT"
}'

# response:
{
  "message": "Configuration 'arb01' saved successfully"
}

Uses the updated generic.arbitrage_controller ✅

Successfully deploy ✅

Incase needed, attached is the logs of hummingbot-mcp tests: test-endpoint-logs.log

--

im able to reproduce this behavior when i stop/start gateway and deploy any v2 controller configuration e.g generic.arbitrage_controller config hummingbot/deploy#87 ❌

rapcmia · 2025-10-21T15:26:10Z

Commit 7676c29

./run.sh —dev : ModuleNotFoundError: No module named 'services.gateway_transaction_poller' ❌

INFO:     Will watch for changes in these directories: ['/home/yawnyunehh/hummingbot/hummingbot-api/89b']
INFO:     Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO:     Started reloader process [1221674] using WatchFiles
Process SpawnProcess-1:
Traceback (most recent call last):
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/_subprocess.py", line 80, in subprocess_started
    target(sockets=sockets)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 67, in run
    return asyncio_run(self.serve(sockets=sockets), loop_factory=self.config.get_loop_factory())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "uvloop/loop.pyx", line 1518, in uvloop.loop.Loop.run_until_complete
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 71, in serve
    await self._serve(sockets)
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/server.py", line 78, in _serve
    config.load()
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/config.py", line 439, in load
    self.loaded_app = import_from_string(self.app)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/importer.py", line 22, in import_from_string
    raise exc from None
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/site-packages/uvicorn/importer.py", line 19, in import_from_string
    module = importlib.import_module(module_str)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yawnyunehh/anaconda3/envs/hummingbot-api/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 999, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89b/main.py", line 35, in <module>
    from services.bots_orchestrator import BotsOrchestrator
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89b/services/__init__.py", line 1, in <module>
    from .accounts_service import AccountsService
  File "/home/yawnyunehh/hummingbot/hummingbot-api/89b/services/accounts_service.py", line 16, in <module>
    from services.gateway_transaction_poller import GatewayTransactionPoller
ModuleNotFoundError: No module named 'services.gateway_transaction_poller'
INFO:     Stopping reloader process [1221674]

rapcmia · 2025-10-21T16:23:19Z

Commit c3528a0

Fixed gateway tx poller error ✅

Fresh install returns warning on market_data_provider omva;od connector format ❗

INFO:     Will watch for changes in these directories: ['/home/yawnyunehh/hummingbot/hummingbot-api/89b']
INFO:     Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO:     Started reloader process [1254309] using WatchFiles
INFO:     Started server process [1254311]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
2025-10-21 23:33:48,860 - hummingbot.data_feed.market_data_provider - WARNING - Could not get chain/network for gateway: Invalid connector format. Use format like 'uniswap/amm' or 'jupiter/router'
2025-10-21 23:33:48,860 - hummingbot.data_feed.market_data_provider - WARNING - Could not get chain/network for gateway: Invalid connector format. Use format like 'uniswap/amm' or 'jupiter/router'
2025-10-21 23:33:48,860 - hummingbot.data_feed.market_data_provider - WARNING - Could not get chain/network for gateway: Invalid connector format. Use format like 'uniswap/amm' or 'jupiter/router

Fixed when adding dex wallet POST /accounts/gateway/add-wallet ✅

Checked gateway endpoints, restart is now available ✅

curl -X 'POST' \
  'http://100.124.88.27:8000/gateway/restart' \
  -u "admin:admin" \
  -H 'Content-Type: application/json' \
  -d '{
  "passphrase": "string",
  "image": "hummingbot/gateway:latest",
  "port": 15888,
  "dev_mode": true
}'

# response
{
  "success": true,
  "message": "Gateway started successfully",
  "container_id": "333d637ed0a5206553357b570297a07680247e225f4973640edbf01fa22b5d54",
  "port": 15888
}

rapcmia · 2025-10-27T13:04:47Z

Commit 78dcd46

Tested hummingbot-api on source build + docker gateway (dev branch)
Tested using helius nodeURL
Not getting the data_feed.market_data_provider warning ✅
Gateway status, stop, start and restart ✅
Added solana wallets, helius API key ✅
Add controller configuration for generic.arbitrage_controller, deploy, stop and archived ✅
Tested gateway/swap quote and execute for {buy and sell} ✅
- Compare prices, data on curl response and txn, all ok

Setup production mode gateway by changing dev_mode to true ❌

Not able to start either valid or invalid passphrase
Container kept on restarting, can’t stop even using POST /gateway/stop
- Workaround: Run on terminal docker rm -f gateway to force remove
- Gateway works best on development mode (dev_mode: false) atm ✅

Test both this PR and gateway on docker ❗

Successfully build local docker image from this PR ✅
Check gateway status, stop, start and restart ✅
Other gateway endpoints returning gateway service is unavailable or gateway service is not available ❌
- GET or POST gateway/connector, gateway/chains, gateway/network, accounts/gateway/wallets and accounts/gateway/add-wallet ❌

in case needed, attached logs and hummingbot-mcp endpoint logs:
10272025a.zip

cardosofede added 19 commits October 7, 2025 17:17

(feat) add controller docs

b3ca232

(feat) ignore gateway files

da80e55

(feat) add passphrase for gateway in env

5ca7d25

(feat) add gatewya models

15bd8e1

(feat) add gateway service

13bd8e5

(feat) add deps and include router

fad0995

(feat) add gateway func

8990839

(feat) add gateway router

c74f0e1

(feat) add gateway models

e9e00a7

(feat) adapt routers to include gateway

5482674

(feat) add gateway models and client

c44d415

(feat) remove not necessary endpoint

5eb9eb1

(feat) improve models

1955798

(feat) improve gateway service

9907eb8

(feat) merge network chain

ff5d5f8

(feat) unify on network chain

3f00099

(feat) add gateway trading

7b4fe36

(feat) remove dex trading

f316c94

(feat) add gateway trading

b5f63ad

rapcmia added this to Pull Request Board Oct 14, 2025

rapcmia moved this to Backlog in Pull Request Board Oct 14, 2025

rapcmia requested review from fengtality and rapcmia October 14, 2025 06:22

rapcmia moved this from Backlog to Under Review in Pull Request Board Oct 14, 2025

cardosofede added 2 commits October 15, 2025 11:45

(feat) add gateway trading models

00e0237

(feat) add unique instance ts

e5b04d8

cardosofede added 2 commits October 16, 2025 19:24

(feat) adapting models

57cc733

(feat) improve gateway config and trading

140c53b

cardosofede added 3 commits October 20, 2025 22:48

(feat) add db cache in gateway trading

36bfe36

(feat) add gateway tx poller to accounts service

736656f

(feat) add restart endpoint

7676c29

(feat) add gateway tx poller

c3528a0

cardosofede added 5 commits October 21, 2025 13:44

(feat) git push

a43b3e5

(feat) improve balance query

92c5ac5

(feat) add better error handling

19f0be5

(feat) fix tx polling

4dc7280

(feat) re-order routes

78dcd46

cardosofede added 17 commits October 27, 2025 17:56

(feat) abstract swap in a different router

aebe12a

(feat) add clmm router

4623875

(feat) add utils to gateway client

00ac6c7

(feat) expose clmm and swap routers

1910be6

(feat) add status parsing

f12cafb

(feat) add position rent

f6a934c

(feat) improve db models

4c1d59a

(feat) add position poll interval

6b247cf

(feat) fix endpoint

2c04afd

(feat) add gateway config settings

d49eb24

(feat) pass gateway config

e0291a2

(feat) add to the env for local deploy

fc02bc1

(feat) override gateway url when deploying in docker

369997c

(feat) improve response snake case

a85f98d

(feat) add exceprtion

4bd4d04

(feat) improve logic for docker deployment

d13c34a

(feat) make host docker internal

dac5b15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Feat/gateway integration #89

Feat/gateway integration #89

Uh oh!

cardosofede commented Oct 13, 2025

Uh oh!

rapcmia commented Oct 14, 2025

Uh oh!

rapcmia commented Oct 15, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 27, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Feat/gateway integration #89

Are you sure you want to change the base?

Feat/gateway integration #89

Uh oh!

Conversation

cardosofede commented Oct 13, 2025

Uh oh!

rapcmia commented Oct 14, 2025

Uh oh!

rapcmia commented Oct 15, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 21, 2025

Uh oh!

rapcmia commented Oct 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

rapcmia commented Oct 27, 2025 •

edited

Loading