-
Notifications
You must be signed in to change notification settings - Fork 574
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failure to connect to a Postgres hosted in AWS RDS through SSM Port Forwarding #1278
Comments
Config.yaml type: llm
type: embedder
type: engine type: document_store type: pipeline
settings: |
@lenongsa thanks for reporting this. |
Describe the bug
It's not possible to connect to an AWS RDS Postgres database through the UI when doing SSM Port Forwarding. More specifically, if the RDS instance is in a private subnet and can only be acessed thorugh SSM Port Forwarding, and we forward localhost:5432 to the RDS instance port 5432, we get the following error when trying to connect to it through the WrenAI UI:
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A connection is established to the RDS Postgres instance.
Screenshots
Desktop (please complete the following information):
Wren AI Information
Relevant log output
wren-ai-ibis-server logs
2025-02-08 04:16:58.894 | [053f8d27-7e0e-4737-889c-5bd05343ddc2] | INFO | init.dispatch:29 - Request ended
ERROR Exception in ASGI application
| File "/app/.venv/lib/python3.11/site-packages/starlette/_utils.py", line 76, in collapse_excgroups
| yield
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 186, in call
| async with anyio.create_task_group() as task_group:
| File "/app/.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 767, in aexit
| raise BaseExceptionGroup(
| ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
+-+---------------- 1 ----------------
| Traceback (most recent call last):
| File "/app/.venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
| result = await app( # type: ignore[func-returns-value]
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
| return await self.app(scope, receive, send)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
| await super().call(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/applications.py", line 113, in call
| await self.middleware_stack(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
| raise exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
| await self.app(scope, receive, _send)
| File "/app/.venv/lib/python3.11/site-packages/asgi_correlation_id/middleware.py", line 90, in call
| await self.app(scope, receive, handle_outgoing_request)
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
| with collapse_excgroups():
| File "/usr/local/lib/python3.11/contextlib.py", line 155, in exit
| self.gen.throw(typ, value, traceback)
| File "/app/.venv/lib/python3.11/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
| raise exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 187, in call
| response = await self.dispatch_func(request, call_next)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/middleware/init.py", line 35, in dispatch
| response = await call_next(request)
| ^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 163, in call_next
| raise app_exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 149, in coro
| await self.app(scope, receive_or_disconnect, send_no_error)
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
| with collapse_excgroups():
| File "/usr/local/lib/python3.11/contextlib.py", line 155, in exit
| self.gen.throw(typ, value, traceback)
| File "/app/.venv/lib/python3.11/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
| raise exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 187, in call
| response = await self.dispatch_func(request, call_next)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/middleware/init.py", line 27, in dispatch
| raise exc
| File "/app/middleware/init.py", line 24, in dispatch
| return await call_next(request)
| ^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 163, in call_next
| raise app_exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 149, in coro
| await self.app(scope, receive_or_disconnect, send_no_error)
| File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
| await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
| raise exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
| await app(scope, receive, sender)
| File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
| await self.middleware_stack(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
| await route.handle(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
| await self.app(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
| await wrap_app_handling_exceptions(app, request)(scope, receive, send)
| File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
| raise exc
| File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
| await app(scope, receive, sender)
| File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
| response = await f(request)
| ^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
| raw_response = await run_endpoint_function(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
| return await run_in_threadpool(dependant.call, **values)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/starlette/concurrency.py", line 39, in run_in_threadpool
| return await anyio.to_thread.run_sync(func, *args)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
| return await get_async_backend().run_sync_in_worker_thread(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2461, in run_sync_in_worker_thread
| return await future
| ^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 962, in run
| result = context.run(func, *args)
| ^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/routers/v2/connector.py", line 71, in get_table_list
| return MetadataFactory.get_metadata(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/model/metadata/factory.py", line 28, in get_metadata
| return mappingdata_source
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/model/metadata/postgres.py", line 17, in init
| self.connection = DataSource.postgres.get_connection(connection_info)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/model/data_source.py", line 45, in get_connection
| return DataSourceExtension[self].get_connection(info)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/model/data_source.py", line 72, in get_connection
| return ibis.connect(info.connection_url.get_secret_value())
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/ibis/backends/init.py", line 1444, in connect
| return backend._from_url(parsed, **kwargs)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/app/.venv/lib/python3.11/site-packages/ibis/backends/postgres/init.py", line 66, in _from_url
| "port": url.port,
| ^^^^^^^^
| File "/usr/local/lib/python3.11/urllib/parse.py", line 182, in port
| raise ValueError(f"Port could not be cast to integer value as {port!r}")
| ValueError: Port could not be cast to integer value as '('
+------------------------------------
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/.venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
result = await app( # type: ignore[func-returns-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/applications.py", line 113, in call
await self.middleware_stack(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
raise exc
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
await self.app(scope, receive, _send)
File "/app/.venv/lib/python3.11/site-packages/asgi_correlation_id/middleware.py", line 90, in call
await self.app(scope, receive, handle_outgoing_request)
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 155, in exit
self.gen.throw(typ, value, traceback)
File "/app/.venv/lib/python3.11/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
raise exc
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 187, in call
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/middleware/init.py", line 35, in dispatch
response = await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 163, in call_next
raise app_exc
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 149, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 185, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 155, in exit
self.gen.throw(typ, value, traceback)
File "/app/.venv/lib/python3.11/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
raise exc
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 187, in call
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/middleware/init.py", line 27, in dispatch
raise exc
File "/app/middleware/init.py", line 24, in dispatch
return await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 163, in call_next
raise app_exc
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/base.py", line 149, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/app/.venv/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
await self.middleware_stack(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
await route.handle(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
await self.app(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/app/.venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/app/.venv/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
response = await f(request)
^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
return await run_in_threadpool(dependant.call, **values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/starlette/concurrency.py", line 39, in run_in_threadpool
return await anyio.to_thread.run_sync(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2461, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 962, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/routers/v2/connector.py", line 71, in get_table_list
return MetadataFactory.get_metadata(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/model/metadata/factory.py", line 28, in get_metadata
return mappingdata_source
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/model/metadata/postgres.py", line 17, in init
self.connection = DataSource.postgres.get_connection(connection_info)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/model/data_source.py", line 45, in get_connection
return DataSourceExtension[self].get_connection(info)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/model/data_source.py", line 72, in get_connection
return ibis.connect(info.connection_url.get_secret_value())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/ibis/backends/init.py", line 1444, in connect
return backend._from_url(parsed, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.11/site-packages/ibis/backends/postgres/init.py", line 66, in _from_url
"port": url.port,
^^^^^^^^
File "/usr/local/lib/python3.11/urllib/parse.py", line 182, in port
raise ValueError(f"Port could not be cast to integer value as {port!r}")
ValueError: Port could not be cast to integer value as '('
UI logs
�[36m[2025-02-08T04:16:58.871] [DEBUG] ProjectService - �[39mCreating project...
�[36m[2025-02-08T04:16:58.878] [DEBUG] DataSourceResolver - �[39mProject created.
�[36m[2025-02-08T04:16:58.878] [DEBUG] DataSourceResolver - �[39mDashboard init...
�[36m[2025-02-08T04:16:58.881] [DEBUG] DataSourceResolver - �[39mDashboard created.
�[36m[2025-02-08T04:16:58.883] [DEBUG] IbisAdaptor - �[39mGetting tables from ibis
�[36m[2025-02-08T04:16:58.903] [DEBUG] IbisAdaptor - �[39mGot error when getting table: Port could not be cast to integer value as '('
�[91m[2025-02-08T04:16:58.904] [ERROR] DataSourceResolver - �[39mFailed to get project tables {
"message": "Port could not be cast to integer value as '('",
"extensions": {
"originalError": {
"message": "Request failed with status code 500",
"name": "AxiosError",
"stack": "AxiosError: Request failed with status code 500\n at settle (file:///app/node_modules/axios/lib/core/settle.js:19:12)\n at IncomingMessage.handleStreamEnd (file:///app/node_modules/axios/lib/adapters/http.js:599:11)\n at IncomingMessage.emit (node:events:529:35)\n at endReadableNT (node:internal/streams/readable:1400:12)\n at process.processTicksAndRejections (node:internal/process/task_queues:82:21)\n at Axios.request (file:///app/node_modules/axios/lib/core/Axios.js:45:41)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async r (/app/.next/server/chunks/980.js:1:3171)\n at async I.getTables (/app/.next/server/chunks/980.js:1:3493)\n at async n.listTables (/app/.next/server/chunks/980.js:8:15323)\n at async f.getProjectDataSourceTables (/app/.next/server/chunks/980.js:8:27008)\n at async y.saveDataSource (/app/.next/server/pages/api/graphql.js:1:82899)",
"config": {
"transitional": {
"silentJSONParsing": true,
"forcedJSONParsing": true,
"clarifyTimeoutError": false
},
"adapter": [
"xhr",
"http",
"fetch"
],
"transformRequest": [
null
],
"transformResponse": [
null
],
"timeout": 0,
"xsrfCookieName": "XSRF-TOKEN",
"xsrfHeaderName": "X-XSRF-TOKEN",
"maxContentLength": -1,
"maxBodyLength": -1,
"env": {},
"headers": {
"Accept": "application/json, text/plain, /",
"Content-Type": "application/json",
"User-Agent": "axios/1.7.4",
"Content-Length": "109",
"Accept-Encoding": "gzip, compress, deflate, br"
},
"method": "post",
"url": "http://ibis-server:8000/v2/connector/postgres/metadata/tables",
"data": "{"connectionInfo":{"connectionUrl":"postgresql://worker:(#[email protected]:5432/worker?"}}"
},
"code": "ERR_BAD_RESPONSE",
"status": 500
},
"code": "IBIS_SERVER_ERROR",
"message": "Port could not be cast to integer value as '('",
"shortMessage": "Data connection error"
}
}
�[91m[2025-02-08T04:16:58.908] [ERROR] APOLLO - �[39m== original error ==
�[91m[2025-02-08T04:16:58.908] [ERROR] APOLLO - �[39mAxiosError: Request failed with status code 500
at settle (file:///app/node_modules/axios/lib/core/settle.js:19:12)
at IncomingMessage.handleStreamEnd (file:///app/node_modules/axios/lib/adapters/http.js:599:11)
at IncomingMessage.emit (node:events:529:35)
at endReadableNT (node:internal/streams/readable:1400:12)
at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
at Axios.request (file:///app/node_modules/axios/lib/core/Axios.js:45:41)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async r (/app/.next/server/chunks/980.js:1:3171)
at async I.getTables (/app/.next/server/chunks/980.js:1:3493)
at async n.listTables (/app/.next/server/chunks/980.js:8:15323)
at async f.getProjectDataSourceTables (/app/.next/server/chunks/980.js:8:27008)
at async y.saveDataSource (/app/.next/server/pages/api/graphql.js:1:82899)
The text was updated successfully, but these errors were encountered: