Skip to content

Issue with the LLM server while testing the API calls #74

New issue
New issue
Open
Open
Issue with the LLM server while testing the API calls#74
@saharshayegan

Description

@saharshayegan
saharshayegan
opened on Jul 10, 2025

Hi,

I am trying to test out the API calls for the claim analysis and I am facing this error. Could you please help me with it?

The endpoint is:
/v1/analysis/claim/{claim_id}/stream

And the error is:


misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | ERROR:    Exception in ASGI application
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
misinformation_mitigation_api  |     result = await app(  # type: ignore[func-returns-value]
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
misinformation_mitigation_api  |     return await self.app(scope, receive, send)
misinformation_mitigation_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
misinformation_mitigation_api  |     await super().__call__(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/applications.py", line 113, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, _send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 715, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 735, in app
misinformation_mitigation_api  |     await route.handle(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
misinformation_mitigation_api  |     response = await f(request)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 291, in app
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 605, in solve_dependencies
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 628, in solve_dependencies
misinformation_mitigation_api  |     solved = await call(**solved_result.values)
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | INFO | app.core.llm.vertex_ai_llama | Loading service account from: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | ERROR | app.core.llm.vertex_ai_llama | Failed to initialize Vertex AI Llama provider: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | ERROR | app.api.dependencies | Failed to initialize LLM provider: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | ERROR:    Exception in ASGI application
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
misinformation_mitigation_api  |     result = await app(  # type: ignore[func-returns-value]
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
misinformation_mitigation_api  |     return await self.app(scope, receive, send)
misinformation_mitigation_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
misinformation_mitigation_api  |     await super().__call__(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/applications.py", line 113, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, _send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 715, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 735, in app
misinformation_mitigation_api  |     await route.handle(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
misinformation_mitigation_api  |     response = await f(request)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 291, in app
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 605, in solve_dependencies
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 628, in solve_dependencies
misinformation_mitigation_api  |     solved = await call(**solved_result.values)
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions