feat: track internally started models by ID

[mudler]

Description

This PR changes how we track models that are being loaded. Instead of refering to the model's file and path, we are going to track now the model ID. The model ID is also the name of each model that can be specified with a name - in this way we keep a 1:1 mapping and we fallback into using the model file name if a model name is not provided.

This allows for instance now to have the same backing model to be loaded with different parameters, and helps also into understanding which models are loaded as it now references what is returned when we list available models or models loaded in /system.

This pull request includes significant changes to the model loading and backend configuration processes in the codebase. The changes primarily focus on improving the flexibility and robustness of model handling by introducing a new modelID parameter and refactoring related functions.

Copilot summary

Model Loading Enhancements:

• Introduced modelID parameter in the Options struct and related functions to uniquely identify models. (pkg/model/options.go) [1] [2]
• Updated the LoadModel function to use modelID for loading and checking models. (pkg/model/loader.go) [1] [2] [3]

Backend Configuration Improvements:

• Refactored modelOpts to include default options and handle modelID. (core/backend/options.go)
• Modified various backend-related functions to remove redundant options and use the new modelID parameter. (core/backend/embeddings.go, core/backend/image.go, core/backend/llm.go) [1] [2] [3] [4]

GRPC Model Loading Adjustments:

• Updated the grpcModel function to accommodate the modelID parameter and ensure proper logging and error handling. (pkg/model/initializers.go) [1] [2] [3] [4] [5] [6] [7] [8]

Testing Updates:

• Adjusted unit tests to align with the new modelID parameter and updated test cases accordingly. (pkg/model/loader_test.go)
• Enhanced end-to-end tests to improve error handling and response validation. (tests/e2e-aio/e2e_test.go)

[netlify]

✅ Deploy Preview for localai ready!

Name	Link
🔨 Latest commit	c93a669
🔍 Latest deploy log	https://app.netlify.com/sites/localai/deploys/66fcce733b232b00082cf4e8
😎 Deploy Preview	https://deploy-preview-3693--localai.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[siddimore]

nice change @mudler