-
Notifications
You must be signed in to change notification settings - Fork 287
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Feature request description
lets say we have a model store with models A,B,C,D
Ramalama serve no argument will create a serve container that mounts all the models with the proxy able do the model swap
Ramalama serve A,B will create a serve container that only mounts A and B still able to model swap
Ramalama serve A will create a serve container with no proxy not able to swap (for security reasons)
Suggest potential solution
@engelmi has did some amazing work creating the ton of the groundwork for this so it just needs to be implemented now
Have you considered any alternatives?
No response
Additional context
No response
federicofortini
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request