Kserve Adapter

Kserve Adapter

Context Diagram

  • O-Cloud : To deploy/undeploy kserve inference service, RICDMS requests to deploy/undeploy to Kserve Adapter.

  • RIC : Kserve Adapter requests onboarding of inference service to xapp-onboarder before deploy inference service.

  • SMO : Kserve Adapter monitors and manages kserve inference service. Kserve Adapter will deliver monitoring information to SMO, and SMO can retrieve inference.

Class Diagram

 

Sequence Diagram

 

  • RICDMS manages deployment of inference service

    • needs to implement pluggable architecture to handle deployment of inference service 

    • if RICDMS has a separate chartmusem, no modification is required on the xapp-onboarder side.

  • kserve-adapter packages helm chart of inference service