Skip to content

Deploying KServe

This section provides steps for installing and deploying KServe, including enabling the NAT module, creating pull image secrets, following a defined deployment order and installing services using Helm commands.

  1. Enable the iptable NAT module on each node by running the following command:

    modprobe iptable_nat
    
  2. Create a pull image secret in the specified namespaces:

    1. Namespace: knative-serving
    2. Namespace: mdsp-bk-kserve
    3. Namespace: istio-system

      kubectl create secret docker-registry mdsp-registry-secret --docker-server=xiotlpccertcr.azurecr.io --docker-username=xiotlpccertcr --docker-password=JeBd0hJq60vv8Mu2HkQz6zCzPnVMN7Ag8d5egz52Ys+ACRBFheo9 --docker-email=test@aliyun.com
      
  3. Follow the deployment order to install services and components in the correct sequence across their respective namespaces.

    Sl no Service Namespace
    1 cert-manager cert-manager
    2 istio istio-system
    3 knative-serving-crd
    4 knative-serving knative-serving
    5 kserve-crd
    6 kserve mdsp-bk-kserve
  4. Navigate to the kServe directory and install the services using Helm.

    cd kserve
    
    helm -n cert-manager install cert-manager  cert-manager
    
    helm -n istio-system install istio istio
    
    helm -n knative-serving install knative-serving-crd knative-serving/knative-serving-crd
    
    helm -n knative-serving install knative-serving knative-serving/knative-serving
    
    helm -n mdsp-bk-kserve install kserve-crd kserve/kserve-crd
    
    helm -n mdsp-bk-kserve install kserve kserve/kserve
    

Reference


Last update: January 31, 2025