Skip to content

Commit

Permalink
Deployed ea547ac to master with MkDocs 1.5.3 and mike 2.0.0
Browse files Browse the repository at this point in the history
  • Loading branch information
github-actions[bot] committed Feb 17, 2024
1 parent 9b00cb6 commit 7a89d88
Show file tree
Hide file tree
Showing 7 changed files with 174 additions and 172 deletions.
4 changes: 3 additions & 1 deletion master/modelserving/storage/pvc/pvc/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1243,13 +1243,15 @@ <h3 id="copy-model-to-pv">Copy model to PV<a class="headerlink" href="#copy-mode

kubectl<span class="w"> </span><span class="nb">exec</span><span class="w"> </span>-it<span class="w"> </span>model-store-pod<span class="w"> </span>--<span class="w"> </span>bash
</code></pre></div>
<p>In different terminal, copy the model from local into PV.</p>
<p>In different terminal, copy the model from local into PV, then delete <code>model-store-pod</code>.</p>
<div class="tabbed-set tabbed-alternate" data-tabs="5:1"><input checked="checked" id="__tabbed_5_1" name="__tabbed_5" type="radio"><div class="tabbed-labels"><label for="__tabbed_5_1">kubectl</label></div>
<div class="tabbed-content">
<div class="tabbed-block"></div>
</div>
</input></div>
<div class="highlight"><pre><span></span><code>kubectl<span class="w"> </span>cp<span class="w"> </span>model.joblib<span class="w"> </span>model-store-pod:/pv/model.joblib<span class="w"> </span>-c<span class="w"> </span>model-store

kubectl<span class="w"> </span>delete<span class="w"> </span>pod<span class="w"> </span>model-store-pod
</code></pre></div>
<h2 id="deploy-inferenceservice-with-models-on-pvc">Deploy <code>InferenceService</code> with models on PVC<a class="headerlink" href="#deploy-inferenceservice-with-models-on-pvc" title="Permanent link"></a></h2>
<p>Update the ${PVC_NAME} to the created PVC name and create the InferenceService with the PVC <code>storageUri</code>.</p>
Expand Down
2 changes: 1 addition & 1 deletion master/modelserving/v1beta1/llm/vllm/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1141,7 +1141,7 @@ <h2 id="deploy-the-llama-model-with-vllm-runtime">Deploy the LLaMA model with vL
<span class="w"> </span><span class="p p-Indicator">-</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">vllm.entrypoints.api_server</span>
<span class="w"> </span><span class="nt">env</span><span class="p">:</span>
<span class="w"> </span><span class="p p-Indicator">-</span><span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">STORAGE_URI</span>
<span class="w"> </span><span class="nt">value</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">gcs://kfserving-examples/llm/huggingface/llama</span>
<span class="w"> </span><span class="nt">value</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">gs://kfserving-examples/llm/huggingface/llama</span>
<span class="w"> </span><span class="nt">image</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">kserve/vllmserver:latest</span>
<span class="w"> </span><span class="nt">name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">kserve-container</span>
<span class="w"> </span><span class="nt">resources</span><span class="p">:</span>
Expand Down
2 changes: 1 addition & 1 deletion master/reference/swagger-ui/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -1452,7 +1452,7 @@ <h1>
</a>
<h1 id="open-inference-protocol-api-specification">Open Inference Protocol API Specification<a class="headerlink" href="#open-inference-protocol-api-specification" title="Permanent link"></a></h1>
<h2 id="rest">REST<a class="headerlink" href="#rest" title="Permanent link"></a></h2>
<p><iframe class="swagger-ui-iframe" frameborder="0" id="4820b8a6" src="swagger-4820b8a6.html" style="overflow:hidden;width:100%;" width="100%"></iframe></p>
<p><iframe class="swagger-ui-iframe" frameborder="0" id="57542b7e" src="swagger-57542b7e.html" style="overflow:hidden;width:100%;" width="100%"></iframe></p>
<h2 id="grpc">GRPC<a class="headerlink" href="#grpc" title="Permanent link"></a></h2>
<h3 id="serverlive">ServerLive<a class="headerlink" href="#serverlive" title="Permanent link"></a></h3>
<p>The ServerLive API indicates if the inference server is able to receive
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@
}

const resize_ob = new ResizeObserver(function(entries) {
parent.update_swagger_ui_iframe_height("4820b8a6");
parent.update_swagger_ui_iframe_height("57542b7e");
});

// start observing for resizing
Expand Down
2 changes: 1 addition & 1 deletion master/search/search_index.json

Large diffs are not rendered by default.

Loading

0 comments on commit 7a89d88

Please sign in to comment.