File tree Expand file tree Collapse file tree 1 file changed +13
-1
lines changed
Expand file tree Collapse file tree 1 file changed +13
-1
lines changed Original file line number Diff line number Diff line change @@ -206,7 +206,7 @@ complex execution modes and dynamic shapes. If not specified, all are enabled by
206206
207207 `ENABLE_TENSOR_FUSER`
208208
209- ### Important Note
209+ ### Important Notes
210210
211211* The execution of PyTorch model on GPU is asynchronous in nature. See
212212 [ here] ( https://pytorch.org/docs/stable/notes/cuda.html#asynchronous-execution )
@@ -223,3 +223,15 @@ a List of Strings as input(s) / produces a List of String as output(s). For thes
223223Triton allows users to pass String input(s)/receive String output(s) using the String
224224datatype. As a limitation of using List instead of Tensor for String I/O, only for
2252251-dimensional input(s)/output(s) are supported for I/O of String type.
226+
227+ #### PyTorch 2.0
228+
229+ Currently, the
230+ [ PyTorch Backend] ( https://github.com/triton-inference-server/pytorch_backend )
231+ relies on LibTorch/TorchScript (C++) which has been deprecated from
232+ [ PyTorch 2.0] ( https://pytorch.org/get-started/pytorch-2.0/ ) .
233+
234+ So, users interested in new features introduced in PyTorch 2.0 should try the
235+ [ Python Backend] ( https://github.com/triton-inference-server/python_backend )
236+ route instead.
237+
You can’t perform that action at this time.
0 commit comments