Skip to content

Commit fd7f814

Browse files
authored
feat: Add GPUType field for TensorRT (#107)
1 parent 10ed03b commit fd7f814

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

pkg/model/types.go

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,10 @@ type Metadata struct {
1717
Tags []string `json:"tags,omitempty" yaml:"tags,omitempty"`
1818
Labels map[string]string `json:"labels,omitempty" yaml:"labels,omitempty"`
1919
Format string `json:"format,omitempty" yaml:"format,omitempty"`
20+
// GPUType is for TensorRT format only, it must be set when extract signature or serve
21+
// as a online service, otherwise, it can not extract or serve as a service.
22+
// for other model format, you can set empty string or not set.
23+
GPUType string `json:"gpuType,omitempty" yaml:"gpuType,omitempty"`
2024
Framework string `json:"framework,omitempty" yaml:"framework,omitempty"`
2125
Metrics []Metric `json:"metrics,omitempty" yaml:"metrics,omitempty"`
2226
Hyperparameters []Hyperparameter `json:"hyperparameters,omitempty" yaml:"hyperparameters,omitempty"`

0 commit comments

Comments
 (0)