Skip to content

Conversation

@simon-cj
Copy link
Contributor

@simon-cj simon-cj commented Aug 21, 2020

What this PR does / why we need it:

Add your description
For trtserver, all model format must have directory structure as follow when serving:

--| models
     --| config.pbtxt
     --| 1
        --| xxx.pb

Which issue(s) this PR is related to (optional, link to 3rd issue(s)):

Fixes #

Reference to #

Special notes for your reviewer:

/cc @gaocegege

Release note:

NONE

@caicloud-bot caicloud-bot added release-note-none Denotes a PR that doesn't merit a release note. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Aug 21, 2020
// For TensorFlow serving, MUST move /mnt/models/model to /mnt/models/1 (dstDir).
ormbfileBytes, err := ioutil.ReadFile(path.Join(modelDir, "ormbfile.yaml"))
if err != nil {
if err := os.Rename(originalDir, path.Join(modelDir, "1")); err != nil {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we keep 1 in the model content layer?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it is OK. the directory structure will be as follow when ormb push:

--| models
    --| model
       --| 1
           --| xxx.pb
    --| ormbfile.yaml

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, in this way we do not need to have this trick. As you know, other formats such as onnx do not need 1 dir.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

comment are address, PTAL

@simon-cj simon-cj force-pushed the update-clever-to-klever branch from 96c7fcb to a4b25ad Compare August 23, 2020 06:49
@simon-cj simon-cj changed the title feat: Update re-layout logic for model serving feat: Update example model and remove relayout option Aug 23, 2020
@simon-cj simon-cj force-pushed the update-clever-to-klever branch from a4b25ad to 84dba0b Compare August 23, 2020 06:55
@simon-cj simon-cj force-pushed the update-clever-to-klever branch 2 times, most recently from 1e9a7d5 to 11e35f3 Compare August 23, 2020 07:32
Copy link
Member

@gaocegege gaocegege left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@caicloud-bot caicloud-bot added the lgtm Indicates that a PR is ready to be merged. label Aug 23, 2020
@caicloud-bot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: gaocegege

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@caicloud-bot caicloud-bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 23, 2020
@gaocegege
Copy link
Member

Please repush to trigger another build. I decrease the CI test coverage threshold.

@simon-cj simon-cj force-pushed the update-clever-to-klever branch from 11e35f3 to 33b44e7 Compare August 23, 2020 09:42
@caicloud-bot caicloud-bot removed the lgtm Indicates that a PR is ready to be merged. label Aug 23, 2020
@caicloud-bot
Copy link

New changes are detected. LGTM label has been removed.

@simon-cj simon-cj merged commit f657c35 into kleveross:master Aug 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. release-note-none Denotes a PR that doesn't merit a release note. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants