Replies: 3 comments 1 reply
-
|
Question: This topic should be in General or Q&A category? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
General is fine :) Actually, this very interesting to me - I'd love to hear more about how you are testing LLMs with Locust. Can we have a quick chat about it? |
Beta Was this translation helpful? Give feedback.
-
|
I created a ticket based on this here: #3076 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Sure, let's talk @cyberw ! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi guys,
I am implementing a benchmark on a vLLM target. It has an OpenAI
chat/completionslike interface.When I send my request I can see the number of tokens generated in the response.
What I want is to create a new stats that take this value and add as a new stats in my result csvs.
I checked the stats topic in the docs but could not find anything about create new custom stats.
Is there a way to do it?
Beta Was this translation helpful? Give feedback.
All reactions