Quantitative testing of models on HF #6
Description
@ngxson suggested to do a larger sweep of compatibility tests on this llama.cpp PR (cc/ @Vaibhavs10 & @Rocketknight1)
To start with, I've added the models listed in https://aiworld.eu/embed/model/model/treemap (top liked / downloaded) to the tested MODEL_IDS.
Known failures:
- fireworks-ai/llama-3-firefunction-v2 -> Support fireworks-ai/llama-3-firefunction-v2 #7
- ai21labs/AI21-Jamba-1.5-Large -> Support ai21labs/AI21-Jamba-1.5-Large (* expansion operator) #8
Some others are playing hard to get (where are the templates for ai21labs/Jamba-v0.1, apple/OpenELM-1_1B-Instruct , dreamgen/WizardLM-2-7B, xai-org/grok-1?), but otherwise so far so good :-)