Add Gemma 2 9B and 27B

[carterprince]

I'm not sure the "correct" place to request a new model, so I'm just gonna make an issue here.

Hugging Face links:

• https://huggingface.co/google/gemma-2-9b-it
• https://huggingface.co/google/gemma-2-27b-it

They're also available on Vertex as gemma-2-9b-it and gemma-2-27b-it.

[wenhuchen]

Thanks for the reminder! We will work on it.

[Wyyyb]

The results of the gemma-2-9b and gemma-2-9b-it models have been updated on the leaderboard (https://huggingface.co/spaces/TIGER-Lab/MMLU-Pro). However, due to issues with the 27b vllm support (see vllm-project/vllm#5908), we will update the corresponding results once this issue is resolved.

[Kyeongpil]

@Wyyyb Hello, Is there any updates?

[Wyyyb]

The 9b models have been added, but it seems that the issues with support for the 27b models in vllm have not been resolved, vllm-project/vllm#6387