what is the default prompt used in the online demo?

[sszzsupersupersupersuper]

I found the demo really cool and wanted to set up one on my own device, but was confused what prompt I should use to have the peformance as shown in the demo https://chat.lmsys.org/. because the default prrompt in Conversation Class works not as good as expected.

Could you share some knowledge about prompt?

[merrymercy]

We use the same default prompt

FastChat/fastchat/conversation.py

Lines 109 to 138 in ecb5f2b

	conv_v1_2 = Conversation(
	system="A chat between a curious human and an artificial intelligence assistant. "
	"The assistant gives helpful, detailed, and polite answers to the human's questions.",
	roles=("Human", "Assistant"),
	messages=(
	("Human", "What are the key differences between renewable and non-renewable energy sources?"),
	("Assistant",
	"Renewable energy sources are those that can be replenished naturally in a relatively "
	"short amount of time, such as solar, wind, hydro, geothermal, and biomass. "
	"Non-renewable energy sources, on the other hand, are finite and will eventually be "
	"depleted, such as coal, oil, and natural gas. Here are some key differences between "
	"renewable and non-renewable energy sources:\n"
	"1. Availability: Renewable energy sources are virtually inexhaustible, while non-renewable "
	"energy sources are finite and will eventually run out.\n"
	"2. Environmental impact: Renewable energy sources have a much lower environmental impact "
	"than non-renewable sources, which can lead to air and water pollution, greenhouse gas emissions, "
	"and other negative effects.\n"
	"3. Cost: Renewable energy sources can be more expensive to initially set up, but they typically "
	"have lower operational costs than non-renewable sources.\n"
	"4. Reliability: Renewable energy sources are often more reliable and can be used in more remote "
	"locations than non-renewable sources.\n"
	"5. Flexibility: Renewable energy sources are often more flexible and can be adapted to different "
	"situations and needs, while non-renewable sources are more rigid and inflexible.\n"
	"6. Sustainability: Renewable energy sources are more sustainable over the long term, while "
	"non-renewable sources are not, and their depletion can lead to economic and social instability.\n")
	),
	offset=2,
	sep_style=SeparatorStyle.SINGLE,
	sep="###",
	)

If you use our delta weights and code, you should be able to get the identity output. You can check this by setting temperature to 0

[merrymercy]

Hi @lazyfuzzypringle , we have released a new version of weights (https://github.com/lm-sys/FastChat/blob/main/docs/weights_version.md).
It simplifies a lot of tokenization/prompt settings. Could you try it again?