Skip to content

Commit a01686a

Browse files
committed
Update target URL
1 parent fa64c0e commit a01686a

File tree

2 files changed

+5
-1
lines changed

2 files changed

+5
-1
lines changed

evals/eval_config.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"testdata_path": "ground_truth.jsonl",
33
"results_dir": "results/experiment<TIMESTAMP>",
44
"requested_metrics": ["gpt_groundedness", "gpt_relevance", "answer_length", "latency", "citation_match"],
5-
"target_url": "http://host.docker.internal:8000/chat",
5+
"target_url": "http://127.0.0.1:8000/chat",
66
"target_parameters": {
77
"overrides": {
88
"use_advanced_flow": true,

evals/evaluate.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,10 @@ def get_openai_config() -> dict:
5050
load_dotenv(".env", override=True)
5151

5252
openai_config = get_openai_config()
53+
# TODO: specify the localhost URL using argument
54+
# TODO: specify the experiment name (based on PR number)
55+
# TODO: Specify the num questions using argument
56+
5357
run_evaluate_from_config(
5458
working_dir=Path(__file__).parent, config_path="eval_config.json", openai_config=openai_config, num_questions=2
5559
)

0 commit comments

Comments
 (0)