Skip to content

Commit 82f680b

Browse files
Removed instruction fallback to a string (#61)
* In evaluate, removed empty 'instructions' fallback and added code to ensure task_definition is validated * Removed task_definition validation in the decorator. It should be handled in the sdk-backend.
1 parent 762d945 commit 82f680b

File tree

2 files changed

+7
-3
lines changed

2 files changed

+7
-3
lines changed

.gitignore

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,3 +31,9 @@ pip-log.txt
3131
.metaflow
3232
.metaflow/
3333
.ipynb_checkpoints
34+
35+
## Local testing
36+
venv
37+
tests/test_local_eval.py
38+
tests/fixed_test_eval.csv
39+
tests/test_evaluation_dataset_may_2025.csv

aimon/decorators/evaluate.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -284,9 +284,7 @@ def evaluate(
284284
"evaluation_id": am_eval.id,
285285
"evaluation_run_id": eval_run.id,
286286
}
287-
if "instructions" in payload and not payload["instructions"]:
288-
payload["instructions"] = ""
289-
287+
290288
results.append(EvaluateResponse(record['output'], client.analyze.create(body=[payload])))
291289

292290
return results

0 commit comments

Comments
 (0)