Skip to content

Troubleshooting

The incorrect answer is marked successful

Cause: the report is not the supplied returns-policy example, or the saved JSON was edited.

Fix: run sushi-deepeval read on the complete path from this run. The reader checks the actual answer text, the thresholds, and the success flags for this example only. Preserve the original report.

Judge configuration refuses to start

Cause: ~/.config/deepeval/judge.json already exists.

Fix: edit that file. The keys are base_url, model, and api_key. Keep mode 0600. Do not rerun configure expecting it to replace the file.

A judge request fails

Cause: the base URL, model id, JSON-object support, key, outbound access, or file ownership is wrong. A remote provider must be HTTPS and the base URL must include /v1. This example does not call the Bedrock API.

Fix: correct the file and rerun bash /opt/sushi/docs/demo.sh --judge. No accepted report is written for the failed request. A failed request does not block the next run. Do not delete /var/lib/deepeval.

You expected a web page

Cause: this image has no web UI and no listening API.

Fix: use the CLI on the instance over Session Manager or SSH. There is no port to forward.

Last updated November 11, 2026 · Suggest an improvement