Troubleshooting¶
Checks for the Promptfoo outcomes the listing treats as normal, and for the ones it treats as failures.
The walkthrough exits 100¶
Cause: the second suite fails all four assertions on purpose. Exit 100 is Promptfoo's result for that suite. The demo expects it.
Fix: if the command then continues and writes both result directories, the exit 100 is the evaluation result. An installer error or a provider error fails the command on its own, before that check. Read the command output on the instance and fix the reported cause. Do not rerun with a deleted database just to clear exit 100.
A later demo refuses to start¶
Cause: the demo requires the earlier evaluation IDs and the unchanged
JSON under ~/promptfoo-results/ before it creates a new result.
Fix: restore the missing evaluation-* directory, or leave the previous
output in place. First boot does not delete existing state. Deleting results
to "reset" the demo removes the history the next run checks.
The viewer is reachable from another host¶
Cause: promptfoo view has no --host flag and listens on network
interfaces. Started outside the bounded unit, it is not limited to
localhost.
Fix: stop it, and start only the unit in
Optional viewer. Keep inbound ports
closed. Forward port 15500 with Session Manager, and open
http://127.0.0.1:15500 on your workstation. There is no viewer password.
--bedrock fails¶
Cause: the account cannot use amazon.nova-lite-v1:0 in us-east-1, or
the instance role lacks bedrock:InvokeModel for that model. The command
makes eight real requests.
Fix: enable the model and add the permission, then rerun
/opt/sushi/bin/promptfoo-run-suite --bedrock. The model-free
/opt/sushi/docs/demo.sh does not need Bedrock.
A provider key was passed as a command argument¶
Cause: the credential was placed on the command line. The published guide
says to keep it in a file readable only by ubuntu.
Fix: stop that command. Store the credential in a file readable only by
ubuntu, and pass promptfoo eval the config path.
Last updated October 27, 2026 · Suggest an improvement