Haystack Document API
Haystack 3.4.1 and Hayhooks 2.1.0 on Ubuntu 24.04 store local text documents and return the exact source text for a question. Retrieval is BM25 and does not need a model. Optional answer generation uses an OpenAI-compatible chat model you configure after launch. There is no browser dashboard.
- AMI release
- 0.1.0 (Haystack 3.4.1)
- Recommended
- t3.medium
- Storage
- 20 GiB+ encrypted gp3
- Access
- Session Manager or SSH
- Released
- Oct 30, 2026
- Delivery
- Amazon Machine Image in your own AWS account
Haystack 3.4.1 and Hayhooks 2.1.0 with local SQLite document storage and BM25 retrieval returning exact source text.
Per-instance authentication and loopback REST API on port 1416, with customer setup and recovery instructions.
Keyless document walkthrough with independent readback; optional answer generation through a model you supply.
Quick start
Full guide →What is on the image¶
This guide matches Marketplace package 0.1.0 (Haystack 3.4.1). Check the listing for the version currently on offer.
- Haystack 3.4.1 and Hayhooks 2.1.0, plus a document REST adapter.
- Authenticated JSON API on
127.0.0.1:1416. - SQLite documents in
/var/lib/haystack/documents.sqlite3. - Client identity in
/etc/haystack/client.json. Service settings are in/etc/haystack/config.json. - A walkthrough,
/opt/sushi/docs/demo.sh, that stores two synthetic documents and checks an exact source.
The index is rebuilt from SQLite for each query. The package holds up to 1,000 documents, up to 16,384 characters each, and up to 100 documents per upload. A query returns up to three sources. Requests are limited to 2 MiB.
Recommended instance¶
t3.medium (at least 4 GiB of memory) or a larger listed type, with an
encrypted gp3 root volume of at least 20 GiB and IMDSv2. No GPU is required.
The listed types are t3.medium, t3.large, t3.xlarge, and t3.2xlarge.
Leave inbound application ports closed. Forward port 1416.
Scope and limits¶
This is a single instance. Deployment, undeployment, chat, tracing, and other upstream HTTP routes are not available. Install a pipeline change through the filesystem and restart the service. Generated answers can be wrong even when they cite a source. Read the returned sources. No deepset commercial platform, enterprise support, durable job runner, or Redis deployment is included.
Billing¶
The listing states USD 0.03 per running instance-hour. Confirm the offer,
including its free trial, before you subscribe. EC2, EBS, data transfer, and
model-provider usage are billed separately. The default demo does not call
a model. demo.sh --generate does.
Where to go next¶
- Getting started: launch, store a document, and query it.
- Configuration: the API and the optional provider.
- Operations: backups and support.
- Troubleshooting: 401, 409, 422, and 502.
Upstream project¶
Haystack and Hayhooks are Apache-2.0. Other dependencies keep their own
licenses. Wheels and sources are under /opt/haystack/wheels and
/opt/haystack/sources. Notices are under /usr/share/doc/haystack.
Software Sushi is independent of deepset. See the
Haystack documentation and
Hayhooks. The
public getting-started page
matches this package.
Last updated November 11, 2026 · Suggest an improvement