Skip to content

Haystack Document API

AI Platform & Data Haystack 3.4.1 Hardened AMI

Haystack 3.4.1 and Hayhooks 2.1.0 on Ubuntu 24.04 store local text documents and return the exact source text for a question. Retrieval is BM25 and does not need a model. Optional answer generation uses an OpenAI-compatible chat model you configure after launch. There is no browser dashboard.

AMI release
0.1.0 (Haystack 3.4.1)
Recommended
t3.medium
Storage
20 GiB+ encrypted gp3
Access
Session Manager or SSH
Released
Oct 30, 2026
Delivery
Amazon Machine Image in your own AWS account

Haystack 3.4.1 and Hayhooks 2.1.0 with local SQLite document storage and BM25 retrieval returning exact source text.

Per-instance authentication and loopback REST API on port 1416, with customer setup and recovery instructions.

Keyless document walkthrough with independent readback; optional answer generation through a model you supply.

Quick start

Full guide →
  1. Subscribe
  2. Launch the instance
  3. Connect
  4. Open port 1416
  5. Generate an answer

What is on the image

This guide matches Marketplace package 0.1.0 (Haystack 3.4.1). Check the listing for the version currently on offer.

  • Haystack 3.4.1 and Hayhooks 2.1.0, plus a document REST adapter.
  • Authenticated JSON API on 127.0.0.1:1416.
  • SQLite documents in /var/lib/haystack/documents.sqlite3.
  • Client identity in /etc/haystack/client.json. Service settings are in /etc/haystack/config.json.
  • A walkthrough, /opt/sushi/docs/demo.sh, that stores two synthetic documents and checks an exact source.

The index is rebuilt from SQLite for each query. The package holds up to 1,000 documents, up to 16,384 characters each, and up to 100 documents per upload. A query returns up to three sources. Requests are limited to 2 MiB.

t3.medium (at least 4 GiB of memory) or a larger listed type, with an encrypted gp3 root volume of at least 20 GiB and IMDSv2. No GPU is required. The listed types are t3.medium, t3.large, t3.xlarge, and t3.2xlarge. Leave inbound application ports closed. Forward port 1416.

Scope and limits

This is a single instance. Deployment, undeployment, chat, tracing, and other upstream HTTP routes are not available. Install a pipeline change through the filesystem and restart the service. Generated answers can be wrong even when they cite a source. Read the returned sources. No deepset commercial platform, enterprise support, durable job runner, or Redis deployment is included.

Billing

The listing states USD 0.03 per running instance-hour. Confirm the offer, including its free trial, before you subscribe. EC2, EBS, data transfer, and model-provider usage are billed separately. The default demo does not call a model. demo.sh --generate does.

Where to go next

Upstream project

Haystack and Hayhooks are Apache-2.0. Other dependencies keep their own licenses. Wheels and sources are under /opt/haystack/wheels and /opt/haystack/sources. Notices are under /usr/share/doc/haystack. Software Sushi is independent of deepset. See the Haystack documentation and Hayhooks. The public getting-started page matches this package.

Last updated November 11, 2026 · Suggest an improvement