Skip to content

Vector Log Pipeline

Vector 0.58.0 on Ubuntu 24.04 LTS, set up as a local log pipeline on your own EC2 instance. It takes JSON logs over HTTPS or from files, removes common secrets with a VRL program, buffers them on disk and writes them to a local file, ready for you to add your own sinks such as Amazon S3. Everything listens on loopback only.

Launch on AWS Marketplace Getting started

What is included

  • Vector 0.58.0, the official linux/amd64 build, at /opt/vector/bin/vector (also on the path as vector).
  • HTTPS JSON ingest on 127.0.0.1:8687, protected by HTTP basic authentication with a password created on first boot.
  • File ingest of JSON lines from /var/lib/vector/in/*.log.
  • A VRL redaction step that drops debug records and replaces password, token and email values with REDACTED.
  • A bounded disk buffer in front of a local file destination in /var/lib/vector/out/.
  • Health API and Prometheus metrics on loopback.
  • An example S3 sink and IAM policy, not enabled.
  • A built-in walkthrough at /opt/sushi/docs/demo.sh.

The image contains no certificate, password, AWS keys or live configuration; first boot creates them.

Ports

Port Protocol Listens on Purpose
8687 HTTPS 127.0.0.1 JSON ingest at /ingest, basic authentication
8686 HTTP 127.0.0.1 Vector API, including /health
9598 HTTP 127.0.0.1 Prometheus metrics at /metrics

No inbound security group rule is needed.

Billing

The software is billed per running instance-hour on t3.medium, as set out in the AWS Marketplace offer terms. Check the listing for the current price and any free trial. AWS bills EC2, EBS and data transfer separately.

Where to go next

Upstream project

Vector is developed by Datadog and published under the MPL-2.0 license. Software Sushi packages it independently; this offer does not include Vector project support. See the Vector documentation for the full reference.