Skip to main content

MinIO

Overview

MinIO uploads log batches to a MinIO (S3-compatible) bucket.

Supported types: Logs · Metrics · Traces

Authentication Configuration

MinIO supports MinIO credentials.

ParameterTypeRequiredDescription
credential_typeoptiontrueminio: MinIO Username and Password.
access_key_idstringtrueMinIO username.
secret_access_keystringtrueMinIO password.

Note: The Credential Type field is required if not using default credentials.

Configuration

ParameterTypeDefault ValueRequiredDescription
endpointstringnoneYesMinIO endpoint URL (e.g., https://minio.example.com).
regionstringnoneYesRegion for the MinIO deployment.
s3_bucketstringnoneYesThe name of the MinIO bucket to upload to.
s3_prefixstring/logsYesThe key prefix for uploaded objects.
s3_partition_formatstring%Y/%m/%d/%H/%MNoPartition format for uploaded objects.
file_prefixstringnoneNoOptional file prefix to prepend to object keys.
s3_force_path_stylebooleantrueNoForces path-style addressing where the bucket name appears in the request path instead of the hostname.
timeoutstring5sNoTimeout for upload operations.

Sending Queue Settings

ParameterTypeDefault ValueDescription
queue_sizeint641000Maximum number of log entries to hold in the queue.
num_consumersint10Number of parallel workers processing logs from the queue.
enable_disk_backed_queuebooltrueSaves the queue to disk so data can survive restarts.

Note: Sending Queue fields available if enabled.

Example Configuration

{
"s3uploader": {
"endpoint": "https://minio.example.com", // required
"region": "us-east-1", // required
"s3_bucket": "my-output-bucket", // required
"s3_prefix": "/logs", // required
"s3_partition_format": "%Y/%m/%d/%H/%M",
"file_prefix": "app-logs-",
"s3_force_path_style": true,
},

"timeout": "30s",

"sending_queue": {
// conditional
"queue_size": 5000,
"num_consumers": 10,
"enable_disk_backed_queue": true,
},
}