MinIO
Overview
MinIO uploads log batches to a MinIO (S3-compatible) bucket.
Supported types: Logs · Metrics · Traces
Authentication Configuration
MinIO supports MinIO credentials.
| Parameter | Type | Required | Description |
|---|---|---|---|
| credential_type | option | true | minio: MinIO Username and Password. |
| access_key_id | string | true | MinIO username. |
| secret_access_key | string | true | MinIO password. |
Note: The Credential Type field is required if not using default credentials.
Configuration
| Parameter | Type | Default Value | Required | Description |
|---|---|---|---|---|
| endpoint | string | none | Yes | MinIO endpoint URL (e.g., https://minio.example.com). |
| region | string | none | Yes | Region for the MinIO deployment. |
| s3_bucket | string | none | Yes | The name of the MinIO bucket to upload to. |
| s3_prefix | string | /logs | Yes | The key prefix for uploaded objects. |
| s3_partition_format | string | %Y/%m/%d/%H/%M | No | Partition format for uploaded objects. |
| file_prefix | string | none | No | Optional file prefix to prepend to object keys. |
| s3_force_path_style | boolean | true | No | Forces path-style addressing where the bucket name appears in the request path instead of the hostname. |
| timeout | string | 5s | No | Timeout for upload operations. |
Sending Queue Settings
| Parameter | Type | Default Value | Description |
|---|---|---|---|
| queue_size | int64 | 1000 | Maximum number of log entries to hold in the queue. |
| num_consumers | int | 10 | Number of parallel workers processing logs from the queue. |
| enable_disk_backed_queue | bool | true | Saves the queue to disk so data can survive restarts. |
Note: Sending Queue fields available if enabled.
Example Configuration
{
"s3uploader": {
"endpoint": "https://minio.example.com", // required
"region": "us-east-1", // required
"s3_bucket": "my-output-bucket", // required
"s3_prefix": "/logs", // required
"s3_partition_format": "%Y/%m/%d/%H/%M",
"file_prefix": "app-logs-",
"s3_force_path_style": true,
},
"timeout": "30s",
"sending_queue": {
// conditional
"queue_size": 5000,
"num_consumers": 10,
"enable_disk_backed_queue": true,
},
}