How to Rotate Log Files in Fluentd?

Fluentd offers the capability to set up log rotation, particularly useful when managing large volumes of logs that consume significant disk space. This feature can be configured through Fluentd's system-wide settings.

Here is an example of a log rotation configuration in Fluentd that can rotate logs daily:

<system>
  <log>
    rotate_age 7
    rotate_size 1048576
  </log>
</system>

The configuration options are as follows:

• rotate_age: This parameter specifies the maximum age of log files in days before they are rotated. In this example, logs older than seven days will be rotated.

• rotate_size: This option defines the maximum file size in bytes for a log file before it gets rotated. Here, the file size threshold for rotation is set at 1MB.

Additionally, the rotate_age option can accept string values for more dynamic scheduling:

<system>
  <log>
    rotate_age weekly
    rotate_size 1048576
  </log>
</system>

Setting rotate_age to "weekly" means that the files will be rotated every week.

These settings are not limited to configuration files. You can also pass them as command-line arguments:

fluentd -c fluent.conf --log-rotate-age 7 --log-rotate-size 104857600

Got an article suggestion? Let us know

Explore more

How to Use Conditional Statements In Fluentd

Questions

How to Add Tags to My Fluentd Events

Questions

How to Send Logs to Multiple Outputs With Same Match Tags in Fluentd?

Questions

How to Use Environmental Variables in Fluentd Config

Questions

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.