How to solve the issue of Kafka log data not being cleaned up effectively?

If Kafka’s cleanup of log data is not effective, you can try the following solutions:

1. policy for cleaning up logs
2. hours to retain logs
3. Check the timestamps of the log segment files: Kafka uses the timestamps of log segment files to determine if they need to be cleaned up. Make sure the timestamps of the log segment files are correct and will not be retained.
4. Check disk space: When Kafka cleans up log data, it requires sufficient disk space to store the cleaned data. Make sure there is enough disk space available, and delete unnecessary files to free up disk space.
5. The command kafka-topics.sh
6. the shell script kafka-log-dirs.sh
7. The delay time for the log cleaner to back off
8. The number of threads used by the log cleaner.

If the above methods still cannot solve the problem, you can try restarting the Kafka node or check the Kafka log files for more error information to troubleshoot the root cause of the issue.