Delay in sending logs to Logstash

[azhavoro]

My actions before raising this issue

• Read/searched the docs
• Searched past issues

It looks like in case of a lot of log events (about about 1 million per day), python-logstash-async doesn't process them in time and keeps them in the queue. This leads events being pushed to logstash with a long delay(several hours in our case).

Expected Behaviour

Current Behaviour

Possible Solution

Adjust python-logstash-async settings

Your Environment

• Git hash commit (git log -1): 59c3b28
• Docker version docker version (e.g. Docker 17.0.05):
• Are you using Docker Swarm or Kubernetes?
• Operating System and version (e.g. Linux, Windows, MacOS):
• Code example or link to GitHub repo or gist to reproduce problem:
• Other diagnostic information / logs:
  Logs from `cvat` container

Next steps

You may join our Gitter channel for community support.

[abidahmadq]

I can start working on this if someone can point me towards a direction. I am new contributor.

[chaoyifei]

In general, each data may be delayed

[chaoyifei]

I can start working on this if someone can point me towards a direction. I am new contributor.
Hi,did you fix this problem? @abidahmadq