Slow Dequeueing Process

[kfogle]

We're experiencing extremely slow dequeuing of one of our sites. The following snippet from verbose logging shows that it takes almost 3 minutes to lookup visitor. This worked well for a few weeks, but has slowly declined over time.

[2020-08-31 16:01:01] piwik.DEBUG: Executing Piwik\Plugins\CoreHome\Tracker\VisitRequestProcessor::processRequestParams()... [] {"class":"QueuedTracking","request_id":31138}

[2020-08-31 16:01:01] piwik.DEBUG: token_auth is authenticated in cache! [] {"class":"CoreHome","request_id":31138}

[2020-08-31 16:01:01] piwik.DEBUG: DoNotTrack support is not enabled, skip check [] {"class":"PrivacyManager","request_id":31138}

[2020-08-31 16:01:01] piwik.DEBUG: Matching visitors with: visitorId=2f89489d694097e4 OR configId=1522d51efd5641cb [] {"class":"CoreHome","request_id":31138}

[2020-08-31 16:02:50] piwik.DEBUG: The visitor was not matched with an existing visitor... [] {"class":"CoreHome","request_id":31138}

[tsteur]

Hi @kfogle are you using Redis or MySQL database for storing the queue data? Generally this sounds unrelated to the queue though. Where there maybe any indexes removed on the <prefix>log_visit table? Or is there maybe generally a big load on the database?

[StevieKay90]

@kfogle this seems a little similar to the issue I am having with a slow dequeueing process - did you remedy this?
Which matomo version were you using?

[keller31]

Please try to close the Provider plug-in.
Provider will seriously block the processing progress of the queue.