Village Pump (technical) - Job Queue

Job Queue

The job queue for enwiki has been over 1,000,000 for most of the past week, having risen rapidly around 3 weeks ago:

  • API jobs="1085212"
  • Ganglia queue graphs
  • Gdash I/O graphs
  • Ganglia I/O graphs
  • Ganglia jobrunners graphs

Until November, typical values (allowing for brief spikes) were usually well under 100,000. Unfortunately, the more useful measure of job queue durations does not seem to be recorded (Bugzilla:9518).

This was recently discussed under Bugzilla:42614 in relation to recent code changes, but that bug has since been marked resolved.

Does Wikipedia:Don't worry about performance mean that this should not concern us, or does something need fixing?

— Richardguk (talk) 12:07, 16 December 2012 (UTC)

This edit and two days later this one didn't exactly do wonders for the job queue. We know that it's still being processed because Category:Pages with malformed coordinate tags is still being populated. --Redrose64 (talk) 16:33, 16 December 2012 (UTC)
The queue seems to have risen further over the past 10 hours, to a recent peak of around 1,200,000. — Richardguk (talk) 17:42, 16 December 2012 (UTC)

Something should be done, I've been waiting for an update to whatlinkshere from a navbox update for 23 hours now, this is a measurable problem now... --Joy (talk) 19:25, 17 December 2012 (UTC)

The job queue is now over two million. I'd say there's a major bug somewhere. jcgoble3 (talk) 20:56, 17 December 2012 (UTC)
And now it's skyrocketed to over 5.5 million. Can somebody please file a bug on Bugzilla? I don't have an account there and am not interested in creating yet another account that I'll rarely use. jcgoble3 (talk) 05:49, 18 December 2012 (UTC)
It's been discussed on the #wikimedia-tech IRC channel - those two big spikes are supposed to be the end of it, and things should be getting back to normal. --Joy (talk) 09:26, 18 December 2012 (UTC)

Read more about this topic:  Village Pump (technical)

Famous quotes containing the words job and/or queue:

    Do we honestly believe that hopeless kids growing up under the harsh new rules will turn out to be chaste, studious, responsible adults? On the contrary, by limiting welfare, job training, education and nutritious food, won’t we plant the seeds for another bumper crop of out-of-wedlock moms, deadbeat dads and worse?
    Richard B. Stolley (20th century)

    English people apparently queue up as a sort of hobby. A family man might pass a mild autumn evening by taking the wife and kids to stand in the cinema queue for a while and then leading them over for a few minutes in the sweetshop queue and then, as a special treat for the kids, saying “Perhaps we’ve time to have a look at the Number Thirty-One bus queue before we turn in.”
    Calvin Trillin (b. 1940)