Village Pump (technical) - Job Queue

Job Queue

The job queue for enwiki has been over 1,000,000 for most of the past week, having risen rapidly around 3 weeks ago:

  • API jobs="1085212"
  • Ganglia queue graphs
  • Gdash I/O graphs
  • Ganglia I/O graphs
  • Ganglia jobrunners graphs

Until November, typical values (allowing for brief spikes) were usually well under 100,000. Unfortunately, the more useful measure of job queue durations does not seem to be recorded (Bugzilla:9518).

This was recently discussed under Bugzilla:42614 in relation to recent code changes, but that bug has since been marked resolved.

Does Wikipedia:Don't worry about performance mean that this should not concern us, or does something need fixing?

— Richardguk (talk) 12:07, 16 December 2012 (UTC)

This edit and two days later this one didn't exactly do wonders for the job queue. We know that it's still being processed because Category:Pages with malformed coordinate tags is still being populated. --Redrose64 (talk) 16:33, 16 December 2012 (UTC)
The queue seems to have risen further over the past 10 hours, to a recent peak of around 1,200,000. — Richardguk (talk) 17:42, 16 December 2012 (UTC)

Something should be done, I've been waiting for an update to whatlinkshere from a navbox update for 23 hours now, this is a measurable problem now... --Joy (talk) 19:25, 17 December 2012 (UTC)

The job queue is now over two million. I'd say there's a major bug somewhere. jcgoble3 (talk) 20:56, 17 December 2012 (UTC)
And now it's skyrocketed to over 5.5 million. Can somebody please file a bug on Bugzilla? I don't have an account there and am not interested in creating yet another account that I'll rarely use. jcgoble3 (talk) 05:49, 18 December 2012 (UTC)
It's been discussed on the #wikimedia-tech IRC channel - those two big spikes are supposed to be the end of it, and things should be getting back to normal. --Joy (talk) 09:26, 18 December 2012 (UTC)

Read more about this topic:  Village Pump (technical)

Famous quotes containing the words job and/or queue:

    We have not the motive to prepare ourselves for a “life-work” of teaching, of social work—we know that we would lay it down with hallelujah in the height of our success, to make a home for the right man. And all the time in the background of our consciousness rings the warning that perhaps the right man will never come. A great love is given to very few. Perhaps this make-shift time filler of a job is our life work after all.
    Ruth Benedict (1887–1948)

    English people apparently queue up as a sort of hobby. A family man might pass a mild autumn evening by taking the wife and kids to stand in the cinema queue for a while and then leading them over for a few minutes in the sweetshop queue and then, as a special treat for the kids, saying “Perhaps we’ve time to have a look at the Number Thirty-One bus queue before we turn in.”
    Calvin Trillin (b. 1940)