9201-9250 of 10000 results (37ms)
2014-07-28 §
23:21 <AaronS> Updated /srv/jobrunner to 0bb0ad62dd9240e0f67b2ded4519f125de13dfbc [production]
23:12 <mutante> temp. disabled puppet on neon and ircecho [production]
23:06 <mutante> graceful apache on palladium [production]
21:13 <hashar> Gerrit: allowed JenkinsBot to submit patches on wikimedia/bots (and thus on all child repositories) [production]
20:50 <hashar> operations/puppet.git manifests should no more have leading tabulations {{gerritI69ddc72f5a072ac7dc4f67622b65f36a70d3c021}} [production]
20:08 <bblack> intermittent 5xx are most likely varnish restarts off and on rest of today [production]
19:51 <hashar> Zuul: stopped / started process to clear up obsoletes changes stuck in queue [production]
19:47 <hashar> Jenkins/Zuul lost connection somehow. Disabled/Reenabled gearman client in Jenkins [production]
19:44 <hashar> Jenkins: updated qunit jobs to roam on both gallium and lanthanum (were previously tied to run only on gallium) [production]
19:43 <ottomata> restarted varnishkafka on some esams hosts that seem old misconfigured vk processes [production]
19:13 <ottomata> restarting varnishkafka on amssq31 [production]
19:08 <ottomata> restarting varnishkafka on cp3013 [production]
17:46 <aaron> Synchronized php-1.24wmf14/includes/jobqueue/JobQueueFederated.php: 87e7bfceb795d065d6157ac8ce3381a7814000b5 (duration: 00m 03s) [production]
17:38 <aaron> Synchronized php-1.24wmf15/includes/jobqueue/JobQueueFederated.php: 12ce1dc1ec46b06d1160e142ddfaf8dcb1c9f131 (duration: 00m 04s) [production]
16:30 <andrewbogott> updated wikitech to 1.24wmf15; turned on OAuth [production]
16:05 <Nemo_bis> andrewbogott> Nikerabbit: I'm upgrading it [wikitech wiki], it'll be flaky for a bit [production]
16:00 <manybubbles> deone with SWAT [production]
15:57 <manybubbles> Synchronized php-1.24wmf14/extensions/VisualEditor/: SWAT - fix visual editor bug - Changes made after reviewing changes are not sent (when caching is enabled) (duration: 00m 07s) [production]
15:47 <manybubbles> Synchronized php-1.24wmf15/extensions/VisualEditor/: SWAT - fix visual editor bug - Changes made after reviewing changes are not sent (when caching is enabled) (duration: 00m 08s) [production]
15:41 <hoo> Removed all right holders from closed and inaccessible ukwikimedia (bug 68737) [production]
15:39 <manybubbles> Synchronized php-1.24wmf15/includes/specials/SpecialRevisiondelete.php: SWAT - fix fatal on revision delete (duration: 00m 08s) [production]
15:33 <manybubbles> Synchronized wmf-config/CommonSettings.php: SWAT load Mantle before MobileFrontent (duration: 00m 07s) [production]
15:31 <manybubbles> Synchronized php-1.24wmf14/extensions/Echo/: SWAT fix bad variable name in echo (duration: 00m 08s) [production]
15:23 <manybubbles> Synchronized wmf-config/InitialiseSettings.php: SWAT - update some permissions on eswiki (duration: 00m 08s) [production]
15:17 <manybubbles> Synchronized php-1.24wmf15/extensions/Echo/: SWAT - fix incorrect variable name (duration: 00m 08s) [production]
15:15 <manybubbles> Synchronized wmf-config/InitialiseSettings.php: SWAT - add import sources to bhwiki (duration: 00m 08s) [production]
15:10 <manybubbles> Synchronized php-1.24wmf14/extensions/FundraisingTranslateWorkflow/: SWAT update fundraising to fix botched deploy [production]
12:28 <hashar> Upgrading our Jenkins Job Builder fork ( d833015..666e953 ) [production]
03:00 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Jul 28 02:59:35 UTC 2014 (duration 59m 34s) [production]
02:26 <LocalisationUpdate> completed (1.24wmf15) at 2014-07-28 02:25:34+00:00 [production]
02:16 <LocalisationUpdate> completed (1.24wmf14) at 2014-07-28 02:15:00+00:00 [production]
2014-07-27 §
05:24 <springle> mysqldump s6 dbstore1002 to dbstore1001 [production]
02:59 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jul 27 02:58:15 UTC 2014 (duration 58m 14s) [production]
02:25 <LocalisationUpdate> completed (1.24wmf15) at 2014-07-27 02:24:10+00:00 [production]
02:14 <LocalisationUpdate> completed (1.24wmf14) at 2014-07-27 02:13:44+00:00 [production]
2014-07-26 §
21:29 <hashar> restarting Zuul to clear up some stalled changes. [production]
02:59 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jul 26 02:57:52 UTC 2014 (duration 57m 50s) [production]
02:26 <LocalisationUpdate> completed (1.24wmf15) at 2014-07-26 02:25:46+00:00 [production]
02:16 <LocalisationUpdate> completed (1.24wmf14) at 2014-07-26 02:15:31+00:00 [production]
2014-07-25 §
22:52 <mutante> Bugzilla - upgraded to 4.4.5 [production]
22:41 <mutante> ocg - deleted old log dirs [production]
19:28 <hashar> Jenkins : disabling gearman plugin and reenabling it (just uncheck/save/check a box in https://integration.wikimedia.org/ci/configure ) [production]
19:25 <hashar> zuul@gallium:/etc/zuul/wikimedia$ echo status|nc -q 3 localhost 4730|wc -l ... Yields: 0 . Which mean jobs are no more registered for some reason. [production]
19:24 <hashar> Jenkins stalled again yeahhhhh [production]
16:59 <mutante> powercycled ms-be1010 - unresponsive to ssh, nothing on mgmt [production]
16:28 <MaxSem> Updating PageImages data for mainspace on Commons from terbium [production]
13:09 <_joe_> re-enabling puppet, test run on the test host was fine. [production]
13:03 <_joe_> stopping puppet on all appservers - will reactivate after testing [production]
11:26 <reedy> Synchronized docroot and w: (no message) (duration: 00m 13s) [production]
10:51 <hashar> contint: manually cleared /tmp on the 3 labs jenkins slaves. [production]