5751-5800 of 10000 results (51ms)
2015-11-23 §
08:58 <godog> restbase1001 nodetool decommission [production]
08:57 <mobrovac> mathoid deploying ff03d56 [production]
08:12 <moritzm> restarted gitblit on antimony [production]
03:28 <bd808> Freed 800M on deployment-bastion by running /home/bd808/cleanup-var-crap.sh [releng]
02:19 <l10nupdate@tin> Synchronized php-1.27.0-wmf.7/cache/l10n: l10nupdate for 1.27.0-wmf.7 (duration: 05m 57s) [production]
01:26 <Jamesofur> end enwiki test election from cli to avoid confusion with real election [production]
2015-11-22 §
21:30 <Reedy> restarting stuck Jenkins [production]
21:15 <Krinkle> Zuul queue stuck as of 3 hours ago. Jenkins unresponsive or 503 over HTTP. [releng]
02:16 <l10nupdate@tin> Synchronized php-1.27.0-wmf.7/cache/l10n: l10nupdate for 1.27.0-wmf.7 (duration: 05m 22s) [production]
01:57 <Luke081515> deleted rcm-5 (specific tests done) [rcm]
2015-11-21 §
03:19 <ori> SecurePoll arbcomlist.php run for enwiki (requested by Jamesofur) complete. [production]
02:20 <l10nupdate@tin> Synchronized php-1.27.0-wmf.7/cache/l10n: l10nupdate for 1.27.0-wmf.7 (duration: 05m 18s) [production]
00:50 <ori> update-ubuntu-mirror on carbon completed successfully ; going to re-enable icinga-wm [production]
00:46 <ori> rampant puppet failures appear to be the result of a Hash Sum mismatch error during apt-get update; attempting to fix by running sudo -u mirror /usr/local/sbin/update-ubuntu-mirror on carbon. [production]
00:37 <ori> disabled puppet on neon for one hour and killed icinga-wm to silence a tide of puppet failure alerts [production]
00:24 <demon@tin> Synchronized .arcconfig: no-op, for completeness (duration: 00m 31s) [production]
2015-11-20 §
22:01 <Coren> tools-webgrid-lighttpd-1412 tools-webgrid-lighttpd-1413 tools-webgrid-lighttpd-1414 tools-webgrid-lighttpd-1415 done and back in rotation. [tools]
21:59 <bd808> Removed shadow l10nupdate user from /etc/passwd & /etc/shadow on mira.deployment-prep.eqiad.wmflabs [releng]
21:45 <Coren> tools-webgrid-lighttpd-1411 tools-webgrid-lighttpd-1211 done and back in rotation. [tools]
21:45 <csteipp@tin> Synchronized php-1.27.0-wmf.7/includes/User.php: Deploy fix for T119021 (duration: 00m 28s) [production]
21:30 <Coren> tools-webgrid-lighttpd-1410 tools-webgrid-lighttpd-1210 done and back in rotation. [tools]
21:25 <Coren> tools-webgrid-lighttpd-1409 tools-webgrid-lighttpd-1209 done and back in rotation. [tools]
21:13 <Coren> tools-webgrid-lighttpd-1408 tools-webgrid-lighttpd-1208 done and back in rotation. [tools]
20:58 <Coren> tools-webgrid-lighttpd-1407 tools-webgrid-lighttpd-1207 done and back in rotation. [tools]
20:53 <Coren> tools-webgrid-lighttpd-1406 tools-webgrid-lighttpd-1206 done and back in rotation. [tools]
20:41 <Coren> tools-webgrid-lighttpd-1405 tools-webgrid-lighttpd-1205 tools-webgrid-generic-1405 done and back in rotation. [tools]
20:28 <Coren> tools-webgrid-lighttpd-1404 tools-webgrid-lighttpd-1204 tools-webgrid-generic-1404 done and back in rotation. [tools]
19:49 <Coren> done, and putting back in rotation: tools-webgrid-lighttpd-1403 tools-webgrid-lighttpd-1203 tools-webgrid-generic-1403 [tools]
19:25 <Coren> -lighttpd-1403 wants a restart. [tools]
19:15 <Coren> done, and putting back in rotation: tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1202 tools-webgrid-generic-1402 [tools]
18:55 <Coren> Putting -lighttpd-1401 -lighttpd-1201 -generic-1401 back in rotation, disabling the others. [tools]
18:55 <ori> resuming interrupted arbcomlist invocation on terbium [production]
18:24 <Coren> Beginning draining web nodes; -lighttpd-1401 -lighttpd-1201 -generic-1401 [tools]
18:10 <Coren> disabling puppet on the grid nodes listed at https://phabricator.wikimedia.org/P2337 so that the /tmp change in https://gerrit.wikimedia.org/r/#/c/252506/ do not apply early and break services [tools]
16:51 <_joe_> decommissioning mw1041: removed facts and certs, removed from conftool and pybal [production]
16:44 <reedy@tin> Synchronized wmf-config/throttle.php: Add throttle config for Viquimarató nit digital/2015 (duration: 00m 28s) [production]
16:17 <_joe_> depooled mw1041 [production]
15:41 <Reedy> running sync-common on mw1041 [production]
15:32 <_joe_> powercycling mw1041 [production]
15:26 <reedy@tin> Synchronized wmf-config/throttle.php: Update throttle for event tomorrow (duration: 00m 28s) [production]
14:35 <godog> swift eqiad-prod: set ms-be1019 / ms-be1020 / ms-be1021 weight 3000 [production]
14:33 <hashar> restarted qa-morebots [releng]
14:33 <hashar> Jenkins: deleting all phpcs-HEAD jobs https://phabricator.wikimedia.org/T90943 [releng]
14:30 <hashar> Jenkins: deleting all phpcs-HEAD jobs https://phabricator.wikimedia.org/T90943 [releng]
12:53 <hashar> beta cluster: ran git gc --prune=all on /srv/mediawiki-staging git repositories [releng]
10:06 <ori> Running SecurePoll's arbcomlist.php on terbium with performance fix from https://gerrit.wikimedia.org/r/#/c/254375/ , per request from Jamesofur. Looks to be behaving well, can be killed if it acts up. [production]
08:47 <ori> !log Resetting skin preference to MonoBook for User:Billinghurst per request in T114208 []
07:44 <_joe_> rebooted pybal-test2001 [production]
07:36 <_joe_> powercycled mw1041 [production]
04:55 <twentyafterfour@tin> Synchronized multiversion/checkoutMediaWiki.php: inconsequential sync to test mirroring (duration: 02m 14s) [production]