1-50 of 10000 results (27ms)
2016-03-09 ยง
23:54 <bblack> ending caches codfw->direct testing [production]
23:15 <bblack> restarted puppetmaster on palladium [production]
23:03 <bblack> caches: starting test codfw->direct (codfw caches -> eqiad apps) [production]
22:42 <bearND> mobileapps deployed 26d4031 [production]
22:36 <bearND> starting mobileapps deploy, second try (without dead link removal patch) [production]
21:54 <bearND> mobileapps deployed 95a2d76 [production]
21:28 <ori> Depooled mw1107 [production]
21:26 <bearND> starting mobileapps deploy [production]
21:22 <ori> restarted HHVM on mw1107; lock-up [production]
21:06 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.16 [production]
20:57 <ori> Upgrade HHVM on CODFW app servers to 3.12.1+dfsg-1 [production]
20:19 <urandom> decommissioning restbase1001.eqiad.wmnet : T125842 [production]
20:11 <krinkle@tin> Synchronized wmf-config/db-eqiad.php: Clean up - Ibb4bb0b32f5 (duration: 00m 29s) [production]
20:11 <krinkle@tin> Synchronized wmf-config/db-codfw.php: Clean up - Ibb4bb0b32f5 (duration: 00m 35s) [production]
19:01 <volans@tin> Synchronized wmf-config/db-codfw.php: Change codfw external storage topology T127330 (duration: 00m 27s) [production]
18:52 <anomie@tin> Synchronized php-1.27.0-wmf.16/includes/session/SessionManager.php: Add backtrace to log for MW_NO_SESSION warning mode [[gerrit:276232]] (duration: 00m 50s) [production]
18:44 <volans> Changing topology of local codfw masters for es2 and es3 before merging https://gerrit.wikimedia.org/r/#/c/276229/1 T127330 [production]
17:53 <csteipp> deployed patch for T110143 to wmf16 [production]
17:40 <csteipp> deployed patch for T122056 [production]
16:09 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: Wikipedia while at Women of the World Festival throttle rule [[gerrit:276179]] (duration: 00m 30s) [production]
16:05 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Change LanguageOverlay bucket rates [[gerrit:276172]] (duration: 00m 52s) [production]
14:54 <volans@tin> Synchronized wmf-config/db-codfw.php: Rebalance external storage servers in codfw T127330 (duration: 00m 41s) [production]
14:14 <moritzm> installing Django security updates [production]
13:19 <moritzm> installing beanshell security updates [production]
12:46 <paravoid> set disable on cr2-knams:xe-1/2/0 (Init7), issues with at least one large network [production]
12:25 <elukey> added rdb1003 back to the Job Runners queue. All the jobchron processes on jobrunners/videoscalers need to be restarted. [production]
12:07 <elukey@tin> Synchronized wmf-config/jobqueue-eqiad.php: Add rdb1003 back to the Redis JobQueue pool after maintenance (duration: 00m 34s) [production]
12:00 <elukey> re-enabled puppet on rdb1004 [production]
11:47 <moritzm> uploaded firmware-nonfree 20151018 to jessie-wikimedia on carbon [production]
11:39 <godog> rolling restart cassandra in staging after merging https://gerrit.wikimedia.org/r/#/c/275917/ [production]
11:27 <jynus> setting up master-master cross-datacenter replication for s2 (db1018-db2017) [production]
11:20 <ema> hhvm restarted on mw1140 [production]
11:04 <jynus> deployed manually new code at dbtree (noc.wikimedia.org) [production]
10:39 <elukey> puppet disabled on rdb1004 (plus Redis instances) as precautionary step for master reimage - rdb1003 [production]
10:35 <jynus> setting up master-master replication on tools (labsdb100[45]) [production]
09:32 <moritzm> rebooting iron for kernel update [production]
09:26 <elukey> puppet disabled on rdb1003 for debian re-image. Redis servers going to be stopped too as pre-step for backup. [production]
08:32 <oblivian@tin> Synchronized wmf-config/jobqueue-eqiad.php: re-routing writes from rdb1003 to rdb1005 for reimaging (duration: 00m 36s) [production]
08:29 <jynus@tin> Synchronized wmf-config/db-codfw.php: Repool db2035 (duration: 00m 39s) [production]
07:49 <_joe_> uploading hhvm 3.12, extensions to reprepro [production]
06:26 <mutante> bast2001 - still installing in snail mode - please feel free to check if it's done, and if so re-add to puppet so users get created.thx [production]
03:16 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Mar 9 03:16:21 UTC 2016 (duration 8m 2s) [production]
03:08 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.16) (duration: 17m 51s) [production]
02:32 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.15) (duration: 13m 28s) [production]
02:13 <ori@tin> Synchronized php-1.27.0-wmf.15/includes/diff/DairikiDiff.php: I4d4b8f81c: Dont quote assert expressions in DairikiDiff (duration: 00m 27s) [production]
02:12 <ori@tin> Synchronized php-1.27.0-wmf.16/includes/diff/DairikiDiff.php: I4d4b8f81c: Dont quote assert expressions in DairikiDiff (duration: 00m 31s) [production]
01:40 <csteipp> redeploy patch for T129120 [production]
01:39 <csteipp@tin> Synchronized php-1.27.0-wmf.16/includes/api/ApiQueryInfo.php: (no message) (duration: 00m 33s) [production]
00:33 <maxsem@tin> Synchronized php-1.27.0-wmf.15/extensions/Echo/: SWAT (duration: 00m 32s) [production]
00:32 <maxsem@tin> Synchronized php-1.27.0-wmf.15/extensions/MobileFrontend/: SWAT (duration: 00m 32s) [production]