2251-2300 of 10000 results (54ms)
2018-04-13 §
13:52 <elukey> roll restart druid + zookeeper daemons on druid100[123] for openjdk-7 updates [production]
13:49 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool es1013 with full weight (duration: 01m 00s) [production]
13:32 <elukey> restart druid and zookeeper daemons on druid100[456] for opejdk-7 updates [production]
13:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1104 after alter table (duration: 01m 02s) [production]
13:18 <urandom> increasing heap size to 16G -- T186751 [production]
12:37 <moritzm> installing apache security updates on mendelevium (otrs) [production]
12:36 <moritzm> installing apache security updates on bohrium (piwik) [production]
11:58 <vgutierrez@neodymium> conftool action : set/pooled=yes; selector: name=maerlant.wikimedia.org,service=pdns_recursor [production]
11:56 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool es1013 with low load (duration: 01m 04s) [production]
10:59 <moritzm> reimaging mw1261-mw1264 to stretch (T174431) [production]
10:40 <vgutierrez@neodymium> conftool action : set/pooled=no; selector: name=maerlant.wikimedia.org,service=pdns_recursor [production]
10:38 <vgutierrez> Depool and reimage maerlant.wikimedia.org as stretch [production]
10:16 <vgutierrez@neodymium> conftool action : set/pooled=yes; selector: name=nescio.wikimedia.org,service=pdns_recursor [production]
10:01 <moritzm> installing java security updates on meiterium/archive.wikimedia.org [production]
09:33 <jynus> start reimage of es1013 [production]
09:03 <moritzm> reimaging mw1276-mw1278 to stretch (T174431) [production]
08:53 <vgutierrez@neodymium> conftool action : set/pooled=no; selector: name=nescio.wikimedia.org,service=pdns_recursor [production]
08:52 <vgutierrez> depool and reimage nescio.wikimedia.org as stretch [production]
08:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1114 in API - T191996 (duration: 01m 00s) [production]
08:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully depool db1114 - T191996 (duration: 01m 00s) [production]
07:58 <mobrovac@tin> Started restart [electron-render/deploy@94d27d7]: Kick Electron, hanging, take 2 - T174916 [production]
07:52 <mobrovac@tin> Started restart [electron-render/deploy@94d27d7]: Kick Electron, hanging - T174916 [production]
07:22 <legoktm> restarting jenkins [production]
07:15 <moritzm> pooling mw1265 and mw1279 for production traffic [production]
05:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1114 from main traffic - T191996 (duration: 01m 00s) [production]
05:37 <marostegui> Deploy schema change on db1104 - T187089 T185128 T153182 [production]
05:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1104 for alter table (duration: 01m 00s) [production]
05:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1066 after alter table (duration: 01m 01s) [production]
05:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1101:3318 after alter table (duration: 01m 01s) [production]
2018-04-12 §
23:33 <awight@tin> Finished deploy [ores/deploy@543901a]: Restore ores1001 canary to master branch (duration: 03m 24s) [production]
23:30 <awight@tin> Started deploy [ores/deploy@543901a]: Restore ores1001 canary to master branch [production]
23:25 <awight@tin> Finished deploy [ores/deploy@a5cec53]: Canary ores1001 only: Limited test of git-lfs for ORES (duration: 02m 31s) [production]
23:22 <awight@tin> Started deploy [ores/deploy@a5cec53]: Canary ores1001 only: Limited test of git-lfs for ORES [production]
23:09 <dereckson@tin> Synchronized tests/: Update PHPUnit tests to use PHPUnit\Framework\TestCase (no-op) (duration: 01m 01s) [production]
22:07 <urandom> restarting Cassandra, restbase2003 -- T192112 [production]
21:06 <urandom> restarting Cassandra, restbase1010 -- T192112 [production]
21:03 <urandom> temporarily disabling puppet to make (ephemeral) change to GC settings, restbase1010 -- T192112 [production]
20:37 <urandom> increase change-prop sample rate in dev env to 100% (from 80) -- T186751 [production]
20:34 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@bd772eb]: Revert switching TranslationUpdateJob T192107 (duration: 00m 39s) [production]
20:33 <ppchelko@tin> Started deploy [cpjobqueue/deploy@bd772eb]: Revert switching TranslationUpdateJob T192107 [production]
20:32 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Switch TranslateUpdateJob back to the Redis-based queue as it is using PHP serialisation - T192107 (duration: 01m 00s) [production]
20:04 <XioNoX> all good, revert routing ns1 to radon [production]
19:54 <ema> reboot baham for kernel upgrade T188092 [production]
19:51 <XioNoX> routing ns1 to radon [production]
19:46 <XioNoX> all good, revert routing ns0 to baham [production]
19:41 <thcipriani@tin> rebuilt and synchronized wikiversions files: All wikis to 1.31.0-wmf.29 [production]
19:40 <ema> reboot radon for kernel upgrade T188092 [production]
19:37 <XioNoX> routing ns0 to baham [production]
18:02 <arlolra@tin> Finished deploy [parsoid/deploy@1807a38]: Updating Parsoid to 322b6e8 (duration: 15m 09s) [production]
17:47 <arlolra@tin> Started deploy [parsoid/deploy@1807a38]: Updating Parsoid to 322b6e8 [production]