1401-1450 of 10000 results (39ms)
2018-04-13 §
08:53 <vgutierrez@neodymium> conftool action : set/pooled=no; selector: name=nescio.wikimedia.org,service=pdns_recursor [production]
08:52 <vgutierrez> depool and reimage nescio.wikimedia.org as stretch [production]
08:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1114 in API - T191996 (duration: 01m 00s) [production]
08:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully depool db1114 - T191996 (duration: 01m 00s) [production]
07:58 <mobrovac@tin> Started restart [electron-render/deploy@94d27d7]: Kick Electron, hanging, take 2 - T174916 [production]
07:52 <mobrovac@tin> Started restart [electron-render/deploy@94d27d7]: Kick Electron, hanging - T174916 [production]
07:22 <legoktm> restarting jenkins [production]
07:15 <moritzm> pooling mw1265 and mw1279 for production traffic [production]
05:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1114 from main traffic - T191996 (duration: 01m 00s) [production]
05:37 <marostegui> Deploy schema change on db1104 - T187089 T185128 T153182 [production]
05:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1104 for alter table (duration: 01m 00s) [production]
05:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1066 after alter table (duration: 01m 01s) [production]
05:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1101:3318 after alter table (duration: 01m 01s) [production]
2018-04-12 §
23:33 <awight@tin> Finished deploy [ores/deploy@543901a]: Restore ores1001 canary to master branch (duration: 03m 24s) [production]
23:30 <awight@tin> Started deploy [ores/deploy@543901a]: Restore ores1001 canary to master branch [production]
23:25 <awight@tin> Finished deploy [ores/deploy@a5cec53]: Canary ores1001 only: Limited test of git-lfs for ORES (duration: 02m 31s) [production]
23:22 <awight@tin> Started deploy [ores/deploy@a5cec53]: Canary ores1001 only: Limited test of git-lfs for ORES [production]
23:09 <dereckson@tin> Synchronized tests/: Update PHPUnit tests to use PHPUnit\Framework\TestCase (no-op) (duration: 01m 01s) [production]
22:07 <urandom> restarting Cassandra, restbase2003 -- T192112 [production]
21:06 <urandom> restarting Cassandra, restbase1010 -- T192112 [production]
21:03 <urandom> temporarily disabling puppet to make (ephemeral) change to GC settings, restbase1010 -- T192112 [production]
20:37 <urandom> increase change-prop sample rate in dev env to 100% (from 80) -- T186751 [production]
20:34 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@bd772eb]: Revert switching TranslationUpdateJob T192107 (duration: 00m 39s) [production]
20:33 <ppchelko@tin> Started deploy [cpjobqueue/deploy@bd772eb]: Revert switching TranslationUpdateJob T192107 [production]
20:32 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Switch TranslateUpdateJob back to the Redis-based queue as it is using PHP serialisation - T192107 (duration: 01m 00s) [production]
20:04 <XioNoX> all good, revert routing ns1 to radon [production]
19:54 <ema> reboot baham for kernel upgrade T188092 [production]
19:51 <XioNoX> routing ns1 to radon [production]
19:46 <XioNoX> all good, revert routing ns0 to baham [production]
19:41 <thcipriani@tin> rebuilt and synchronized wikiversions files: All wikis to 1.31.0-wmf.29 [production]
19:40 <ema> reboot radon for kernel upgrade T188092 [production]
19:37 <XioNoX> routing ns0 to baham [production]
18:02 <arlolra@tin> Finished deploy [parsoid/deploy@1807a38]: Updating Parsoid to 322b6e8 (duration: 15m 09s) [production]
17:47 <arlolra@tin> Started deploy [parsoid/deploy@1807a38]: Updating Parsoid to 322b6e8 [production]
17:38 <herron> puppet master updates complete — re-enabling puppet agents [production]
17:35 <moritzm> installing apache security updates on hafnium [production]
17:31 <herron> temporarily disabling puppet agents for openssl updates and apache restarts on puppet masters [production]
17:27 <moritzm> installing apache security updates on krypton [production]
17:17 <moritzm> installing patch security updates on trusty [production]
16:59 <urandom> increase change-prop sample rate in dev env to 80% (from 60) -- T186751 [production]
16:21 <marostegui> Deploy schema change on db1066 - T132416 [production]
16:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1114 to main traffic and depool db1066 for alter table - T191996 (duration: 01m 17s) [production]
16:07 <marostegui> Reboot es2013 - T191977 [production]
15:27 <gehel> rolling restart of elasticsearch cirrus / eqiad for jvm upgrade completed [production]
15:06 <moritzm> installing django/apache security updates on labmon* [production]
15:03 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool es2013 (duration: 01m 17s) [production]
14:59 <jynus> shutting down es2013's mariadb [production]
14:46 <mobrovac@tin> Synchronized wmf-config/InitialiseSettings.php: No-op: Clean up an unused global var for the EventBus-based JobQueue (duration: 01m 17s) [production]
14:43 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Switch the second bulk of low-traffic jobs for all wikis - T190327 (duration: 01m 16s) [production]
14:43 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@85fbd47]: Enable second bulk of low traffic jobs for all wikis T190327 (duration: 00m 35s) [production]