5651-5700 of 10000 results (58ms)
2018-02-16 §
15:37 <andrew@tin> Started deploy [horizon/deploy@29f9afb]: second attempt at ocata branch [production]
15:29 <andrew@tin> Finished deploy [horizon/deploy@58d2718]: first attempt at ocata branch (duration: 01m 28s) [production]
15:28 <andrew@tin> Started deploy [horizon/deploy@58d2718]: first attempt at ocata branch [production]
15:27 <godog> shut ms-be1018 for bbu swap - T186988 [production]
15:16 <akosiaris> run T181121#3978654 oneliner once more on sca1004, this time the VM has no DRBD [production]
15:14 <akosiaris> poweroff sca1004, switch from DRBD to plain disk template T181121 [production]
14:15 <akosiaris> doing more IO stress tests on ganeti1005. T181121. Seems like we can reproduce [production]
14:06 <chasemp> T184209 initial setup of labs-instances2-b-codfw and hosts [production]
13:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1094 (duration: 00m 56s) [production]
13:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 and db1067 - T162807 (duration: 00m 55s) [production]
13:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1094 (duration: 00m 56s) [production]
12:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1094 (duration: 00m 56s) [production]
12:46 <jynus> reload dbproxy1008 configuration [production]
12:44 <jynus> reload dbproxy1003 configuration [production]
12:37 <ema> cp3049: restart varnish-fe to clear 'child restarted' alert [production]
12:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1094 (duration: 00m 56s) [production]
12:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 56s) [production]
12:17 <marostegui> Stop MySQL on db1094 for mariadb upgrade, kernel upgrade and socket location upgrade [production]
12:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 (duration: 00m 56s) [production]
12:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1093 (duration: 00m 56s) [production]
11:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 00m 56s) [production]
11:35 <jynus> stopping mysql on db1043, db2012 for clonning data away [production]
11:33 <jynus> changing socket location on phabricator db hosts T148507 [production]
11:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 00m 56s) [production]
11:28 <ema> cp3036: restart varnish-fe to clear 'child restarted' alert [production]
11:28 <hashar> Switching operations/mediawiki-config job for composer to Docker | https://gerrit.wikimedia.org/r/#/c/411206/ [production]
11:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1093 (duration: 00m 56s) [production]
11:09 <elukey> restart nfaccd on rhenium to see if it picks up the new kafka topic config (3 partitions) [production]
11:06 <marostegui> Stop MySQL on db1093 for mariadb and kernel upgrade, also update socket path [production]
11:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 56s) [production]
09:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1099:3311 - T162807 (duration: 00m 56s) [production]
09:55 <jynus@tin> Synchronized wmf-config/db-codfw.php: Remove db1053 (duration: 00m 56s) [production]
09:53 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Remove db1053 (duration: 00m 56s) [production]
08:48 <akosiaris> doing IO stress tests on ganeti1005. T181121 [production]
08:34 <akosiaris> manually allocate logstash1008 on ganeti1005 to undo the manual override of sensible allocation rules by ganeti [production]
08:30 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1053 (duration: 00m 57s) [production]
08:14 <akosiaris> powercycle ganeti1006 T181121 [production]
08:13 <akosiaris> powercycle ganeti1006 [production]
06:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1067 - T162807 (duration: 00m 59s) [production]
06:41 <moritzm> installing installing quagga security updates [production]
06:35 <marostegui> Deploy schema change on s5 primary master db1070 - T185128 T153182 [production]
00:16 <ebernhardson@tin> Synchronized php-1.31.0-wmf.21/extensions/ProofreadPage/modules/page/ext.proofreadpage.page.edit.js: SWAT: T187454 fix text selection on #wpTextbox1 (duration: 00m 58s) [production]
2018-02-15 §
23:43 <demon@tin> Synchronized scap/plugins/clean.py: no-op (duration: 00m 56s) [production]
22:54 <demon@tin> Synchronized php-1.31.0-wmf.21/extensions/MassMessage/includes/MassMessage.php: fix use statement, T187510 (duration: 00m 57s) [production]
21:50 <ejegg> updated CiviCRM from 61acc9175e to 31115684f6 [production]
20:22 <twentyafterfour> 1.31.0-wmf.21 deployed: no apparent change in fatalmonitor error rate. refs T183960 [production]
20:18 <twentyafterfour@tin> rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.21 [production]
20:11 <twentyafterfour@tin> Synchronized php-1.31.0-wmf.21/extensions/TwoColConflict/includes/TwoColConflictHooks.php: sync https://gerrit.wikimedia.org/r/#/c/410809/ (duration: 01m 13s) [production]
20:09 <twentyafterfour> syncing a patch before deploying 1.31.0-wmf.21 to all wikis. [production]
19:55 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: Follow-up 77be427a1: [[gerrit:411048|Enable the Beta Feature on all wikis]] T185708 (duration: 01m 12s) [production]