4151-4200 of 10000 results (54ms)
2018-02-19 §
06:44 <marostegui> Stop MySQL on db1089 to update its socket path [production]
06:42 <marostegui> Deploy schema change on s6 codfw master (db2039), this will generate lag on codfw - T187089 T185128 T153182 [production]
06:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 and db1105 - T162807 (duration: 00m 56s) [production]
05:29 <andrew@tin> Finished deploy [horizon/deploy@6a40f84]: rolling out several horizon bugfixes (duration: 03m 14s) [production]
05:26 <andrew@tin> Started deploy [horizon/deploy@6a40f84]: rolling out several horizon bugfixes [production]
02:50 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.21) (duration: 10m 59s) [production]
2018-02-18 §
15:49 <_joe_> rolling restart (1 at a time, staggered by 2 minutes) of 18 api appservers in equiad [production]
2018-02-17 §
17:33 <twentyafterfour> restarting apache on phab1001 to clear deadlocked workers. refs T182832 [production]
03:15 <demon@tin> Pruned MediaWiki: 1.31.0-wmf.20 [keeping static files] (duration: 01m 17s) [production]
03:12 <demon@tin> Pruned MediaWiki: 1.31.0-wmf.17 (duration: 04m 32s) [production]
2018-02-16 §
21:12 <hashar> Upgraded Zuul to https://gerrit.wikimedia.org/r/#/c/411322/3 | T187567 [production]
20:40 <andrew@tin> Finished deploy [horizon/deploy@efcba2b]: sudo dashboard update (duration: 01m 16s) [production]
20:39 <andrew@tin> Started deploy [horizon/deploy@efcba2b]: sudo dashboard update [production]
20:11 <andrew@tin> Finished deploy [horizon/deploy@1fdd122]: two more small fixes (duration: 01m 21s) [production]
20:10 <andrew@tin> Started deploy [horizon/deploy@1fdd122]: two more small fixes [production]
19:54 <andrew@tin> Finished deploy [horizon/deploy@bdcc12b]: ocata branch with sidebar fix (duration: 03m 12s) [production]
19:51 <andrew@tin> Started deploy [horizon/deploy@bdcc12b]: ocata branch with sidebar fix [production]
18:34 <hashar> upgraded zuul [production]
16:21 <andrew@tin> Finished deploy [horizon/deploy@16f3d8e]: ocata branch with upper new requirements (duration: 08m 00s) [production]
16:13 <andrew@tin> Started deploy [horizon/deploy@16f3d8e]: ocata branch with upper new requirements [production]
16:06 <cmjohnson1> labstore1006 and labstore1007 down for rack relocation [production]
16:03 <andrew@tin> Finished deploy [horizon/deploy@16d0b17]: ocata branch with upper constraints (duration: 02m 18s) [production]
16:00 <andrew@tin> Started deploy [horizon/deploy@16d0b17]: ocata branch with upper constraints [production]
15:40 <andrew@tin> Finished deploy [horizon/deploy@29f9afb]: second attempt at ocata branch (duration: 03m 22s) [production]
15:37 <andrew@tin> Started deploy [horizon/deploy@29f9afb]: second attempt at ocata branch [production]
15:29 <andrew@tin> Finished deploy [horizon/deploy@58d2718]: first attempt at ocata branch (duration: 01m 28s) [production]
15:28 <andrew@tin> Started deploy [horizon/deploy@58d2718]: first attempt at ocata branch [production]
15:27 <godog> shut ms-be1018 for bbu swap - T186988 [production]
15:16 <akosiaris> run T181121#3978654 oneliner once more on sca1004, this time the VM has no DRBD [production]
15:14 <akosiaris> poweroff sca1004, switch from DRBD to plain disk template T181121 [production]
14:15 <akosiaris> doing more IO stress tests on ganeti1005. T181121. Seems like we can reproduce [production]
14:06 <chasemp> T184209 initial setup of labs-instances2-b-codfw and hosts [production]
13:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1094 (duration: 00m 56s) [production]
13:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 and db1067 - T162807 (duration: 00m 55s) [production]
13:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1094 (duration: 00m 56s) [production]
12:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1094 (duration: 00m 56s) [production]
12:46 <jynus> reload dbproxy1008 configuration [production]
12:44 <jynus> reload dbproxy1003 configuration [production]
12:37 <ema> cp3049: restart varnish-fe to clear 'child restarted' alert [production]
12:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1094 (duration: 00m 56s) [production]
12:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 56s) [production]
12:17 <marostegui> Stop MySQL on db1094 for mariadb upgrade, kernel upgrade and socket location upgrade [production]
12:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 (duration: 00m 56s) [production]
12:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1093 (duration: 00m 56s) [production]
11:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 00m 56s) [production]
11:35 <jynus> stopping mysql on db1043, db2012 for clonning data away [production]
11:33 <jynus> changing socket location on phabricator db hosts T148507 [production]
11:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 00m 56s) [production]
11:28 <ema> cp3036: restart varnish-fe to clear 'child restarted' alert [production]
11:28 <hashar> Switching operations/mediawiki-config job for composer to Docker | https://gerrit.wikimedia.org/r/#/c/411206/ [production]