3651-3700 of 10000 results (73ms)
2019-06-05 §
12:32 <ladsgroup@deploy1001> Synchronized php-1.34.0-wmf.8/extensions/WikimediaMessages/: SWAT: [[gerrit:514460|Fix wikidata copyright message (T224536)]] (duration: 00m 56s) [production]
11:43 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:514449|Enable the new history page in the advanced mobile contributions mode (T219895)]] (duration: 00m 56s) [production]
11:27 <urbanecm@deploy1001> Synchronized wmf-config/flaggedrevs.php: [[:gerrit:514413|Remove project namespace from flaggedrevs on ruwikisource]] (T225037) (duration: 00m 54s) [production]
10:57 <ladsgroup@deploy1001> Synchronized php-1.34.0-wmf.8/extensions/FlaggedRevs: [[gerrit:514456|Add ext.flaggedRevs.icons to modules registeration]] (duration: 00m 57s) [production]
10:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1135 (duration: 00m 55s) [production]
10:09 <godog> mount sdb3 on ms-be1022 - T225079 [production]
09:50 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool db1135 with very low weight on s4 (duration: 00m 55s) [production]
09:26 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Pool without traffic db1135 into s4 T225060 (duration: 00m 55s) [production]
09:25 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool without traffic db1135 into s4 T225060 (duration: 00m 56s) [production]
08:42 <onimisionipe> removing maps2001 from cassandra cluster. It is going to be reimaged - T224395 [production]
08:40 <_joe_> rolling restart of php7 on the api servers, to test a different strategy of restarting compared to the appservers. [production]
08:21 <_joe_> performing a rolling restart of the php appservers via cumin to test speed and safety of the operations proposed in T224857 [production]
08:13 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:12 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
08:12 <moritzm> rebooting pybal-test2001 for tests with new qemu [production]
08:12 <ema> pool cp3035 w/ ATS backend T222937 [production]
08:12 <marostegui> Reboot db1091 T225060 [production]
08:05 <moritzm> installing qemu security updates on Ganeti hosts [production]
07:45 <marostegui> Transfer dbprov1001.eqiad.wmnet:snapshot.s4.2019-06-04--21-37-03.tar.gz to db1135 to provision it on s4 T225060 [production]
07:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Clarify db1091 status (duration: 00m 56s) [production]
07:22 <ema> depool cp3035 and reimage as upload_ats T222937 [production]
07:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 - host went down (duration: 00m 55s) [production]
06:45 <marostegui> Restart MySQL on db2110 to get the binlog format changed to STATEMENT - T220170 [production]
06:45 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Promote db2090 to s4 codfw master T220170 (duration: 00m 54s) [production]
06:25 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Mimic s4 codfw weights to eqiad T220170 (duration: 00m 55s) [production]
06:17 <marostegui> Start topology changes on s4 codfw to replace current master db2051 with db2090 - T220170 [production]
06:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1084 into API (duration: 00m 54s) [production]
05:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1084 after upgrade T224852 (duration: 00m 55s) [production]
05:49 <marostegui> Upgrade MySQL on db1084 T224852 [production]
05:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1084 for upgrade T224852 (duration: 01m 06s) [production]
05:31 <marostegui> Stop MySQL on db1125 (sanitarium) s2,s4,s6,s7 to upgrade mysql - T224852 [production]
05:28 <marostegui> Keep compressing tables on labsdb1012 - T222978 [production]
05:22 <marostegui> Change replication topology on m3 codfw to promote db2065 as codfw master instead of db2042 - T221533 [production]
05:07 <marostegui> Upgrade Mysql on labsdb1012 - T224852 [production]
04:09 <onimisionipe> starting postgres slave init on maps2001 - T224395 [production]
2019-06-04 §
23:03 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Change log level to debug for PageTriage (duration: 01m 03s) [production]
22:06 <eileen> civicrm revision changed from 506ebe2f2a to 5c02e62d6e, config revision is 63438eea43 [production]
21:08 <jbond42> finished rolling reboots of mw1* servers [production]
21:07 <jbond42> finished tolling reboots of mw1* servers [production]
20:56 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:55 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:36 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:36 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:26 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:26 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:10 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:10 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:03 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:03 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:55 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]