3001-3050 of 10000 results (67ms)
2019-06-05 §
07:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Clarify db1091 status (duration: 00m 56s) [production]
07:22 <ema> depool cp3035 and reimage as upload_ats T222937 [production]
07:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 - host went down (duration: 00m 55s) [production]
06:45 <marostegui> Restart MySQL on db2110 to get the binlog format changed to STATEMENT - T220170 [production]
06:45 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Promote db2090 to s4 codfw master T220170 (duration: 00m 54s) [production]
06:25 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Mimic s4 codfw weights to eqiad T220170 (duration: 00m 55s) [production]
06:17 <marostegui> Start topology changes on s4 codfw to replace current master db2051 with db2090 - T220170 [production]
06:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1084 into API (duration: 00m 54s) [production]
05:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1084 after upgrade T224852 (duration: 00m 55s) [production]
05:49 <marostegui> Upgrade MySQL on db1084 T224852 [production]
05:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1084 for upgrade T224852 (duration: 01m 06s) [production]
05:31 <marostegui> Stop MySQL on db1125 (sanitarium) s2,s4,s6,s7 to upgrade mysql - T224852 [production]
05:28 <marostegui> Keep compressing tables on labsdb1012 - T222978 [production]
05:22 <marostegui> Change replication topology on m3 codfw to promote db2065 as codfw master instead of db2042 - T221533 [production]
05:07 <marostegui> Upgrade Mysql on labsdb1012 - T224852 [production]
04:09 <onimisionipe> starting postgres slave init on maps2001 - T224395 [production]
2019-06-04 §
23:03 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Change log level to debug for PageTriage (duration: 01m 03s) [production]
22:06 <eileen> civicrm revision changed from 506ebe2f2a to 5c02e62d6e, config revision is 63438eea43 [production]
21:08 <jbond42> finished rolling reboots of mw1* servers [production]
21:07 <jbond42> finished tolling reboots of mw1* servers [production]
20:56 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:55 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:36 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:36 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:26 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:26 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:10 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:10 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:03 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:03 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:55 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:55 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:48 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:48 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:48 <XioNoX> replace logstash.svc.eqiad.wmnet syslog target with syslog.codfw.wmnet on cr4-ulsfo - T224128 [production]
19:41 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:41 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:41 <jbond42> reboot mwdebug1002 [production]
19:36 <jbond42> reboot mwdebug1001 [production]
19:35 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:35 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:28 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:28 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:21 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:21 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:45 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:45 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:38 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:38 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:17 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]