2701-2750 of 10000 results (49ms)
2019-06-24 §
08:38 <jynus> upgrade, stop and restart db1108 [production]
08:34 <jynus> reloading haproxy on dbproxy1004/9 [production]
08:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1120 after upgrade T226358 (duration: 00m 56s) [production]
08:14 <jynus> upgrade, stop and restart db1107 [production]
08:09 <marostegui> Stop MySQL on db1120 for upgrade - T226358 [production]
08:08 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1120 for upgrade T226358 (duration: 00m 56s) [production]
07:51 <elukey> stop mysql consumer on eventlog1002 (so traffic to db1107 will be stopped, to allow maintenance to happen) [production]
07:06 <moritzm> installing vim update for stretch [production]
06:31 <_joe_> publishing docker-registry.wikimedia.org/nodejs10-slim:0.0.2, T226346 [production]
06:16 <elukey> powercycle analytics1060 (stuck, no ssh, no console com2 available) [production]
06:01 <marostegui> Stop MySQL on db1117:3321 to clone db1135 (haproxy alert will be triggered) - T222682 [production]
05:57 <_joe_> rebuilding base debian/alpine images to pick up security updates [production]
05:07 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1135 from config T222682 (duration: 00m 55s) [production]
05:06 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1135 from config T222682 (duration: 01m 07s) [production]
04:59 <marostegui> Rename table wikimedia_editor_tasks_entity_description_exists in db1123 (testwikidatawiki) T226326 [production]
04:54 <marostegui> Rename table wikimedia_editor_tasks_entity_description_exists in db1092 T226326 [production]
2019-06-21 §
14:54 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:53 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:51 <moritzm> rebooting planet1001 to pick up MDS mitigations/new kernel [production]
14:50 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:50 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:50 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:49 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:37 <moritzm> rebooting kerberos1001 to pick up MDS mitigations/new kernel [production]
14:26 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:26 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:23 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
14:23 <moritzm> rebooting wezen [production]
14:22 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:22 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:17 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
14:16 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
14:10 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
14:10 <Urbanecm> Attached Carmen0428@metawiki to Carmen0428 global account (T223036) [production]
14:09 <Urbanecm> Renamed Carmen0429@metawiki to Carmen0428@metawiki as part of re-attaching to global account (T223036) [production]
13:55 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:52 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:52 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:48 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:48 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:48 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:43 <akosiaris@deploy1001> scap-helm mathoid finished [production]
13:43 <akosiaris@deploy1001> scap-helm mathoid cluster staging completed [production]
13:43 <akosiaris@deploy1001> scap-helm mathoid upgrade --recreate-pods -f mathoid-staging-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] [production]
13:33 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:26 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:16 <moritzm> rebooting kafkamon instances to pick up MDS mitigations/new kernel [production]
13:16 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:16 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:11 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]