551-600 of 10000 results (26ms)
2021-01-26 ยง
20:13 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2321.codfw.wmnet [production]
20:12 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2321.codfw.wmnet [production]
20:03 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1409.eqiad.wmnet [production]
20:01 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1408.eqiad.wmnet [production]
19:53 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1408.eqiad.wmnet [production]
19:53 <legoktm@cumin1001> conftool action : set/pooled=yes; selector: name=mw2317.codfw.wmnet [production]
19:49 <legoktm@cumin1001> conftool action : set/pooled=no; selector: name=mw2317.codfw.wmnet [production]
19:43 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1409.eqiad.wmnet [production]
19:42 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1337.eqiad.wmnet [production]
19:18 <legoktm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2317.codfw.wmnet with reason: REIMAGE [production]
19:16 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2317.codfw.wmnet with reason: REIMAGE [production]
19:13 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2321.codfw.wmnet [production]
18:58 <moritzm> installing sudo security updates on Jessie [production]
18:57 <moritzm> uploaded sudo 1.8.10p3-1+deb8u7+wmf1 to apt.wikimedia.org [production]
18:46 <dancy@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.28 (duration: 40m 09s) [production]
18:37 <moritzm> installing sudo security updates on Stretch [production]
18:22 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps1009.eqiad.wmnet with reason: Downtiming after rebuild [production]
18:22 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps1009.eqiad.wmnet with reason: Downtiming after rebuild [production]
18:15 <moritzm> installing sudo security updates on Buster [production]
18:07 <dancy@deploy1001> Started scap: testwikis wikis to 1.36.0-wmf.28 [production]
17:48 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1408.eqiad.wmnet with reason: REIMAGE [production]
17:46 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1409.eqiad.wmnet with reason: REIMAGE [production]
17:44 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1408.eqiad.wmnet with reason: REIMAGE [production]
17:44 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1409.eqiad.wmnet with reason: REIMAGE [production]
17:19 <mutante> ms-be1028 - running puppet to clear ferm icinga alert [production]
17:08 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1337.eqiad.wmnet with reason: REIMAGE [production]
17:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2321.codfw.wmnet with reason: REIMAGE [production]
17:05 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1337.eqiad.wmnet with reason: REIMAGE [production]
17:04 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2321.codfw.wmnet with reason: REIMAGE [production]
16:58 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1408.eqiad.wmnet with reason: REIMAGE [production]
16:57 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1409.eqiad.wmnet with reason: REIMAGE [production]
16:56 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1408.eqiad.wmnet with reason: REIMAGE [production]
16:55 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1409.eqiad.wmnet with reason: REIMAGE [production]
16:50 <marostegui> Deploy schema change on testwiki - T272953 [production]
16:44 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
16:43 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
16:43 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
16:42 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1009.eqiad.wmnet with reason: REIMAGE [production]
16:42 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
16:42 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
16:42 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
16:42 <mutante> reimaginge l33t jobrunner mw1337 [production]
16:40 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on maps1009.eqiad.wmnet with reason: REIMAGE [production]
16:38 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
16:38 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
16:38 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
16:02 <moritzm> installing mutt security updates on buster [production]
14:58 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1009.eqiad.wmnet with reason: REIMAGE [production]
14:56 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on maps1009.eqiad.wmnet with reason: REIMAGE [production]
14:44 <hnowlan> reimaging maps1009 as new buster master [production]