851-900 of 10000 results (28ms)
2020-07-28 ยง
15:45 <jayme@cumin1001> conftool action : set/pooled=no; selector: name=wtp1035.* [production]
15:44 <jayme@cumin1001> conftool action : set/pooled=no; selector: name=wtp1034.* [production]
15:35 <ayounsi@deploy1001> Finished deploy [homer/deploy@5e999c8]: once more (duration: 03m 06s) [production]
15:32 <ayounsi@deploy1001> Started deploy [homer/deploy@5e999c8]: once more [production]
15:32 <ayounsi@deploy1001> Finished deploy [homer/deploy@5e999c8]: CR613642 (duration: 03m 38s) [production]
15:31 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1045.eqiad.wmnet [production]
15:30 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1041.eqiad.wmnet [production]
15:30 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1044.eqiad.wmnet [production]
15:29 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1039.eqiad.wmnet [production]
15:28 <ayounsi@deploy1001> Started deploy [homer/deploy@5e999c8]: CR613642 [production]
15:19 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:17 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:16 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
15:15 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:14 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
15:13 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
15:08 <ayounsi@deploy1001> Finished deploy [homer/deploy@fcf4332]: CR613642 (duration: 02m 14s) [production]
15:06 <ayounsi@deploy1001> Started deploy [homer/deploy@fcf4332]: CR613642 [production]
15:01 <ayounsi@deploy1001> Finished deploy [homer/deploy@fcf4332]: CR613642 (duration: 00m 11s) [production]
15:01 <ayounsi@deploy1001> Started deploy [homer/deploy@fcf4332]: CR613642 [production]
14:58 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1043.eqiad.wmnet [production]
14:58 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1040.eqiad.wmnet [production]
14:57 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
14:55 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1042.eqiad.wmnet [production]
14:54 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1038.eqiad.wmnet [production]
14:52 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
14:48 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
14:23 <herron> bounced centrallog rsyslog services in codfw/eqiad [production]
14:19 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:15 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1147', diff saved to https://phabricator.wikimedia.org/P12087 and previous config saved to /var/cache/conftool/dbconfig/20200728-140313-marostegui.json [production]
14:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1148', diff saved to https://phabricator.wikimedia.org/P12086 and previous config saved to /var/cache/conftool/dbconfig/20200728-140249-marostegui.json [production]
14:02 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1148', diff saved to https://phabricator.wikimedia.org/P12085 and previous config saved to /var/cache/conftool/dbconfig/20200728-140220-marostegui.json [production]
14:02 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1148', diff saved to https://phabricator.wikimedia.org/P12084 and previous config saved to /var/cache/conftool/dbconfig/20200728-140207-marostegui.json [production]
14:00 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:59 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:58 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:58 <moritzm> installing perl security updates [production]
13:56 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:56 <jayme@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:55 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1041.eqiad.wmnet [production]
13:55 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1037.eqiad.wmnet [production]
13:50 <godog> remove stale ipvs thanos-query service on port 80 [production]
13:39 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1040.eqiad.wmnet [production]
13:38 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1036.eqiad.wmnet [production]
13:38 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1039.eqiad.wmnet [production]
13:37 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=wtp1035.eqiad.wmnet [production]
13:37 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=wtp1038.eqiad.wmnet [production]