6401-6450 of 10000 results (42ms)
2021-01-27 ยง
18:50 <mutante> testreduce1001 - making nginx listen on IPv6 and restarting it T266509 [production]
18:49 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE [production]
18:47 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE [production]
18:45 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2219.codfw.wmnet with reason: REIMAGE [production]
18:43 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2219.codfw.wmnet with reason: REIMAGE [production]
18:42 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2218.codfw.wmnet with reason: REIMAGE [production]
18:40 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2218.codfw.wmnet with reason: REIMAGE [production]
18:39 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2217.codfw.wmnet with reason: REIMAGE [production]
18:37 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2217.codfw.wmnet with reason: REIMAGE [production]
18:30 <Tchanders> Creating the table securepoll_log in votewiki and testwiki (T271270) [production]
18:25 <hashar@deploy1001> Finished deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 (duration: 00m 07s) [production]
18:25 <hashar@deploy1001> Started deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 [production]
18:25 <hashar@deploy1001> Finished deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 (duration: 00m 10s) [production]
18:25 <hashar@deploy1001> Started deploy [integration/docroot@da43ad4]: Add Shellbox to doc.wm.o , misc build related changes fdf0917..da43ad4 [production]
18:23 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1268.eqiad.wmnet [production]
18:21 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1268.eqiad.wmnet [production]
18:15 <dpifke@deploy1001> Finished deploy [performance/arc-lamp@e24f319]: Re-deploying ArcLamp to webperf1002 (duration: 00m 05s) [production]
18:15 <dpifke@deploy1001> Started deploy [performance/arc-lamp@e24f319]: Re-deploying ArcLamp to webperf1002 [production]
18:13 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2301.codfw.wmnet [production]
18:10 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1406.eqiad.wmnet [production]
18:07 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2216.codfw.wmnet with reason: REIMAGE [production]
18:06 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1407.eqiad.wmnet [production]
18:05 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2216.codfw.wmnet with reason: REIMAGE [production]
18:04 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1407.eqiad.wmnet [production]
18:03 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2301.codfw.wmnet [production]
18:03 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1406.eqiad.wmnet [production]
17:50 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2215.codfw.wmnet with reason: REIMAGE [production]
17:48 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2215.codfw.wmnet with reason: REIMAGE [production]
17:34 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2301.codfw.wmnet with reason: REIMAGE [production]
17:32 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2301.codfw.wmnet with reason: REIMAGE [production]
17:32 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1406.eqiad.wmnet with reason: REIMAGE [production]
17:30 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1407.eqiad.wmnet with reason: REIMAGE [production]
17:29 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1406.eqiad.wmnet with reason: REIMAGE [production]
17:28 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1407.eqiad.wmnet with reason: REIMAGE [production]
17:27 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE [production]
17:25 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1268.eqiad.wmnet with reason: REIMAGE [production]
16:54 <elukey@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventstreams-internal' for release 'main' . [production]
16:40 <elukey@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventstreams-internal' for release 'main' . [production]
16:38 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
16:21 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
16:18 <moritzm> installing python-bottle security updates [production]
15:42 <elukey> umount /var/hadoop/data/r on an-worker1099 and restart hadoop daemons - T273034 [production]
15:31 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Migrate 5 NavigationTiming schemas to Event Platform on group0 and group1 - T271208 (duration: 01m 07s) [production]
15:15 <godog> bounce rsyslog on centrallog1001 [production]
13:52 <kharlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
13:52 <kharlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
13:48 <kharlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
13:48 <kharlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
13:43 <kharlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
13:25 <godog> swift codfw-prod decrease SSD weight for ms-be20[16-27] - T272837 [production]