2021-07-15
§
|
19:51 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on pc1013.eqiad.wmnet with reason: REIMAGE |
[production] |
19:51 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1012.eqiad.wmnet with reason: REIMAGE |
[production] |
19:49 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1011.eqiad.wmnet with reason: REIMAGE |
[production] |
19:49 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on pc1012.eqiad.wmnet with reason: REIMAGE |
[production] |
19:47 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on pc1011.eqiad.wmnet with reason: REIMAGE |
[production] |
19:45 |
<nskaggs@cumin1001> |
START - Cookbook wmcs.wikireplicas.add_wiki |
[production] |
19:28 |
<volker-e@deploy1002> |
Finished deploy [design/style-guide@eebdc4d]: Deploy design/style-guide: eebdc4d “Visual style – Icons”: Add Figma colors & icons file as source of truth (#484) (duration: 00m 05s) |
[production] |
19:28 |
<volker-e@deploy1002> |
Started deploy [design/style-guide@eebdc4d]: Deploy design/style-guide: eebdc4d “Visual style – Icons”: Add Figma colors & icons file as source of truth (#484) |
[production] |
19:26 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . |
[production] |
19:26 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . |
[production] |
19:05 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . |
[production] |
19:05 |
<otto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . |
[production] |
18:37 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
18:35 |
<reedy@deploy1002> |
Synchronized php-1.37.0-wmf.14/extensions/EventLogging/includes/JsonSchemaHooks.php: T286611 (duration: 01m 06s) |
[production] |
18:34 |
<reedy@deploy1002> |
Synchronized php-1.37.0-wmf.12/extensions/EventLogging/includes/JsonSchemaHooks.php: T286611 (duration: 01m 07s) |
[production] |
18:32 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
17:11 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@7a673c9] (hadoop-test): Deploy refinery-source 0.1.15 to hadoop-test with fixes for Refine jobs (duration: 05m 41s) |
[production] |
17:07 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
17:05 |
<otto@deploy1002> |
Started deploy [analytics/refinery@7a673c9] (hadoop-test): Deploy refinery-source 0.1.15 to hadoop-test with fixes for Refine jobs |
[production] |
17:00 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
17:00 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@7a673c9]: Deploy refinery-source 0.1.15 with fixes for Refine jobs (duration: 17m 21s) |
[production] |
16:46 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps200[7-9].codfw.wmnet |
[production] |
16:46 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=maps20(0[1-6]|10).codfw.wmnet |
[production] |
16:43 |
<otto@deploy1002> |
Started deploy [analytics/refinery@7a673c9]: Deploy refinery-source 0.1.15 with fixes for Refine jobs |
[production] |
16:40 |
<ejegg> |
updated payments-wiki from d9892207c1 to 844b59ee42 |
[production] |
16:39 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps20(0[1-6]|10).codfw.wmnet |
[production] |
16:39 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=maps200[7-9].codfw.wmnet |
[production] |
16:27 |
<ejegg> |
updated fundraising CiviCRM from e0d53c92b5 to 20e9ef6bbb |
[production] |
16:24 |
<ejegg> |
updated payments-wiki from 0e7800027a to 844b59ee42 |
[production] |
16:19 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps2007.codfw.wmnet |
[production] |
16:00 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es1029.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
16:00 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es1029.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
15:51 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es1028.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
15:51 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es1028.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
15:19 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es1027.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
15:19 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es1027.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
15:16 |
<ladsgroup@deploy1002> |
Synchronized wmf-config/flaggedrevs.php: Config: [[gerrit:704773|flaggedrevs: Allow admins of idwiki to change stablesettings (T268317)]], try II (duration: 01m 05s) |
[production] |
15:03 |
<Amir1> |
temporary becoming admin on idwiki to debug T268317 |
[production] |
15:02 |
<moritzm> |
installing nginx security updates on ms-fe* |
[production] |
14:47 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es1026.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
14:47 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es1026.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
14:40 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps200[7-9].codfw.wmnet |
[production] |
14:40 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=maps20(0[1-6]|10).codfw.wmnet |
[production] |
14:33 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=maps20(0[1-6]|10).codfw.wmnet |
[production] |
14:33 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=maps200[7-9].codfw.wmnet |
[production] |
14:11 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es1024.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
14:11 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es1024.eqiad.wmnet with reason: Rebooting for T273281 |
[production] |
14:11 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on es2023.codfw.wmnet,es[1023-1025].eqiad.wmnet with reason: Rebooting es1024 (es5 eqiad primary) for kernel upgrade T273281 |
[production] |
14:11 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:30:00 on es2023.codfw.wmnet,es[1023-1025].eqiad.wmnet with reason: Rebooting es1024 (es5 eqiad primary) for kernel upgrade T273281 |
[production] |
14:10 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw1301.eqiad.wmnet |
[production] |