|
2020-07-09
ยง
|
| 21:52 |
<tgr> |
all sessions have been invalidated due to T256395 |
[production] |
| 20:58 |
<eileen> |
https://phabricator.wikimedia.org/T253152 |
[production] |
| 19:16 |
<herron> |
upgraded eqiad elk7 cluster from 7.4.2 to 7.8.0 T234854 |
[production] |
| 19:05 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.40 refs T256668 |
[production] |
| 18:51 |
<elukey> |
update spark2 to 2.4.4-bin-hadoop2.6-3 for buster-wikimedia |
[production] |
| 18:44 |
<mutante> |
stat1004, stat1006, stat1007 - upgrading git-review package from 1.25 to 1.27 so that it keeps working with new Gerrit 3.2 (T257609) |
[production] |
| 18:10 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 9f2557f848e99facaa62ca6b3a948cc3e32c32a3: Updating config for Readers Web affinity quicksurvey (T246977) (duration: 01m 06s) |
[production] |
| 17:42 |
<chaomodus> |
codfw frack management dns automation deployment complete T233183 |
[production] |
| 17:37 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 17:36 |
<James_F> |
Synchronized wmf-config/CommonSettings.php: ExtensionDistribution: Drop REL1_33, EOL'ed T256087 |
[production] |
| 17:35 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 17:35 |
<moritzm> |
rebooting moscovium for kernel update |
[production] |
| 17:33 |
<chaomodus> |
deploying frack codfw management dns automation |
[production] |
| 17:32 |
<crusnov@cumin2001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 17:31 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 17:28 |
<crusnov@cumin2001> |
START - Cookbook sre.dns.netbox |
[production] |
| 17:27 |
<moritzm> |
rebooting planet1002 (planet.wikimedia.org) for kernel update |
[production] |
| 17:27 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 17:10 |
<krinkle@deploy1001> |
Synchronized wmf-config/: Ia2f5eddbf2aad2 (duration: 01m 04s) |
[production] |
| 17:09 |
<krinkle@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Ia2f5eddbf2aad2 (duration: 01m 05s) |
[production] |
| 15:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 15:29 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:29 |
<papaul> |
replacing msw-b1,b2,b3 and b4 |
[production] |
| 14:03 |
<moritzm> |
installing libtirpc security updates |
[production] |
| 13:45 |
<moritzm> |
installing gnutls28 security updates |
[production] |
| 13:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1089', diff saved to https://phabricator.wikimedia.org/P11831 and previous config saved to /var/cache/conftool/dbconfig/20200709-133134-marostegui.json |
[production] |
| 13:31 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 13:29 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 13:29 |
<moritzm> |
rebooting puppetboard1001 (puppetboard.wikimedia.org) for kernel update |
[production] |
| 13:15 |
<moritzm> |
installing ffmpeg security updates |
[production] |
| 13:11 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 13:10 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1089', diff saved to https://phabricator.wikimedia.org/P11830 and previous config saved to /var/cache/conftool/dbconfig/20200709-131039-marostegui.json |
[production] |
| 13:08 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 13:07 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 13:05 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 13:00 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:58 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:57 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'proton' for release 'production' . |
[production] |
| 12:57 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:56 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'proton' for release 'production' . |
[production] |
| 12:56 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'proton' for release 'production' . |
[production] |
| 12:54 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:54 |
<moritzm> |
rebooting install* servers for kernel security update |
[production] |
| 12:43 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:40 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:40 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:38 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:38 |
<moritzm> |
rebooting urldownloader1001/2001 for kernel update (failed over, these are now the inactive ones) |
[production] |
| 12:23 |
<jmm@cumin2001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) |
[production] |
| 12:22 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |