5151-5200 of 10000 results (29ms)
2020-07-09 ยง
18:44 <mutante> stat1004, stat1006, stat1007 - upgrading git-review package from 1.25 to 1.27 so that it keeps working with new Gerrit 3.2 (T257609) [production]
18:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 9f2557f848e99facaa62ca6b3a948cc3e32c32a3: Updating config for Readers Web affinity quicksurvey (T246977) (duration: 01m 06s) [production]
17:42 <chaomodus> codfw frack management dns automation deployment complete T233183 [production]
17:37 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
17:36 <James_F> Synchronized wmf-config/CommonSettings.php: ExtensionDistribution: Drop REL1_33, EOL'ed T256087 [production]
17:35 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
17:35 <moritzm> rebooting moscovium for kernel update [production]
17:33 <chaomodus> deploying frack codfw management dns automation [production]
17:32 <crusnov@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:31 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
17:28 <crusnov@cumin2001> START - Cookbook sre.dns.netbox [production]
17:27 <moritzm> rebooting planet1002 (planet.wikimedia.org) for kernel update [production]
17:27 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
17:10 <krinkle@deploy1001> Synchronized wmf-config/: Ia2f5eddbf2aad2 (duration: 01m 04s) [production]
17:09 <krinkle@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Ia2f5eddbf2aad2 (duration: 01m 05s) [production]
15:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
15:29 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:29 <papaul> replacing msw-b1,b2,b3 and b4 [production]
14:03 <moritzm> installing libtirpc security updates [production]
13:45 <moritzm> installing gnutls28 security updates [production]
13:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1089', diff saved to https://phabricator.wikimedia.org/P11831 and previous config saved to /var/cache/conftool/dbconfig/20200709-133134-marostegui.json [production]
13:31 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:29 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:29 <moritzm> rebooting puppetboard1001 (puppetboard.wikimedia.org) for kernel update [production]
13:15 <moritzm> installing ffmpeg security updates [production]
13:11 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1089', diff saved to https://phabricator.wikimedia.org/P11830 and previous config saved to /var/cache/conftool/dbconfig/20200709-131039-marostegui.json [production]
13:08 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:07 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
13:05 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:00 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:58 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:57 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
12:57 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:56 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
12:56 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
12:54 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:54 <moritzm> rebooting install* servers for kernel security update [production]
12:43 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:40 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:40 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:38 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:38 <moritzm> rebooting urldownloader1001/2001 for kernel update (failed over, these are now the inactive ones) [production]
12:23 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) [production]
12:22 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
12:22 <moritzm> rebooting dbmonitor1001 / tendril.wikimedia.org for kernek update [production]
12:11 <XioNoX> enable asw2-b-eqiad:ae3 (to cloudsw1-c8) - T251632 [production]
11:56 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
11:54 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:52 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]