1101-1150 of 10000 results (29ms)
2021-01-14 §
14:24 <arturo> running homer in asw-b-codfw* (T271519) [production]
14:10 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.26 [production]
14:07 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:06 <jmm@cumin2001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
14:06 <hashar@deploy1001> Synchronized php-1.36.0-wmf.26/skins/CologneBlue/includes/CologneBlueHooks.php: Edit link may not be present, avoid undefined index notice T271978 (duration: 01m 07s) [production]
13:56 <aborrero@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
13:47 <marostegui> Restart mysql on db2094 for openssl upgrades test [production]
13:42 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
13:23 <moritzm> restarting mw canaries for openssl update [production]
13:22 <jmm@cumin2001> START - Cookbook sre.ganeti.makevm [production]
13:22 <aborrero@cumin2001> START - Cookbook sre.dns.netbox [production]
13:17 <moritzm> installing openssl1.0 security updates on stretch [production]
13:15 <jmm@cumin2001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
13:11 <moritzm> installing xerces-c security updates on stretch [production]
12:50 <volans> upgraded python3-pynetbox to 5.3.0-1 on all affected hosts - T266487 [production]
12:49 <jmm@cumin2001> START - Cookbook sre.ganeti.makevm [production]
12:47 <aborrero@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
12:34 <jmm@cumin2001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
12:34 <jmm@cumin2001> START - Cookbook sre.ganeti.makevm [production]
12:33 <aborrero@cumin2001> START - Cookbook sre.hosts.decommission [production]
12:29 <aborrero@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
12:29 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-presto1004.eqiad.wmnet with reason: REIMAGE [production]
12:27 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-presto1004.eqiad.wmnet with reason: REIMAGE [production]
12:24 <XioNoX> push pfw3 firewall rules - T271935 [production]
12:16 <volans> upgraded python3-pynetbox to 5.3.0-1 on cumin2001 [production]
12:16 <aborrero@cumin2001> START - Cookbook sre.hosts.decommission [production]
12:14 <elukey@cumin1001> END (ERROR) - Cookbook sre.presto.reboot-workers (exit_code=97) for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
12:14 <volans> built and uploaded python3-pynetbox 5.3.0-1 to apt.wikimedia.org - T266487 [production]
12:10 <awight> EU config window finished. [production]
12:09 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:656116|Remove unused WMDE TeWü QuickSurveys (T253112, T272013)]] (duration: 01m 07s) [production]
12:04 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
12:02 <moritzm> rebooting miscweb1002 [production]
12:02 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:53 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
11:49 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:48 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
11:44 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:43 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) [production]
11:43 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:39 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
11:34 <oblivian@deploy1001> Finished deploy [docker-pkg/deploy@4164318]: (no justification provided) (duration: 30m 34s) [production]
11:34 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
11:22 <elukey@cumin1001> START - Cookbook sre.presto.reboot-workers for Presto analytics cluster: Reboot Presto nodes - elukey@cumin1001 [production]
11:17 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
11:04 <oblivian@deploy1001> Started deploy [docker-pkg/deploy@4164318]: (no justification provided) [production]
11:04 <oblivian@deploy1001> deploy aborted: (no justification provided) (duration: 00m 14s) [production]
11:03 <oblivian@deploy1001> Started deploy [docker-pkg/deploy@4164318]: (no justification provided) [production]
11:01 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
10:42 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
10:36 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single [production]