801-850 of 10000 results (66ms)
2023-11-06 ยง
12:44 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-role for role: idm [production]
12:42 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: idm_test [production]
12:36 <jbond@cumin1001> START - Cookbook sre.puppet.migrate-role for role: idm_test [production]
12:20 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2010.codfw.wmnet with OS bookworm [production]
12:14 <moritzm> installing jetty9 security updates [production]
12:02 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2010.codfw.wmnet with reason: host reimage [production]
11:59 <jynus@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2010.codfw.wmnet with reason: host reimage [production]
11:40 <moritzm> installing openssl bugfix updates on Bullseye (update to 1.1.1w) [production]
11:38 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2193.codfw.wmnet with OS bookworm [production]
11:23 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2193.codfw.wmnet with reason: host reimage [production]
11:20 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2193.codfw.wmnet with reason: host reimage [production]
11:17 <jynus@cumin2002> START - Cookbook sre.hosts.reimage for host backup2010.codfw.wmnet with OS bookworm [production]
11:17 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on an-mariadb[1001-1002].eqiad.wmnet with reason: Commissioning new database servers [production]
11:16 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on an-mariadb[1001-1002].eqiad.wmnet with reason: Commissioning new database servers [production]
11:02 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2193.codfw.wmnet with OS bookworm [production]
11:01 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2192.codfw.wmnet with OS bookworm [production]
10:50 <hashar> Restarting Jenkins [production]
10:46 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2192.codfw.wmnet with reason: host reimage [production]
10:43 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2192.codfw.wmnet with reason: host reimage [production]
10:25 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2192.codfw.wmnet with OS bookworm [production]
10:24 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2191.codfw.wmnet with OS bookworm [production]
10:09 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2191.codfw.wmnet with reason: host reimage [production]
10:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db1136 in db1236 for T344036', diff saved to https://phabricator.wikimedia.org/P53140 and previous config saved to /var/cache/conftool/dbconfig/20231106-100625-arnaudb.json [production]
10:06 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2191.codfw.wmnet with reason: host reimage [production]
10:05 <arnaudb@cumin1001> START - Cookbook sre.mysql.clone of db1136.eqiad.wmnet onto db1236.eqiad.wmnet [production]
10:02 <arnaudb@cumin1001> dbctl commit (dc=all): 'Cloning db1136 in db1236 for T344036', diff saved to https://phabricator.wikimedia.org/P53139 and previous config saved to /var/cache/conftool/dbconfig/20231106-100213-arnaudb.json [production]
09:57 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1236.eqiad.wmnet with reason: provisionning db1236.eqiad.wmnet - T344036 [production]
09:56 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1236.eqiad.wmnet with reason: provisionning db1236.eqiad.wmnet - T344036 [production]
09:56 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: provisionning db1236.eqiad.wmnet - T344036 [production]
09:56 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1136.eqiad.wmnet with reason: provisionning db1236.eqiad.wmnet - T344036 [production]
09:48 <arnaudb@cumin1001> START - Cookbook sre.hosts.reimage for host db2191.codfw.wmnet with OS bookworm [production]
09:39 <zabe@deploy2002> Finished scap: update interwiki cache (duration: 06m 21s) [production]
09:38 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2190.codfw.wmnet with OS bookworm [production]
09:35 <moritzm> installing Tomcat security updates [production]
09:33 <zabe@deploy2002> Started scap: update interwiki cache [production]
09:31 <zabe@deploy2002> Finished scap: T350320 (duration: 06m 28s) [production]
09:26 <zabe@deploy2002> zabe: Continuing with sync [production]
09:25 <zabe@deploy2002> zabe: T350320 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:24 <zabe@deploy2002> Started scap: T350320 [production]
09:24 <moritzm> installing openjdk-11 security updates [production]
09:24 <zabe> Toba Batak Wikipedia # T350320 [production]
09:22 <zabe@deploy2002> Finished scap: T350218 (duration: 07m 04s) [production]
09:21 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2190.codfw.wmnet with reason: host reimage [production]
09:18 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2190.codfw.wmnet with reason: host reimage [production]
09:17 <zabe@deploy2002> zabe: Continuing with sync [production]
09:16 <zabe@deploy2002> zabe: T350218 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:15 <zabe@deploy2002> Started scap: T350218 [production]
09:15 <zabe> create Dagaare Wikipedia # T350218 [production]
09:13 <zabe@deploy2002> Finished scap: T350216 (duration: 07m 15s) [production]
09:10 <moritzm> importing openjdk-8 8u392-ga-1~deb11u1 for bullseye-wikimedia to apt.wikimedia.org (latest Java 8 security fixes) [production]