1051-1100 of 10000 results (102ms)
2024-10-29 ยง
11:09 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-lab1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:09 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve1011.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:09 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-serve1011.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:07 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve1010.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:07 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-serve1010.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:05 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:05 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ml-serve1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:02 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
11:01 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:59 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti2044.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:59 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2043.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:58 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti2043.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:53 <elukey@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2042.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:52 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
10:50 <elukey@cumin2002> START - Cookbook sre.hosts.provision for host ganeti2042.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
10:14 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2015.codfw.wmnet [production]
10:08 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
10:07 <stevemunene@cumin1002> START - Cookbook sre.hosts.reimage for host an-presto1016.eqiad.wmnet with OS bullseye [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2015.codfw.wmnet [production]
10:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2015.codfw.wmnet [production]
09:56 <moritzm> installing wireshark security updates [production]
09:41 <kostajh> UTC morning deploys done [production]
09:23 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:23 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:22 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:21 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:20 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1083890|temp accounts: Enable temp account autocreation on five pilot wikis (T378334)]], [[gerrit:1083836|beta: enable "Surfacing structured tasks" for an early beta-wiki (T376677)]] (duration: 24m 42s) [production]
09:20 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:20 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:16 <kharlan@deploy2002> migr, kharlan: Continuing with sync [production]
09:13 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: maintenance, host is not pooled [production]
09:13 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: maintenance, host is not pooled [production]
09:07 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
09:07 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
08:58 <kharlan@deploy2002> migr, kharlan: Backport for [[gerrit:1083890|temp accounts: Enable temp account autocreation on five pilot wikis (T378334)]], [[gerrit:1083836|beta: enable "Surfacing structured tasks" for an early beta-wiki (T376677)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:56 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1083890|temp accounts: Enable temp account autocreation on five pilot wikis (T378334)]], [[gerrit:1083836|beta: enable "Surfacing structured tasks" for an early beta-wiki (T376677)]] [production]
08:55 <moritzm> upgrade irc.wikimedia.org to ircstream 1.0+wmf12u1 T376014 [production]
08:55 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1169 (re)pooling @ 100%: T378320', diff saved to https://phabricator.wikimedia.org/P70604 and previous config saved to /var/cache/conftool/dbconfig/20241029-085507-arnaudb.json [production]
08:53 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1084027|Unblock CI (T377947)]], [[gerrit:1083967|StatsLib: Set label for wiki ID (T375496)]] (duration: 13m 06s) [production]
08:52 <arnaudb@cumin1002> END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
08:52 <arnaudb@cumin1002> START - Cookbook sre.mysql.clone of db2211.codfw.wmnet onto db2223.codfw.wmnet [production]
08:51 <moritzm> uploaded ircstream 1.0+wmf12u1 to apt.wikimedia.org T376014 [production]
08:49 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 56258 [production]
08:48 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 56258 [production]
08:47 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 264567 [production]
08:47 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 264567 [production]
08:47 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 16591 [production]
08:46 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 16591 [production]
08:46 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 200478 [production]
08:46 <kharlan@deploy2002> kharlan: Continuing with sync [production]