2024-02-12
ยง
|
14:13 |
<logmsgbot> |
lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and hubaishan: Continuing with sync |
[production] |
14:12 |
<logmsgbot> |
lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and hubaishan: Backport for [[gerrit:1000601|Set $wgMinervaEnableSiteNotice for arwikisource (T356460)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
14:10 |
<logmsgbot> |
lucaswerkmeister-wmde@deploy2002 Started scap: Backport for [[gerrit:1000601|Set $wgMinervaEnableSiteNotice for arwikisource (T356460)]] |
[production] |
14:02 |
<ladsgroup@deploy2002> |
Finished scap: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] (duration: 23m 12s) |
[production] |
13:57 |
<taavi@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol2005-dev.codfw.wmnet |
[production] |
13:55 |
<ladsgroup@deploy2002> |
ladsgroup: Continuing with sync |
[production] |
13:49 |
<ladsgroup@deploy2002> |
ladsgroup: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
13:44 |
<taavi@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host cloudcontrol2005-dev.codfw.wmnet |
[production] |
13:44 |
<taavi@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol2004-dev.codfw.wmnet |
[production] |
13:39 |
<ladsgroup@deploy2002> |
Started scap: Backport for [[gerrit:999084|Stop writing to old pagelinks schema in s4 (T352010)]] |
[production] |
13:35 |
<arnaudb@cumin1002> |
START - Cookbook sre.mysql.clone Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:34 |
<arnaudb@cumin1002> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:34 |
<arnaudb@cumin1002> |
START - Cookbook sre.mysql.clone Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:32 |
<arnaudb@cumin1002> |
END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:31 |
<arnaudb@cumin1002> |
START - Cookbook sre.mysql.clone Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:27 |
<taavi@cumin1002> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudcontrol2001-dev.codfw.wmnet |
[production] |
13:21 |
<arnaudb@cumin1002> |
END (PASS) - Cookbook sre.mysql.clone (exit_code=0) Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
13:21 |
<arnaudb@cumin1002> |
START - Cookbook sre.mysql.clone Will create a clone of db2180.codfw.wmnet onto db2194.codfw.wmnet |
[production] |
12:55 |
<taavi@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host cloudcontrol2001-dev.codfw.wmnet |
[production] |
12:52 |
<taavi@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1002-dev.eqiad.wmnet |
[production] |
12:48 |
<taavi@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host cloudbackup1002-dev.eqiad.wmnet |
[production] |
12:47 |
<taavi@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudbackup1001-dev.eqiad.wmnet |
[production] |
12:43 |
<taavi@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host cloudbackup1001-dev.eqiad.wmnet |
[production] |
12:33 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
12:33 |
<brouberol@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply |
[production] |
12:19 |
<brouberol@cumin1002> |
END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for stat1005.eqiad.wmnet: Renew puppet certificate - brouberol@cumin1002 |
[production] |
12:17 |
<brouberol@cumin1002> |
START - Cookbook sre.puppet.renew-cert for stat1005.eqiad.wmnet: Renew puppet certificate - brouberol@cumin1002 |
[production] |
12:14 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host restbase1035.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
12:14 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1040.eqiad.wmnet with OS bullseye |
[production] |
12:14 |
<isaranto@deploy2002> |
helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
12:14 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:14 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1034.eqiad.wmnet with OS bullseye |
[production] |
12:14 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:14 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1037.eqiad.wmnet with OS bullseye |
[production] |
12:14 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:14 |
<isaranto@deploy2002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . |
[production] |
12:13 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1038.eqiad.wmnet with OS bullseye |
[production] |
12:13 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:13 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1039.eqiad.wmnet with OS bullseye |
[production] |
12:13 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:13 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1041.eqiad.wmnet with OS bullseye |
[production] |
12:13 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:13 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase1042.eqiad.wmnet with OS bullseye |
[production] |
12:13 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" |
[production] |
12:04 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 36236 |
[production] |
12:02 |
<ayounsi@cumin1002> |
START - Cookbook sre.network.peering with action 'configure' for AS: 36236 |
[production] |
12:01 |
<taavi> |
taavi@gerrit1003 ~ $ sudo systemctl restart apache2 |
[production] |
11:48 |
<Lucas_WMDE> |
START lucaswerkmeister-wmde@mwmaint2002:~$ mwscript extensions/DiscussionTools/maintenance/persistRevisionThreadItems.php --wiki frwiki --current --all --touched-after=20230613000000 --start '["7544396"]' 2>&1 | tee ~/T315510-frwiki # in tmux |
[production] |
11:46 |
<Lucas_WMDE> |
START lucaswerkmeister-wmde@mwmaint2002:~$ mwscript extensions/DiscussionTools/maintenance/persistRevisionThreadItems.php --wiki viwiki --current --all --touched-after=20230613000000 2>&1 | tee ~/T315510-viwiki # in tmux |
[production] |
10:20 |
<ayounsi@cumin1002> |
END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 138881 |
[production] |