2024-08-06
ยง
|
14:38 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1286.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:37 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1291.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:37 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1287.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:37 |
<zabe@deploy1003> |
Finished scap: update interwiki cache (duration: 07m 10s) |
[production] |
14:36 |
<sukhe@cumin1002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp3081*} and A:cp for 9.2.5-1wm2 |
[production] |
14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1285.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1278.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1282.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1280.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1284.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1283.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1281.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1279.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1277.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1276.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:33 |
<sukhe@cumin1002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp3081*} and A:cp for 9.2.5-1wm2 |
[production] |
14:30 |
<zabe@deploy1003> |
Started scap sync-world: update interwiki cache |
[production] |
14:29 |
<ChrisDobbins901_> |
cdobbins@cumin1002:~$ sudo cumin 'A:cp' 'run-puppet-agent --enable "merging CR #1059123"' |
[production] |
14:29 |
<fnegri@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1020.eqiad.wmnet with reason: Reimaging clouddb1020 T365424 |
[production] |
14:28 |
<fnegri@cumin1002> |
START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1020.eqiad.wmnet with reason: Reimaging clouddb1020 T365424 |
[production] |
14:25 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=bdrwiki --cluster=all 2>&1 | tee /tmp/bdrwiki.UpdateSearchIndexConfig.log # T371757 |
[production] |
14:24 |
<zabe@deploy1003> |
Finished scap: Creating bdrwiki (T371757) (duration: 06m 43s) |
[production] |
14:23 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host vrts2002.codfw.wmnet with OS bookworm |
[production] |
14:23 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
14:23 |
<elukey> |
upgrade debmonitor-server on debmonitor[1,2]003 to version 0.5 - cp /var/cache/apt/archives/python3-debmonitor_0.4.0-3_all.deb . |
[production] |
14:21 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
14:21 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:21 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:20 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1272.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:20 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:19 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1274.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:18 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1270.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:18 |
<zabe@deploy1003> |
Started scap sync-world: Creating bdrwiki (T371757) |
[production] |
14:17 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1274.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1270.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1272.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<zabe> |
Create Wikipedia West Coast Bajau # T371757 |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1270.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1275.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1274.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:17 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1272.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:14 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
14:14 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ml-serve2009 to codfw - jhancock@cumin2002" |
[production] |
14:14 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ml-serve2009 to codfw - jhancock@cumin2002" |
[production] |
14:13 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1285.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:12 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1285.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:12 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1278.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
14:12 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1283.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |