|
2024-08-06
ยง
|
| 14:55 |
<sukhe@cumin1002> |
conftool action : set/pooled=yes; selector: name=dns7002.wikimedia.org [reason: [done] anycast-healthchecker 0.9.8 upgrade] |
[production] |
| 14:53 |
<sukhe@cumin1002> |
conftool action : set/pooled=no; selector: name=dns7002.wikimedia.org [reason: anycast-healthchecker 0.9.8 upgrade] |
[production] |
| 14:53 |
<sukhe@cumin1002> |
conftool action : set/pooled=no; selector: name=dns7002.wikimedia.org,service=recdns [reason: anycast-healthchecker 0.9.8 upgrade] |
[production] |
| 14:44 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1296.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:44 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:44 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1270.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:43 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1272.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:43 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1274.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:43 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1275.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:41 |
<_joe_> |
repool cp4044 |
[production] |
| 14:39 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1295.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:39 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1294.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:39 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1293.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:39 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1292.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:39 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1290.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:38 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1289.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:38 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1288.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:38 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1286.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:37 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1291.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:37 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1287.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:37 |
<zabe@deploy1003> |
Finished scap: update interwiki cache (duration: 07m 10s) |
[production] |
| 14:36 |
<sukhe@cumin1002> |
END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp3081*} and A:cp for 9.2.5-1wm2 |
[production] |
| 14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1285.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1278.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:35 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1282.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1280.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1284.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1283.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1281.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1279.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1277.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:34 |
<jclark@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1276.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:33 |
<sukhe@cumin1002> |
START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp3081*} and A:cp for 9.2.5-1wm2 |
[production] |
| 14:30 |
<zabe@deploy1003> |
Started scap sync-world: update interwiki cache |
[production] |
| 14:29 |
<ChrisDobbins901_> |
cdobbins@cumin1002:~$ sudo cumin 'A:cp' 'run-puppet-agent --enable "merging CR #1059123"' |
[production] |
| 14:29 |
<fnegri@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb1020.eqiad.wmnet with reason: Reimaging clouddb1020 T365424 |
[production] |
| 14:28 |
<fnegri@cumin1002> |
START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb1020.eqiad.wmnet with reason: Reimaging clouddb1020 T365424 |
[production] |
| 14:25 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=bdrwiki --cluster=all 2>&1 | tee /tmp/bdrwiki.UpdateSearchIndexConfig.log # T371757 |
[production] |
| 14:24 |
<zabe@deploy1003> |
Finished scap: Creating bdrwiki (T371757) (duration: 06m 43s) |
[production] |
| 14:23 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host vrts2002.codfw.wmnet with OS bookworm |
[production] |
| 14:23 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 14:23 |
<elukey> |
upgrade debmonitor-server on debmonitor[1,2]003 to version 0.5 - cp /var/cache/apt/archives/python3-debmonitor_0.4.0-3_all.deb . |
[production] |
| 14:21 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" |
[production] |
| 14:21 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:21 |
<jclark@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:20 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1272.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:20 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:19 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1274.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:18 |
<jclark@cumin1002> |
START - Cookbook sre.hosts.provision for host wikikube-worker1270.mgmt.eqiad.wmnet with reboot policy FORCED |
[production] |
| 14:18 |
<zabe@deploy1003> |
Started scap sync-world: Creating bdrwiki (T371757) |
[production] |