|
2026-05-19
ยง
|
| 19:42 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1151-1154].eqiad.wmnet |
[production] |
| 19:41 |
<tchin@deploy1003> |
Finished deploy [analytics/refinery@eeef7f3] (thin): Redeploy v0.3.14 THIN [analytics/refinery@eeef7f3d] (duration: 02m 07s) |
[production] |
| 19:41 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp701[1-2].magru.wmnet} and A:cp |
[production] |
| 19:41 |
<otto@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1289408|BugFix: Emit page_change at version 1.6.0 to pick up user wiki_id (T426198)]] |
[production] |
| 19:40 |
<brett@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host pybal-test2003.codfw.wmnet |
[production] |
| 19:39 |
<tchin@deploy1003> |
Started deploy [analytics/refinery@eeef7f3] (thin): Redeploy v0.3.14 THIN [analytics/refinery@eeef7f3d] |
[production] |
| 19:39 |
<tchin@deploy1003> |
Finished deploy [analytics/refinery@eeef7f3]: Redeploy v0.3.14 [analytics/refinery@eeef7f3d] (duration: 04m 35s) |
[production] |
| 19:34 |
<tchin@deploy1003> |
Started deploy [analytics/refinery@eeef7f3]: Redeploy v0.3.14 [analytics/refinery@eeef7f3d] |
[production] |
| 19:33 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gitlab1003.wikimedia.org |
[production] |
| 19:32 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp7010.magru.wmnet} and A:cp |
[production] |
| 19:32 |
<brett@cumin2002> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7010.magru.wmnet |
[production] |
| 19:32 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp7002.magru.wmnet} and A:cp |
[production] |
| 19:32 |
<brett@cumin2002> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7002.magru.wmnet |
[production] |
| 19:32 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1151-1154].eqiad.wmnet |
[production] |
| 19:30 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1151-1154].eqiad.wmnet |
[production] |
| 19:30 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1147-1150].eqiad.wmnet |
[production] |
| 19:30 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1147-1150].eqiad.wmnet |
[production] |
| 19:28 |
<tchin@deploy1003> |
Finished deploy [analytics/refinery@eeef7f3] (hadoop-test): ReHotfix Hadoop-test analytics/refinery@eeef7f3d] (duration: 02m 00s) |
[production] |
| 19:26 |
<tchin@deploy1003> |
Started deploy [analytics/refinery@eeef7f3] (hadoop-test): ReHotfix Hadoop-test analytics/refinery@eeef7f3d] |
[production] |
| 19:25 |
<mutante> |
rebooting gitlab-replica-a.wikimedia.org |
[production] |
| 19:25 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host gitlab1003.wikimedia.org |
[production] |
| 19:24 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gitlab1003.wikimedia.org with reason: T426563 |
[production] |
| 19:23 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1147-1150].eqiad.wmnet |
[production] |
| 19:21 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1147-1150].eqiad.wmnet |
[production] |
| 19:21 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp7002.magru.wmnet} and A:cp |
[production] |
| 19:21 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp7010.magru.wmnet} and A:cp |
[production] |
| 19:21 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1143-1146].eqiad.wmnet |
[production] |
| 19:21 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1143-1146].eqiad.wmnet |
[production] |
| 19:14 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1143-1146].eqiad.wmnet |
[production] |
| 19:11 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1143-1146].eqiad.wmnet |
[production] |
| 19:11 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1139-1142].eqiad.wmnet |
[production] |
| 19:11 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1139-1142].eqiad.wmnet |
[production] |
| 19:06 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp7001.magru.wmnet,cp7009.magru.wmnet} and A:cp |
[production] |
| 19:06 |
<brett@cumin2002> |
cookbooks.sre.cdn.roll-reboot finished rebooting cp7009.magru.wmnet |
[production] |
| 19:04 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1139-1142].eqiad.wmnet |
[production] |
| 19:03 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-restart-reboot-ncredir rolling reboot on A:ncredir and not A:ncredir-magru and A:ncredir |
[production] |
| 19:02 |
<brett@cumin2002> |
END (ERROR) - Cookbook sre.cdn.roll-restart-reboot-ncredir (exit_code=97) rolling reboot on A:ncredir-magru and A:ncredir |
[production] |
| 19:02 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-restart-reboot-ncredir rolling reboot on A:ncredir-magru and A:ncredir |
[production] |
| 19:02 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1139-1142].eqiad.wmnet |
[production] |
| 19:02 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1135-1138].eqiad.wmnet |
[production] |
| 19:02 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1135-1138].eqiad.wmnet |
[production] |
| 18:55 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-restart-reboot-ncredir (exit_code=0) rolling reboot on A:ncredir-magru and A:ncredir |
[production] |
| 18:52 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1135-1138].eqiad.wmnet |
[production] |
| 18:50 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-codfw |
[production] |
| 18:50 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1135-1138].eqiad.wmnet |
[production] |
| 18:50 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1131-1134].eqiad.wmnet |
[production] |
| 18:50 |
<jiji@cumin1003> |
START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1131-1134].eqiad.wmnet |
[production] |
| 18:48 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'P{O:wmcs::openstack::eqiad1::virt_ceph} AND NOT P{F:kernelversion = 6.12.88}' |
[admin] |
| 18:45 |
<brett@cumin2002> |
START - Cookbook sre.cdn.roll-restart-reboot-ncredir rolling reboot on A:ncredir-magru and A:ncredir |
[production] |
| 18:43 |
<jiji@cumin1003> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1131-1134].eqiad.wmnet |
[production] |