2301-2350 of 10000 results (30ms)
2025-09-22 ยง
20:30 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17927644810 [tools.cluebotng-trainer]
20:26 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1188799|SpecialContribute: configure new page target (T327063)]] [production]
20:25 <sbisson@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190328|eswiki, commonswiki, wikidata: lift IP cap for edit-a-thon (T405095)]] (duration: 11m 34s) [production]
20:20 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
20:19 <sbisson@deploy1003> sbisson, gergesshamon: Continuing with sync [production]
20:19 <sbisson@deploy1003> sbisson, gergesshamon: Backport for [[gerrit:1190328|eswiki, commonswiki, wikidata: lift IP cap for edit-a-thon (T405095)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:14 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
20:13 <sbisson@deploy1003> Started scap sync-world: Backport for [[gerrit:1190328|eswiki, commonswiki, wikidata: lift IP cap for edit-a-thon (T405095)]] [production]
20:08 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1026.eqiad.wmnet with OS bookworm [production]
19:43 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1026.eqiad.wmnet with reason: host reimage [production]
19:42 <jclark@cumin1002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd1025.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:40 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1026.eqiad.wmnet with reason: host reimage [production]
19:36 <jclark@cumin1002> START - Cookbook sre.hosts.provision for host cloudcephosd1025.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
19:29 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host cloudcephosd1025.eqiad.wmnet with OS bookworm [production]
19:23 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1026.eqiad.wmnet with OS bookworm [production]
19:23 <andrew@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcephosd1026.eqiad.wmnet with OS bookworm [production]
19:18 <kharlan@deploy1003> Finished scap sync-world: Backport for [[gerrit:1190319|PrefUpdateInstrumentation: Track PSI related preferences]] (duration: 17m 47s) [production]
19:13 <kharlan@deploy1003> kharlan: Continuing with sync [production]
19:12 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17925793114 [tools.cluebotng-review]
19:10 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17925753138 [tools.cluebotng-staging]
19:08 <wmbot~damian-scripts@tools-bastion-15> report deployed @ refs/tags/1.2.3 [tools.cluebotng]
19:06 <kharlan@deploy1003> kharlan: Backport for [[gerrit:1190319|PrefUpdateInstrumentation: Track PSI related preferences]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:04 <wmbot~damian-scripts@tools-bastion-15> report deployed @ refs/tags/1.2.2 [tools.cluebotng]
19:02 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17925536572 [tools.cluebotng-trainer]
19:02 <wmbot~damian-scripts@tools-bastion-15> report deployed @ refs/tags/1.2.1 [tools.cluebotng]
19:01 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17925551560 [tools.cluebotng-staging]
19:01 <kharlan@deploy1003> Started scap sync-world: Backport for [[gerrit:1190319|PrefUpdateInstrumentation: Track PSI related preferences]] [production]
18:50 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17925326118 [tools.cluebotng-staging]
18:23 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1026.eqiad.wmnet with OS bookworm [production]
18:22 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
18:16 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
18:15 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1024.eqiad.wmnet with OS bookworm [production]
18:08 <wmbot~damian-scripts@tools-bastion-15> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/17924276736 [tools.cluebotng-monitoring]
18:00 <andrew@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcephosd1025.eqiad.wmnet with OS bookworm [production]
17:58 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1024.eqiad.wmnet with reason: host reimage [production]
17:55 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1025.eqiad.wmnet with OS bookworm [production]
17:55 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1024.eqiad.wmnet with reason: host reimage [production]
17:38 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1024.eqiad.wmnet with OS bookworm [production]
17:37 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
17:36 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
17:36 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1023.eqiad.wmnet with OS bookworm [production]
17:24 <sfaci@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic-next: apply [production]
17:23 <sfaci@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic-next: apply [production]
17:18 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1023.eqiad.wmnet with reason: host reimage [production]
17:11 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1023.eqiad.wmnet with reason: host reimage [production]
16:54 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd1023.eqiad.wmnet with OS bookworm [production]
16:51 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) [admin]
16:50 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.reactivate [admin]
16:48 <andrew@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcephosd1025.eqiad.wmnet with OS bookworm [production]
16:47 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.reactivate (exit_code=99) [admin]