|
2024-09-20
ยง
|
| 17:18 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding logging-hd2004 to codfw - jhancock@cumin2002" |
[production] |
| 17:13 |
<jhancock@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 17:06 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 17:05 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/pod2daemon-flexvol:v3.28.2 (T359641) |
[tools] |
| 17:05 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 17:04 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 17:04 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/typha:v3.28.2 (T359641) |
[tools] |
| 17:04 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 17:04 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 17:03 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/node:v3.28.2 (T359641) |
[tools] |
| 17:03 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 17:02 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 17:02 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/kube-controllers:v3.28.2 (T359641) |
[tools] |
| 17:02 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 16:59 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 16:59 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/ctl:v3.28.2 (T359641) |
[tools] |
| 16:59 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 16:57 |
<raymond-ndibe@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T359641) |
[tools] |
| 16:56 |
<raymond-ndibe@cloudcumin1001> |
Updating container image docker-registry.tools.wmflabs.org/calico/cni:v3.28.2 (T359641) |
[tools] |
| 16:56 |
<raymond-ndibe@cloudcumin1001> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 16:54 |
<wmbot~raymondndibe@wmf3402> |
Updating container image docker-registry.tools.wmflabs.org/calico/cni:v3.28.2 (T359641) |
[tools] |
| 16:54 |
<wmbot~raymondndibe@wmf3402> |
START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T359641) |
[tools] |
| 16:54 |
<dancy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1074426 |
[releng] |
| 16:03 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=wikidatawiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 16:02 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=metawiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 16:02 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=loginwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 16:02 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=frwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 16:01 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 16:01 |
<xSavitar> |
T375261 Ran mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=metawiki 'Abderazack Ahmat Annour' 'Renamed user 5dcfa1a90396fed431e188c9cbe5af6a' |
[production] |
| 14:20 |
<Dreamy_Jazz> |
Finished running`foreachwiki maintenance/fixAutoblockLogTitles.php` on a tmux session for T373929 |
[production] |
| 14:08 |
<Dreamy_Jazz> |
Running `foreachwiki maintenance/fixAutoblockLogTitles.php` on a tmux session for T373929 |
[production] |
| 14:04 |
<kcvelaga@deploy1003> |
Finished deploy [airflow-dags/analytics_product@6010568]: automoderator config dag T375062 (duration: 01m 47s) |
[production] |
| 14:03 |
<kcvelaga@deploy1003> |
Started deploy [airflow-dags/analytics_product@6010568]: automoderator config dag T375062 |
[production] |
| 13:20 |
<moritzm> |
uploaded debmonitor-client 0.4.0-3 for buster/bullseye/bookworm to apt.wikimedia.org T216832 |
[production] |
| 13:09 |
<jiji@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 13:09 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 12:45 |
<jiji@cumin1002> |
END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:38 |
<jiji@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 12:37 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 12:36 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:24 |
<jiji@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:18 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:16 |
<jiji@cumin1002> |
END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:11 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.provision for host mw2424.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTARTand with Dell SCP reboot policy GRACEFUL |
[production] |
| 12:07 |
<jiji@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 12:07 |
<jiji@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw2425.codfw.wmnet with reason: reimage |
[production] |
| 11:58 |
<jiji@cumin1002> |
END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2424.codfw.wmnet |
[production] |
| 11:57 |
<jiji@cumin1002> |
START - Cookbook sre.k8s.pool-depool-node depool for host mw2424.codfw.wmnet |
[production] |
| 11:46 |
<cgoubert@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on wikikube-worker2092.codfw.wmnet with reason: Degraded RAID |
[production] |
| 11:46 |
<cgoubert@cumin1002> |
START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on wikikube-worker2092.codfw.wmnet with reason: Degraded RAID |
[production] |