|
2024-04-12
ยง
|
| 10:11 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component envvars-admission |
[toolsbeta] |
| 10:10 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component envvars-admission |
[toolsbeta] |
| 09:58 |
<urbanecm> |
mwmaint1002: mwscript extensions/GrowthExperiments/maintenance/fixLinkRecommendationData.php --wiki=eswiki --search-index (T362367) |
[production] |
| 09:36 |
<moritzm> |
installing postgresql-common bugfix updates from Bullseye point release |
[production] |
| 09:35 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component volume-admission |
[tools] |
| 09:34 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component volume-admission |
[tools] |
| 09:31 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component volume-admission |
[toolsbeta] |
| 09:31 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component volume-admission |
[toolsbeta] |
| 09:30 |
<wmbot~dcaro@urcuchillay> |
END (FAIL) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=99) for component volume-admisison |
[toolsbeta] |
| 09:30 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component volume-admisison |
[toolsbeta] |
| 09:27 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component envvars-api |
[tools] |
| 09:27 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component envvars-api |
[tools] |
| 09:26 |
<moritzm> |
installing debootstrap bugfix updates from Bullseye point release |
[production] |
| 09:25 |
<btullis@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on matomo1003.eqiad.wmnet with reason: Still in setup |
[production] |
| 09:25 |
<btullis@cumin1002> |
START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on matomo1003.eqiad.wmnet with reason: Still in setup |
[production] |
| 09:24 |
<wmbot~dcaro@urcuchillay> |
END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component envvars-api |
[toolsbeta] |
| 09:23 |
<wmbot~dcaro@urcuchillay> |
START - Cookbook wmcs.toolforge.k8s.component.deploy for component envvars-api |
[toolsbeta] |
| 08:56 |
<jelto@cumin1002> |
START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab to new version |
[production] |
| 07:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P60461 and previous config saved to /var/cache/conftool/dbconfig/20240412-072435-root.json |
[production] |
| 07:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P60460 and previous config saved to /var/cache/conftool/dbconfig/20240412-070930-root.json |
[production] |
| 06:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P60459 and previous config saved to /var/cache/conftool/dbconfig/20240412-065424-root.json |
[production] |
| 06:39 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P60458 and previous config saved to /var/cache/conftool/dbconfig/20240412-063918-root.json |
[production] |
| 06:24 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P60457 and previous config saved to /var/cache/conftool/dbconfig/20240412-062412-root.json |
[production] |
| 06:09 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P60456 and previous config saved to /var/cache/conftool/dbconfig/20240412-060907-root.json |
[production] |
| 05:56 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2109.codfw.wmnet with OS bookworm |
[production] |
| 05:54 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'db2109 (re)pooling @ 1%: Repooling', diff saved to https://phabricator.wikimedia.org/P60455 and previous config saved to /var/cache/conftool/dbconfig/20240412-055401-root.json |
[production] |
| 05:35 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2109.codfw.wmnet with reason: host reimage |
[production] |
| 05:33 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db2109.codfw.wmnet with reason: host reimage |
[production] |
| 05:23 |
<moritzm> |
prune obsolete nginx debs on apt-staging after switch to new nginx provider scheme T329529 |
[production] |
| 05:17 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.reimage for host db2109.codfw.wmnet with OS bookworm |
[production] |
| 05:16 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depool db2109', diff saved to https://phabricator.wikimedia.org/P60454 and previous config saved to /var/cache/conftool/dbconfig/20240412-051606-root.json |
[production] |
| 05:01 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=0) |
[toolsbeta] |
| 04:51 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 04:48 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) |
[toolsbeta] |
| 04:48 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 04:47 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) |
[toolsbeta] |
| 04:46 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 04:46 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) |
[toolsbeta] |
| 04:37 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 04:35 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=0) |
[toolsbeta] |
| 04:22 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 03:37 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) |
[toolsbeta] |
| 03:36 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |
| 03:33 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Depooling db1249 (T356166)', diff saved to https://phabricator.wikimedia.org/P60453 and previous config saved to /var/cache/conftool/dbconfig/20240412-033317-marostegui.json |
[production] |
| 03:33 |
<marostegui@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1249.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:32 |
<marostegui@cumin1002> |
START - Cookbook sre.hosts.downtime for 12:00:00 on db1249.eqiad.wmnet with reason: Maintenance |
[production] |
| 03:32 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1248 (T356166)', diff saved to https://phabricator.wikimedia.org/P60452 and previous config saved to /var/cache/conftool/dbconfig/20240412-033254-marostegui.json |
[production] |
| 03:17 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1248', diff saved to https://phabricator.wikimedia.org/P60451 and previous config saved to /var/cache/conftool/dbconfig/20240412-031744-marostegui.json |
[production] |
| 03:17 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.toolforge.remove_k8s_etcd_node (exit_code=99) |
[toolsbeta] |
| 03:06 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.toolforge.remove_k8s_etcd_node |
[toolsbeta] |