401-450 of 10000 results (29ms)
2025-05-13 ยง
09:49 <moritzm> installing wget security updates [production]
09:47 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component builds-api [toolsbeta]
09:44 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1019.eqiad.wmnet [production]
09:41 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1019.eqiad.wmnet [production]
09:38 <moritzm> imported confd 0.16.0-1+deb13u0 to trixie-wikimedia T391083 [production]
09:14 <moritzm> installing nginx security updates [production]
09:11 <jnuche@deploy1003> Started scap sync-world: testwikis to 1.45.0-wmf.1 refs T392171 [production]
09:11 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1020.eqiad.wmnet [production]
09:08 <vgutierrez@cumin1002> START - Cookbook sre.hosts.reboot-single for host lvs1020.eqiad.wmnet [production]
09:00 <vgutierrez> rolling reboot of eqiad load balancers to add E8/F8 interfaces - T393911 | T382017 [production]
08:52 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1145101|expanddblist: Add missing use statement (T393992)]] (duration: 11m 48s) [production]
08:45 <zabe@deploy1003> zabe: Continuing with sync [production]
08:45 <zabe@deploy1003> zabe: Backport for [[gerrit:1145101|expanddblist: Add missing use statement (T393992)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:40 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1145101|expanddblist: Add missing use statement (T393992)]] [production]
08:35 <godog> bounce thanos-query on titan1* [production]
08:34 <XioNoX> pfw1-eqiad - delete specific system-services in favor of "any-service" T390052 [production]
08:31 <XioNoX> pfw1-codfw - delete specific system-services in favor of "any-service" T390052 [production]
08:23 <hashar> Update jobs to mute checks for npm packaging files | https://gerrit.wikimedia.org/r/c/integration/config/+/1145087/ | T393847 [releng]
08:21 <ayounsi@cumin1002> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 3856 [production]
08:12 <moritzm> copied prometheus-rsyslog-exporter 1.0.0+git20221110-1 from bookworm-wikimedia to trixie-wikimedia T391083 [production]
08:11 <ayounsi@cumin1002> START - Cookbook sre.network.peering with action 'email' for AS: 3856 [production]
08:04 <moritzm> imported python-wmflib 1.3.1+deb13u1 to trixie-wikimedia T391083 [production]
07:55 <XioNoX> delete all unterminated cables - T393188 [production]
07:54 <moritzm> imported python-wmflib 1.3.1+deb13u1 to trixie-wikimedia T391083 [production]
07:52 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
07:43 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-36 [tools]
07:41 <taavi> rebuild with latest buildpack versions [tools.openstack-browser]
07:38 <ayounsi@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
07:37 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-36 [tools]
07:37 <taavi@cloudcumin1001> END (ERROR) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=97) for tools-k8s-worker-nfs-36 [tools]
07:35 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
07:35 <ayounsi@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
07:34 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-36 [tools]
07:31 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
07:31 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P75987 and previous config saved to /var/cache/conftool/dbconfig/20250513-073145-root.json [production]
07:31 <ayounsi@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
07:29 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 100%: Repooling', diff saved to https://phabricator.wikimedia.org/P75986 and previous config saved to /var/cache/conftool/dbconfig/20250513-072956-root.json [production]
07:16 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P75985 and previous config saved to /var/cache/conftool/dbconfig/20250513-071639-root.json [production]
07:14 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P75984 and previous config saved to /var/cache/conftool/dbconfig/20250513-071451-root.json [production]
07:01 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 60%: Repooling', diff saved to https://phabricator.wikimedia.org/P75983 and previous config saved to /var/cache/conftool/dbconfig/20250513-070135-root.json [production]
06:59 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 60%: Repooling', diff saved to https://phabricator.wikimedia.org/P75982 and previous config saved to /var/cache/conftool/dbconfig/20250513-065946-root.json [production]
06:46 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P75981 and previous config saved to /var/cache/conftool/dbconfig/20250513-064629-root.json [production]
06:44 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P75980 and previous config saved to /var/cache/conftool/dbconfig/20250513-064440-root.json [production]
06:31 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P75979 and previous config saved to /var/cache/conftool/dbconfig/20250513-063123-root.json [production]
06:29 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 40%: Repooling', diff saved to https://phabricator.wikimedia.org/P75978 and previous config saved to /var/cache/conftool/dbconfig/20250513-062935-root.json [production]
06:16 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P75977 and previous config saved to /var/cache/conftool/dbconfig/20250513-061618-root.json [production]
06:14 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 30%: Repooling', diff saved to https://phabricator.wikimedia.org/P75976 and previous config saved to /var/cache/conftool/dbconfig/20250513-061430-root.json [production]
06:01 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P75975 and previous config saved to /var/cache/conftool/dbconfig/20250513-060113-root.json [production]
05:59 <marostegui@cumin1002> dbctl commit (dc=all): 'es1031 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P75974 and previous config saved to /var/cache/conftool/dbconfig/20250513-055924-root.json [production]
05:46 <marostegui@cumin1002> dbctl commit (dc=all): 'es2029 (re)pooling @ 20%: Repooling', diff saved to https://phabricator.wikimedia.org/P75973 and previous config saved to /var/cache/conftool/dbconfig/20250513-054607-root.json [production]