101-150 of 10000 results (34ms)
2026-07-06 §
10:23 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply [production]
10:21 <elukey@cumin2002> START - Cookbook sre.hosts.reimage for host sretest1005.eqiad.wmnet with OS trixie [production]
10:20 <ozge@deploy1003> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
10:19 <ozge@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
10:17 <elukey> uploaded spicerack_13.0.0 to apt.wikimedia.org bookworm-wikimedia,trixie-wikimedia [production]
09:54 <ozge@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:52 <bwojtowicz@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:20 <elukey> upgrade all bullseye hosts to pywmflib 3.1 - T430552 [production]
09:10 <marostegui@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1015.eqiad.wmnet,service=s4 [production]
09:10 <marostegui@cumin1003> conftool action : set/pooled=yes; selector: name=clouddb1015.eqiad.wmnet,service=s6 [production]
09:07 <blake@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-pretrain: apply [production]
08:58 <bwojtowicz@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
08:56 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-pretrain: apply [production]
08:56 <blake@deploy1003> helmfile [codfw] START helmfile.d/services/mw-pretrain: apply [production]
08:28 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply [production]
08:28 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply [production]
08:11 <James_F> Zuul: Add WikimediaAntiAbuse extension, for T431023 [releng]
08:08 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cumin2002.codfw.wmnet [production]
08:06 <godog> remove cloudvirt1046, cloudvirt1062, cloudvirt1074, cloudvirt1075 from maintenance aggregate and put them in network-ovs - T424802 [production]
08:04 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'P{P:openstack::codfw1dev::nova::compute::service} AND NOT P{F:kernelversion = 6.12.95}' [admin]
08:00 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host cumin2002.codfw.wmnet [production]
07:58 <hashar@deploy1003> Finished scap sync-world: Backport for [[gerrit:1307617|Turn on PageImages in Author namespace for Ukrainian Wikisource (T431202)]] (duration: 32m 53s) [production]
07:57 <fabfur> repooled cp4038 [production]
07:57 <fabfur@cumin1003> conftool action : set/pooled=yes; selector: name=cp4038.* [production]
07:53 <moritzm> installing pyjwt security updates [production]
07:47 <moritzm> installing openjpeg2 security updates [production]
07:45 <hashar@deploy1003> vadymts1, hashar: Continuing with deployment [production]
07:43 <hashar@deploy1003> vadymts1, hashar: Backport for [[gerrit:1307617|Turn on PageImages in Author namespace for Ukrainian Wikisource (T431202)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:38 <moritzm> installing python-urllib3 security updates [production]
07:37 <mvernon@cumin2003> END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe-codfw [production]
07:30 <fabfur> depooled cp4038 to investigate on possible maxmind failure [production]
07:30 <fabfur@cumin1003> conftool action : set/pooled=no; selector: name=cp4038.* [production]
07:30 <fabfur@cumin1003> conftool action : set/pooled=yes; selector: name=cp4038.* [production]
07:29 <mvernon@cumin2003> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe-codfw [production]
07:25 <hashar@deploy1003> Started scap sync-world: Backport for [[gerrit:1307617|Turn on PageImages in Author namespace for Ukrainian Wikisource (T431202)]] [production]
07:08 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'P{P:openstack::codfw1dev::nova::compute::service} AND NOT P{F:kernelversion = 6.12.95}' [admin]
06:13 <moritzm> installing Linux 6.12.95 on trixie hosts [production]
05:20 <marostegui@cumin1003> conftool action : set/pooled=no; selector: name=clouddb1015.eqiad.wmnet,service=s6 [production]
05:20 <marostegui@cumin1003> conftool action : set/pooled=no; selector: name=clouddb1015.eqiad.wmnet,service=s4 [production]
05:19 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1015.eqiad.wmnet with reason: cloning [production]
02:07 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 07m 08s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-07-05 §
02:01 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 01m 08s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]
2026-07-04 §
14:49 <MacFan4000> restarted postgresql [wm-bot]
14:30 <wmftkbot> Test Kitchen experiment (poll 128995) - adds: none; removes: incident_reporting_system_interaction; fields: none - TK tips at https://w.wiki/_cvdP [analytics]
13:54 <wmbot~lucaswerkmeister@tools-bastion-15> deployed b304cd29af (temporary T431146 branch: log request ID and details of every refresh token response) [tools.lexeme-forms]
11:07 <wmbot~lucaswerkmeister@tools-bastion-15> deployed 593bb47c56 (temporary T431146 branch: enable debug logging for requests_oauthlib.oauth2_session) [tools.lexeme-forms]
02:07 <mwpresync@deploy1003> Finished scap build-images: Publishing wmf/next image (duration: 06m 58s) [production]
02:00 <mwpresync@deploy1003> Started scap build-images: Publishing wmf/next image [production]