801-850 of 10000 results (116ms)
2026-01-06 §
10:27 <ayounsi@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 208915 [production]
10:27 <ayounsi@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 208915 [production]
10:22 <mvernon@cumin2002> END (FAIL) - Cookbook sre.swift.remove-ghost-objects (exit_code=99) from container wikipedia-commons-local-public.f7 in codfw [production]
10:19 <mvernon@cumin2002> START - Cookbook sre.swift.remove-ghost-objects from container wikipedia-commons-local-public.f7 in codfw [production]
09:40 <kevinbazira@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:14 <XioNoX> push pfw policies - T413833 [production]
09:07 <moritzm> installing e2fsprogs updates from Bookworm point release [production]
08:12 <moritzm> installing distro-info-data updates [production]
08:08 <hashar@deploy2002> Finished deploy [gerrit/gerrit@c323101]: Disable banner for the 2025 developer survey (duration: 00m 11s) [production]
08:08 <hashar@deploy2002> Started deploy [gerrit/gerrit@c323101]: Disable banner for the 2025 developer survey [production]
07:54 <moritzm> installing bash updates from Bookworm point release [production]
04:55 <eileen> civicrm upgraded from 68ea4eab to dc2511ee [production]
04:47 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.46.0-wmf.10 refs T408280 (duration: 44m 16s) [production]
04:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.46.0-wmf.10 refs T408280 [production]
03:04 <eileen> config revision changed from 76dff80b to 596df184 [production]
02:44 <eileen> revision changed from ddb2f36b to 76dff80b [production]
02:26 <eileen> civicrm upgraded from 6bd3c988 to 8751ed14 [production]
01:13 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 12m 32s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
00:36 <eileen> civicrm upgraded from 9d26c426 to 6bd3c988 [production]
2026-01-05 §
23:38 <ejegg> payments-wiki upgraded from 857e80f2 to 4dbf3b57 [production]
22:58 <reedy@deploy2002> Finished scap sync-world: Backport for [[gerrit:1223244|Remove WebAuthn keys that no longer need Wikimedia overrides (T413287)]] (duration: 06m 24s) [production]
22:54 <reedy@deploy2002> reedy: Continuing with sync [production]
22:53 <reedy@deploy2002> reedy: Backport for [[gerrit:1223244|Remove WebAuthn keys that no longer need Wikimedia overrides (T413287)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:51 <reedy@deploy2002> Started scap sync-world: Backport for [[gerrit:1223244|Remove WebAuthn keys that no longer need Wikimedia overrides (T413287)]] [production]
22:36 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirtlocal1002.eqiad.wmnet with OS trixie [production]
22:31 <cjming> end of UTC late backport window [production]
22:29 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1219628|Fetch user from primary DB when saving settings (T411804)]] (duration: 06m 06s) [production]
22:25 <cjming@deploy2002> d3r1ck01, cjming: Continuing with sync [production]
22:25 <cjming@deploy2002> d3r1ck01, cjming: Backport for [[gerrit:1219628|Fetch user from primary DB when saving settings (T411804)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:23 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1219628|Fetch user from primary DB when saving settings (T411804)]] [production]
21:55 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1220010|[config] Set Category Collation for arwiktionary (T413338)]] (duration: 09m 23s) [production]
21:51 <cjming@deploy2002> hubaishan, cjming: Continuing with sync [production]
21:48 <cjming@deploy2002> hubaishan, cjming: Backport for [[gerrit:1220010|[config] Set Category Collation for arwiktionary (T413338)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:46 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1220010|[config] Set Category Collation for arwiktionary (T413338)]] [production]
21:44 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirtlocal1002.eqiad.wmnet with reason: host reimage [production]
21:44 <cjming@deploy2002> Finished scap sync-world: Backport for [[gerrit:1222511|arbcom_zhwiki: Logo Changes (T413649)]] (duration: 11m 12s) [production]
21:38 <cjming@deploy2002> zhaofjx, cjming: Continuing with sync [production]
21:38 <jhancock@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2249.codfw.wmnet with OS bookworm [production]
21:38 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
21:37 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirtlocal1002.eqiad.wmnet with reason: host reimage [production]
21:37 <cjming@deploy2002> zhaofjx, cjming: Backport for [[gerrit:1222511|arbcom_zhwiki: Logo Changes (T413649)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:33 <cjming@deploy2002> Started scap sync-world: Backport for [[gerrit:1222511|arbcom_zhwiki: Logo Changes (T413649)]] [production]
21:30 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin1003" [production]
21:20 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudvirtlocal1002.eqiad.wmnet with OS trixie [production]
21:15 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on db2249.codfw.wmnet with reason: host reimage [production]
21:07 <jhancock@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on db2249.codfw.wmnet with reason: host reimage [production]
20:58 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host db2249.codfw.wmnet with OS bookworm [production]
20:50 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db2249.codfw.wmnet with OS bookworm [production]
20:07 <jhancock@cumin1003> START - Cookbook sre.hosts.reimage for host db2249.codfw.wmnet with OS bookworm [production]