1-50 of 10000 results (22ms)
2026-08-19 ยง
20:11 <catrope@deploy1003> catrope, gergesshamon: Continuing with deployment [production]
20:08 <catrope@deploy1003> catrope, gergesshamon: Backport for [[gerrit:1325878|[arwiki] Enable restricted user page editing and grant edit permissions (T434878)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:06 <catrope@deploy1003> Started scap sync-world: Backport for [[gerrit:1325878|[arwiki] Enable restricted user page editing and grant edit permissions (T434878)]] [production]
19:59 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host cassandra-dev2001.codfw.wmnet with OS bookworm [production]
19:56 <eevans@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cassandra-dev2001.codfw.wmnet with OS bookworm [production]
19:56 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host cassandra-dev2001.codfw.wmnet with OS bookworm [production]
19:43 <cwilliams@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2207.codfw.wmnet with reason: Maintenance [production]
18:47 <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1319920|Allow setting a separate thumbUrl in production (T427465)]], [[gerrit:1327167|Fix wmgThumbUrl config (T427465)]] (duration: 18m 53s) [production]
18:43 <ladsgroup@deploy1003> ladsgroup: Continuing with deployment [production]
18:30 <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1319920|Allow setting a separate thumbUrl in production (T427465)]], [[gerrit:1327167|Fix wmgThumbUrl config (T427465)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:28 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1319920|Allow setting a separate thumbUrl in production (T427465)]], [[gerrit:1327167|Fix wmgThumbUrl config (T427465)]] [production]
18:26 <sukhe@dns1004> END - running authdns-update [production]
18:24 <sukhe@dns1004> START - running authdns-update [production]
18:09 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1319920|Allow setting a separate thumbUrl in production (T427465)]] [production]
18:03 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-eqiad and A:cp - 9.2.15 upgrade (T434478) [production]
17:56 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-codfw and A:cp - 9.2.15 upgrade (T434478) [production]
17:50 <cmooney@dns3003> END - running authdns-update [production]
17:49 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project onfire in eqiad1 [onfire]
17:46 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.delete_project for project onfire in eqiad1 [onfire]
17:42 <dancy@deploy1003> Installation of scap version "4.283.0" completed for 3 hosts [production]
17:41 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.roll-restart-reboot-durum (exit_code=0) rolling reboot on A:durum and A:durum [production]
17:40 <cmooney@dns3003> START - running authdns-update [production]
17:40 <dancy@deploy1003> Installing scap version "4.283.0" for 3 host(s) [production]
17:38 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:37 <cmooney@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on GTT VPLS - cmooney@cumin1003" [production]
17:37 <urbanecm@deploy1003> mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=enwiki --verbose --scoreLessThan=0.7 --exceptDatasetChecksums=T434319-enwiki-models.txt # T434319 [production]
17:32 <cmooney@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on GTT VPLS - cmooney@cumin1003" [production]
17:29 <sbassett> Deployed security fix for T435210 (wmf.16) [production]
17:26 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
17:22 <sbassett> Deployed security fix for T435210 (wmf.15) [production]
17:08 <James_F> Created integration-cumin-01 for T433592 [integration]
17:00 <sukhe@dns1004> END - running authdns-update [production]
16:58 <sukhe@dns1004> START - running authdns-update [production]
16:53 <sukhe@cumin1003> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) rebooting A:liberica-esams and A:liberica [production]
16:41 <sukhe@cumin1003> START - Cookbook sre.loadbalancer.admin rebooting A:liberica-esams and A:liberica [production]
16:41 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-eqiad and A:cp - 9.2.15 upgrade (T434478) [production]
16:41 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-codfw and A:cp - 9.2.15 upgrade (T434478) [production]
16:41 <cjd91> sudo -i cookbook sre.cdn.roll-upgrade-ats --query 'A:cp-codfw' --task-id T434478 --reason '9.2.15 upgrade' [production]
16:41 <cjd91> sudo -i cookbook sre.cdn.roll-upgrade-ats --query 'A:cp-eqiad' --task-id T434478 --reason '9.2.15 upgrade' [production]
16:40 <sukhe@cumin1003> START - Cookbook sre.dns.roll-restart-reboot-durum rolling reboot on A:durum and A:durum [production]
16:27 <urbanecm@deploy1003> Finished scap sync-world: Backport for [[gerrit:1326881|Echo: Start using virtual domains (T380385)]] (duration: 13m 12s) [production]
16:23 <urbanecm@deploy1003> urbanecm: Continuing with deployment [production]
16:21 <urandom> Completed sessionstore Cassandra/JVM upgrade โ€” T435154 [production]
16:20 <eevans@cumin1003> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching sessionstore[2005-2006].codfw.wmnet,sessionstore[1005-1006].eqiad.wmnet: Upgrade Cassandra to 5.0.8 & Java to 17 โ€” T435154 - eevans@cumin1003 [production]
16:19 <urbanecm@deploy1003> urbanecm: Backport for [[gerrit:1326881|Echo: Start using virtual domains (T380385)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
16:15 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:15 <cmooney@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on ulsfo<->codfw - cmooney@cumin1003" [production]
16:14 <urbanecm@deploy1003> Started scap sync-world: Backport for [[gerrit:1326881|Echo: Start using virtual domains (T380385)]] [production]
16:14 <urbanecm@deploy1003> Finished scap sync-world: Backport for [[gerrit:1327123|Revert^2 "Migrate database access to virtual domains" (T435305)]], [[gerrit:1327124|Pass the mapped domain of virtual-echo-shared to the push NameTableStores (T435305)]] (duration: 07m 42s) [production]
16:13 <eevans@cumin1003> START - Cookbook sre.cassandra.roll-restart for nodes matching sessionstore[2005-2006].codfw.wmnet,sessionstore[1005-1006].eqiad.wmnet: Upgrade Cassandra to 5.0.8 & Java to 17 โ€” T435154 - eevans@cumin1003 [production]