101-150 of 10000 results (14ms)
2026-04-08 ยง
13:41 <phuedx@deploy1003> Finished scap sync-world: Backport for [[gerrit:1268948|PHP SDK: Measure known experiments correctly (T422112)]], [[gerrit:1268947|PHP SDK: Measure known experiments correctly (T422112)]] (duration: 07m 58s) [production]
13:37 <phuedx@deploy1003> phuedx: Continuing with sync [production]
13:35 <phuedx@deploy1003> phuedx: Backport for [[gerrit:1268948|PHP SDK: Measure known experiments correctly (T422112)]], [[gerrit:1268947|PHP SDK: Measure known experiments correctly (T422112)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:34 <godog> leave designate processes up only on cloudcontrol1006 to ease debugging - T422646 [admin]
13:33 <bking@cumin2002> conftool action : set/pooled=true; selector: dnsdisc=wdqs-internal-scholarly,name=eqiad [production]
13:33 <phuedx@deploy1003> Started scap sync-world: Backport for [[gerrit:1268948|PHP SDK: Measure known experiments correctly (T422112)]], [[gerrit:1268947|PHP SDK: Measure known experiments correctly (T422112)]] [production]
13:31 <ayounsi@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host testvm2006.codfw.wmnet with OS trixie [production]
13:28 <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1268820|cswiki: lift IP cap for workshop (T422520)]] (duration: 06m 22s) [production]
13:26 <moritzm> upgrade debdeploy-server on cumin2002 to 0.0.99.14-1+deb12u1+exp1 (temporary build with Cumin 6 compat before we have Cumin 6 universally) [production]
13:25 <lucaswerkmeister-wmde@deploy1003> anzx, lucaswerkmeister-wmde: Continuing with sync [production]
13:24 <lucaswerkmeister-wmde@deploy1003> anzx, lucaswerkmeister-wmde: Backport for [[gerrit:1268820|cswiki: lift IP cap for workshop (T422520)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:22 <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1268820|cswiki: lift IP cap for workshop (T422520)]] [production]
13:15 <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1268679|Turn on Parsoid Read Views for eswiki (T422524)]] (duration: 07m 06s) [production]
13:11 <cscott@deploy1003> cscott: Continuing with sync [production]
13:10 <cscott@deploy1003> cscott: Backport for [[gerrit:1268679|Turn on Parsoid Read Views for eswiki (T422524)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:08 <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1268679|Turn on Parsoid Read Views for eswiki (T422524)]] [production]
13:04 <taavi> restarting pybal on lvs1018 [production]
12:49 <gkyziridis@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
12:43 <taavi> restarting pybal on lvs1020 [production]
12:40 <ayounsi@cumin1003> START - Cookbook sre.hosts.reimage for host testvm2006.codfw.wmnet with OS trixie [production]
12:32 <gkyziridis@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
12:32 <jgiannelos@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
12:32 <jgiannelos@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
12:32 <jgiannelos@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
12:31 <jgiannelos@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
12:29 <jgiannelos@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
12:28 <jgiannelos@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
12:28 <jgiannelos@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
12:27 <jiji@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM wikikube-worker-exp2001.codfw.wmnet [production]
12:27 <jgiannelos@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
12:27 <jiji@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM wikikube-worker-exp2001.codfw.wmnet [production]
12:15 <mszwarc@deploy1003> mwscript-k8s job started: foreachwikiindblist all backfillInterwikiRightsLog.php --remote-wiki metawiki 20260311190000 # T6055 [production]
12:13 <jiji@cumin1003> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM wikikube-worker-exp1001.eqiad.wmnet [production]
12:07 <jiji@cumin1003> START - Cookbook sre.ganeti.reboot-vm for VM wikikube-worker-exp1001.eqiad.wmnet [production]
11:59 <filippo@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment eqiad1 for service: project,designate [admin]
11:58 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,designate [admin]
11:54 <filippo@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) on deployment eqiad1 for service: project,designate [admin]
11:53 <gkyziridis@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
11:53 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,designate [admin]
11:44 <kart_> machinetranslation: Remove networkpolicies for people* (T335491) [production]
11:43 <kartik@deploy1003> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
11:43 <kartik@deploy1003> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
11:42 <kartik@deploy1003> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
11:42 <kartik@deploy1003> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]
11:42 <fabfur@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-drmrs - 3.2.15 upgrade (T421402) [production]
11:41 <kartik@deploy1003> helmfile [staging] DONE helmfile.d/services/machinetranslation: apply [production]
11:41 <kartik@deploy1003> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
11:38 <fabfur@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-magru - 3.2.15 upgrade (T421402) [production]
11:35 <gkyziridis@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
11:23 <fabfur@cumin1003> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-ulsfo - 3.2.15 upgrade (T421402) [production]