151-200 of 10000 results (103ms)
2026-03-12 ยง
20:39 <tgr@deploy2002> tgr, daimona: Continuing with sync [production]
20:37 <tgr@deploy2002> tgr, daimona: Backport for [[gerrit:1251087|Set 'sub' JWT field in client credentials access tokens (T417278)]], [[gerrit:1251088|Set 'sub' JWT field in client credentials access tokens (T417278)]], [[gerrit:1251106|phpunit: Avoid unnecessary writes in generatePHPUnitConfig.php (T419107)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
20:37 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp4046.ulsfo.wmnet with OS trixie [production]
20:35 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1251087|Set 'sub' JWT field in client credentials access tokens (T417278)]], [[gerrit:1251088|Set 'sub' JWT field in client credentials access tokens (T417278)]], [[gerrit:1251106|phpunit: Avoid unnecessary writes in generatePHPUnitConfig.php (T419107)]] [production]
20:35 <jsn@deploy2002> Synchronized wmf-config/throttle.php: (no justification provided) (duration: 01m 57s) [production]
20:32 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp4045.* [production]
20:28 <cdobbins@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp4041.ulsfo.wmnet with OS trixie [production]
20:20 <btullis@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dse-k8s-worker1019.eqiad.wmnet with OS bookworm [production]
20:18 <jsn@deploy2002> Finished scap sync-world: Backport for [[gerrit:1249364|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1251140|[arwikiquote] add namespace alias for NS_PROJECT (T419828)]], [[gerrit:1251098|Deploy participant recruitment survey on frwiki (T419778)]], [[gerrit:1251164|Increase IP cap limit for azwiki (T419899)]] (duration: 11m 11s) [production]
20:14 <jsn@deploy2002> jsn, dani, nmw03, gergesshamon: Continuing with sync [production]
20:09 <jsn@deploy2002> jsn, dani, nmw03, gergesshamon: Backport for [[gerrit:1249364|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1251140|[arwikiquote] add namespace alias for NS_PROJECT (T419828)]], [[gerrit:1251098|Deploy participant recruitment survey on frwiki (T419778)]], [[gerrit:1251164|Increase IP cap limit for azwiki (T419899)]] synced to the testservers (see https://wikitech.wikimedia.org/wik [production]
20:07 <jsn@deploy2002> Started scap sync-world: Backport for [[gerrit:1249364|PersonalDashboard: enable CTA for pilot wikis (T418613)]], [[gerrit:1251140|[arwikiquote] add namespace alias for NS_PROJECT (T419828)]], [[gerrit:1251098|Deploy participant recruitment survey on frwiki (T419778)]], [[gerrit:1251164|Increase IP cap limit for azwiki (T419899)]] [production]
19:21 <rzl@deploy2002> helmfile [codfw] DONE helmfile.d/services/mathoid: apply [production]
19:21 <rzl@deploy2002> helmfile [codfw] START helmfile.d/services/mathoid: apply [production]
19:20 <rzl@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mathoid: apply [production]
19:19 <rzl@deploy2002> helmfile [eqiad] START helmfile.d/services/mathoid: apply [production]
19:16 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
19:16 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
19:15 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
19:14 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
19:13 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
19:12 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
19:12 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
19:11 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
19:07 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp4041.ulsfo.wmnet with OS trixie [production]
19:06 <cdobbins@cumin2002> conftool action : set/pooled=no; selector: name=cp4041.ulsfo.wmnet [reason: trixie reimaging] [production]
19:06 <cdobbins@cumin2002> conftool action : set/pooled=yes; selector: name=cp4039.ulsfo.wmnet [reason: trixie reimaging] [production]
19:06 <swfrench-wmf> reprepro include xdebug_3.4.4-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <swfrench-wmf> reprepro include wikidiff2_1.14.1-2+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <swfrench-wmf> reprepro include php-yaml_2.2.4-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <swfrench-wmf> reprepro include php-xhprof_2.3.10-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <swfrench-wmf> reprepro include php-wmerrors_2.0.0-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <swfrench-wmf> reprepro include php-uuid_1.3.0-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:05 <brennen@deploy2002> Finished scap sync-world: Backport for [[gerrit:1251138|EditPage: Re-add catch block for MWException (T419883)]] (duration: 09m 46s) [production]
19:04 <swfrench-wmf> reprepro include php-redis_6.2.0-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:04 <swfrench-wmf> reprepro include php-pcov_1.0.12-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:04 <swfrench-wmf> reprepro include php-memcached_3.3.0-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:03 <swfrench-wmf> reprepro include php-luasandbox_4.1.2-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:03 <swfrench-wmf> reprepro include php-imagick_3.7.0-13+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:03 <swfrench-wmf> reprepro include php-excimer_1.2.5-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
19:01 <brennen@deploy2002> somerandomdeveloper, brennen: Continuing with sync [production]
18:59 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1019.eqiad.wmnet with OS bookworm [production]
18:57 <brennen@deploy2002> somerandomdeveloper, brennen: Backport for [[gerrit:1251138|EditPage: Re-add catch block for MWException (T419883)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:55 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4039.ulsfo.wmnet with OS trixie [production]
18:55 <brennen@deploy2002> Started scap sync-world: Backport for [[gerrit:1251138|EditPage: Re-add catch block for MWException (T419883)]] [production]
18:52 <rzl@deploy2002> helmfile [staging] DONE helmfile.d/services/mathoid: apply [production]
18:52 <rzl@deploy2002> helmfile [staging] START helmfile.d/services/mathoid: apply [production]
18:42 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp20(2[789]|3[0-9]|40).*,service=ats-be [production]
18:34 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.46.0-wmf.19 refs T413810 [production]
18:29 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4039.ulsfo.wmnet with reason: host reimage [production]