1401-1450 of 10000 results (99ms)
2025-02-05 ยง
18:18 <swfrench@deploy2002> Started scap sync-world: Backport for [[gerrit:1117276|Enroll 50% of client sessions in PHP 8.1 (T383845)]] [production]
18:18 <marostegui@cumin1002> dbctl commit (dc=all): 'db1179 (re)pooling @ 75%: Repooling', diff saved to https://phabricator.wikimedia.org/P73261 and previous config saved to /var/cache/conftool/dbconfig/20250205-181801-root.json [production]
18:11 <swfrench-wmf> mw-api-int to ~ 5% of traffic on PHP 8.1 - T383845 [production]
18:11 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
18:10 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
18:10 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
18:10 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
18:07 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
18:07 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
18:06 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
18:06 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
18:04 <swfrench-wmf> scaled mw-api-ext and mw-web next releases to 25% of main - T383845 [production]
18:04 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
18:03 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
18:03 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
18:03 <marostegui@cumin1002> dbctl commit (dc=all): 'db1237 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P73259 and previous config saved to /var/cache/conftool/dbconfig/20250205-180307-root.json [production]
18:03 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
18:02 <marostegui@cumin1002> dbctl commit (dc=all): 'db1179 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P73258 and previous config saved to /var/cache/conftool/dbconfig/20250205-180256-root.json [production]
18:01 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
18:01 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
18:01 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
18:00 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
17:48 <marostegui@cumin1002> dbctl commit (dc=all): 'db1237 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P73257 and previous config saved to /var/cache/conftool/dbconfig/20250205-174802-root.json [production]
17:47 <marostegui@cumin1002> dbctl commit (dc=all): 'db1179 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P73256 and previous config saved to /var/cache/conftool/dbconfig/20250205-174750-root.json [production]
17:46 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:45 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:43 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ganeti1054.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART [production]
17:32 <marostegui@cumin1002> dbctl commit (dc=all): 'db1237 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P73255 and previous config saved to /var/cache/conftool/dbconfig/20250205-173257-root.json [production]
17:32 <marostegui@cumin1002> dbctl commit (dc=all): 'db1179 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P73254 and previous config saved to /var/cache/conftool/dbconfig/20250205-173245-root.json [production]
17:30 <mutante> phab1004 - rm /lib/systemd/system/phabricator_stats_job_mfa_check.* for gerrit:1117489 T299403 [production]
16:33 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
16:32 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
16:31 <hnowlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
16:30 <hnowlan@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
16:00 <klausman@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-main: sync [production]
15:59 <klausman@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-main: sync [production]
15:54 <marostegui@cumin1002> dbctl commit (dc=all): 'db2221 (re)pooling @ 100%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73252 and previous config saved to /var/cache/conftool/dbconfig/20250205-155456-root.json [production]
15:51 <swfrench-wmf> finished deploying conftool 5.0.1-1 - T383324 [production]
15:39 <marostegui@cumin1002> dbctl commit (dc=all): 'db2221 (re)pooling @ 75%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73251 and previous config saved to /var/cache/conftool/dbconfig/20250205-153951-root.json [production]
15:24 <marostegui@cumin1002> dbctl commit (dc=all): 'db2221 (re)pooling @ 50%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73250 and previous config saved to /var/cache/conftool/dbconfig/20250205-152445-root.json [production]
15:20 <jforrester@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:19 <jforrester@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:19 <jforrester@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:18 <jforrester@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
15:15 <jforrester@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
15:15 <jforrester@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:56 <marostegui@cumin1002> dbctl commit (dc=all): 'db1202 (re)pooling @ 75%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73247 and previous config saved to /var/cache/conftool/dbconfig/20250205-145647-root.json [production]
14:54 <marostegui@cumin1002> dbctl commit (dc=all): 'db2221 (re)pooling @ 10%: Repooling after rebuild index', diff saved to https://phabricator.wikimedia.org/P73246 and previous config saved to /var/cache/conftool/dbconfig/20250205-145434-root.json [production]
14:53 <Lucas_WMDE> UTC afternoon backport+config window done [production]
14:52 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1117321|kywiki: create draft namespace (T385593)]] (duration: 10m 54s) [production]