401-450 of 10000 results (104ms)
2025-12-17 ยง
15:07 <ayounsi@cumin1003> START - Cookbook sre.dns.netbox [production]
15:06 <XioNoX> add AAAA record to restbase1031.eqiad.wmnet - T271140 [production]
15:05 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
15:05 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
15:04 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:03 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
15:03 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
15:01 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
15:01 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
14:59 <moritzm> installing nodejs security updates [production]
14:53 <cgoubert@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
14:53 <cgoubert@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
14:51 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1219158|Revert "Enable v2 non-emergency workflow by default" (T410512 T412715)]], [[gerrit:1218806|Activate post-processing cache on some wikis (T348255)]] (duration: 18m 45s) [production]
14:50 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
14:50 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
14:47 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, ihurbain: Continuing with sync [production]
14:41 <moritzm> installing tiff security updates [production]
14:35 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, ihurbain: Backport for [[gerrit:1219158|Revert "Enable v2 non-emergency workflow by default" (T410512 T412715)]], [[gerrit:1218806|Activate post-processing cache on some wikis (T348255)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:33 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1219158|Revert "Enable v2 non-emergency workflow by default" (T410512 T412715)]], [[gerrit:1218806|Activate post-processing cache on some wikis (T348255)]] [production]
14:29 <lucaswerkmeister-wmde@deploy2002> Sync cancelled. [production]
14:22 <cgoubert@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
14:22 <cgoubert@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
14:19 <lucaswerkmeister-wmde@deploy2002> stran, lucaswerkmeister-wmde: Backport for [[gerrit:1207845|Enable v2 non-emergency workflow by default (T410512 T412715)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:18 <moritzm> installing redis security updates [production]
14:16 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1207845|Enable v2 non-emergency workflow by default (T410512 T412715)]] [production]
14:11 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1218853|lift throttle limits for Sing Lit 2025 (T412820)]] (duration: 07m 10s) [production]
14:09 <moritzm> installing pdns-recursor security updates [production]
14:07 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, robertsky: Continuing with sync [production]
14:06 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, robertsky: Backport for [[gerrit:1218853|lift throttle limits for Sing Lit 2025 (T412820)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:04 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1218853|lift throttle limits for Sing Lit 2025 (T412820)]] [production]
13:53 <daniel@deploy2002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
13:52 <daniel@deploy2002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
13:47 <daniel@deploy2002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
13:45 <daniel@deploy2002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
13:44 <moritzm> upgtrade Envoy on grafana* T410975 [production]
13:36 <moritzm> installing apache2 security updates [production]
13:32 <daniel@deploy2002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
13:29 <daniel@deploy2002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
13:27 <moritzm> upgtrade Envoy on an-web T410975 [production]
12:15 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2222 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P86724 and previous config saved to /var/cache/conftool/dbconfig/20251217-121556-marostegui.json [production]
12:15 <moritzm> installing pam security updates [production]
12:07 <mvolz@deploy2002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
12:06 <mvolz@deploy2002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
12:04 <mvolz@deploy2002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
12:04 <mvolz@deploy2002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
12:02 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
12:01 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
12:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P86723 and previous config saved to /var/cache/conftool/dbconfig/20251217-120047-marostegui.json [production]
11:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P86722 and previous config saved to /var/cache/conftool/dbconfig/20251217-114539-marostegui.json [production]
11:42 <moritzm> installing libsndfile security updates [production]