1101-1150 of 10000 results (91ms)
2025-02-10 §
15:14 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1117927|Fire CentralAuthPostLoginRedirect on SUL3 login (T364866)]], [[gerrit:1118515|Preserve 'campaign' parameter during authentication]], [[gerrit:1118517|Call AuthPreserveQueryParams hook when redirecting to SUL3 domain]] (duration: 14m 47s) [production]
15:07 <tgr@deploy2002> tgr: Continuing with sync [production]
15:03 <tgr@deploy2002> tgr: Backport for [[gerrit:1117927|Fire CentralAuthPostLoginRedirect on SUL3 login (T364866)]], [[gerrit:1118515|Preserve 'campaign' parameter during authentication]], [[gerrit:1118517|Call AuthPreserveQueryParams hook when redirecting to SUL3 domain]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:59 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1117927|Fire CentralAuthPostLoginRedirect on SUL3 login (T364866)]], [[gerrit:1118515|Preserve 'campaign' parameter during authentication]], [[gerrit:1118517|Call AuthPreserveQueryParams hook when redirecting to SUL3 domain]] [production]
14:58 <fnegri@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1006.eqiad.wmnet [production]
14:55 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1116812|Remove /pt from ptwikibooks $wgUploadMissingFileUrl]] (duration: 14m 21s) [production]
14:52 <fnegri@cumin1002> START - Cookbook sre.hosts.reboot-single for host cloudnet1006.eqiad.wmnet [production]
14:48 <tgr@deploy2002> tgr, lucaswerkmeister-wmde: Continuing with sync [production]
14:43 <tgr@deploy2002> tgr, lucaswerkmeister-wmde: Backport for [[gerrit:1116812|Remove /pt from ptwikibooks $wgUploadMissingFileUrl]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:40 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1116812|Remove /pt from ptwikibooks $wgUploadMissingFileUrl]] [production]
14:35 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1115006|Remove `tmpAlwaysShowMulLanguageCode` temporary setting (T330217)]], [[gerrit:1115013|Add `enableMulLanguageCode` to replace `tmpEnableMulLanguageCode` (T330217)]] (duration: 12m 14s) [production]
14:28 <tgr@deploy2002> tgr, arthurtaylor: Continuing with sync [production]
14:27 <tgr@deploy2002> tgr, arthurtaylor: Backport for [[gerrit:1115006|Remove `tmpAlwaysShowMulLanguageCode` temporary setting (T330217)]], [[gerrit:1115013|Add `enableMulLanguageCode` to replace `tmpEnableMulLanguageCode` (T330217)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:23 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1115006|Remove `tmpAlwaysShowMulLanguageCode` temporary setting (T330217)]], [[gerrit:1115013|Add `enableMulLanguageCode` to replace `tmpEnableMulLanguageCode` (T330217)]] [production]
13:16 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
13:16 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
13:14 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
13:13 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
13:13 <kart_> Updated cxserver to 2025-02-10-050623-production (T377966, T383863, T385552, T369815) [production]
13:03 <kartik@deploy2002> helmfile [eqiad] DONE helmfile.d/services/cxserver: apply [production]
13:03 <kartik@deploy2002> helmfile [eqiad] START helmfile.d/services/cxserver: apply [production]
13:02 <kartik@deploy2002> helmfile [codfw] DONE helmfile.d/services/cxserver: apply [production]
13:01 <kartik@deploy2002> helmfile [codfw] START helmfile.d/services/cxserver: apply [production]
12:57 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
12:56 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
12:52 <kartik@deploy2002> helmfile [staging] DONE helmfile.d/services/cxserver: apply [production]
12:52 <kartik@deploy2002> helmfile [staging] START helmfile.d/services/cxserver: apply [production]
11:52 <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1118490|Set file to write both in all wikis (T384481)]] (duration: 10m 21s) [production]
11:46 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
11:45 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:1118490|Set file to write both in all wikis (T384481)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
11:42 <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1118490|Set file to write both in all wikis (T384481)]] [production]
09:27 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1118235|tcywiki: add extendedconfirmed usergroup and restriction level (T385828)]] (duration: 12m 49s) [production]
09:20 <urbanecm@deploy2002> urbanecm, anzx: Continuing with sync [production]
09:18 <urbanecm@deploy2002> urbanecm, anzx: Backport for [[gerrit:1118235|tcywiki: add extendedconfirmed usergroup and restriction level (T385828)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
09:14 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1118235|tcywiki: add extendedconfirmed usergroup and restriction level (T385828)]] [production]
08:49 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
08:49 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
08:48 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
08:47 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
05:18 <tstarling@deploy2002> Finished scap sync-world: Backport for [[gerrit:1118262|Revert "API: Use ExpiryDef for action=block expiry parameter" (T248196)]] (duration: 24m 04s) [production]
05:09 <tstarling@deploy2002> tstarling: Continuing with sync [production]
05:07 <tstarling@deploy2002> tstarling: Backport for [[gerrit:1118262|Revert "API: Use ExpiryDef for action=block expiry parameter" (T248196)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
04:54 <tstarling@deploy2002> Started scap sync-world: Backport for [[gerrit:1118262|Revert "API: Use ExpiryDef for action=block expiry parameter" (T248196)]] [production]
2025-02-09 §
13:52 <cmooney@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on cr2-magru with reason: IBGP instability from cr1 to cr2 in magru causing ping faulures from alert1002 [production]
01:36 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240 (T384592)', diff saved to https://phabricator.wikimedia.org/P73430 and previous config saved to /var/cache/conftool/dbconfig/20250209-013642-marostegui.json [production]
01:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P73429 and previous config saved to /var/cache/conftool/dbconfig/20250209-012135-marostegui.json [production]
01:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240', diff saved to https://phabricator.wikimedia.org/P73428 and previous config saved to /var/cache/conftool/dbconfig/20250209-010628-marostegui.json [production]
00:51 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2240 (T384592)', diff saved to https://phabricator.wikimedia.org/P73427 and previous config saved to /var/cache/conftool/dbconfig/20250209-005121-marostegui.json [production]
2025-02-08 §
19:36 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2240 (T384592)', diff saved to https://phabricator.wikimedia.org/P73426 and previous config saved to /var/cache/conftool/dbconfig/20250208-193620-marostegui.json [production]
19:36 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2240.codfw.wmnet with reason: Maintenance [production]