451-500 of 10000 results (106ms)
2025-10-21 ยง
14:14 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 46997 [production]
14:13 <cmooney@cumin1003> START - Cookbook sre.network.peering with action 'configure' for AS: 46997 [production]
14:08 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1104.eqiad.wmnet [production]
14:08 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1105.eqiad.wmnet [production]
14:06 <sukhe@cumin1003> END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp40[50-52].ulsfo.wmnet} and A:cp [production]
14:06 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp4052.ulsfo.wmnet [production]
13:56 <Lucas_WMDE> UTC afternoon backport+config window done [production]
13:53 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1196921|[igwiki] Create 'autopatrolled' and 'rollbacker' usergroups (T407439)]], [[gerrit:1196930|Throttle exemption for Editathon by Wikimedistas en Cruce - 6/7 November 2025 (T407630)]], [[gerrit:1197004|[specieswiki] Enable USERLANGUAGE magic word (T406583)]], [[gerrit:1197614|[hsbwiktionary] Enable importing from enwiktionary (T40771 [production]
13:48 <lucaswerkmeister-wmde@deploy2002> superpes, lucaswerkmeister-wmde: Continuing with sync [production]
13:45 <Lucas_WMDE> (cont.) (T407713)]], [[gerrit:1197615|[dawikisource] Enable RC Patrol (T407790)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:45 <lucaswerkmeister-wmde@deploy2002> superpes, lucaswerkmeister-wmde: Backport for [[gerrit:1196921|[igwiki] Create 'autopatrolled' and 'rollbacker' usergroups (T407439)]], [[gerrit:1196930|Throttle exemption for Editathon by Wikimedistas en Cruce - 6/7 November 2025 (T407630)]], [[gerrit:1197004|[specieswiki] Enable USERLANGUAGE magic word (T406583)]], [[gerrit:1197614|[hsbwiktionary] Enable importing from enwiktionary [production]
13:44 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
13:43 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
13:41 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1196921|[igwiki] Create 'autopatrolled' and 'rollbacker' usergroups (T407439)]], [[gerrit:1196930|Throttle exemption for Editathon by Wikimedistas en Cruce - 6/7 November 2025 (T407630)]], [[gerrit:1197004|[specieswiki] Enable USERLANGUAGE magic word (T406583)]], [[gerrit:1197614|[hsbwiktionary] Enable importing from enwiktionary (T407713 [production]
13:28 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1103.eqiad.wmnet [production]
13:27 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1102.eqiad.wmnet [production]
13:25 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp4051.ulsfo.wmnet [production]
13:07 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/kartotherian: sync [production]
13:06 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/kartotherian: sync [production]
13:05 <elukey@deploy2002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: sync [production]
13:04 <elukey@deploy2002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: sync [production]
12:50 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1197278|Define CheckUser Suggested Investigations event stream (T404177)]], [[gerrit:1196914|CheckUser UserInfoCard: Enable XTools menu link on SUL wikis (T406012)]] (duration: 11m 42s) [production]
12:47 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1101.eqiad.wmnet [production]
12:47 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp1100.eqiad.wmnet [production]
12:46 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
12:42 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1197278|Define CheckUser Suggested Investigations event stream (T404177)]], [[gerrit:1196914|CheckUser UserInfoCard: Enable XTools menu link on SUL wikis (T406012)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
12:42 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp4050.ulsfo.wmnet [production]
12:42 <topranks> stopping netbox service on netbox-dev2003 to update db from live netbox [production]
12:38 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1197278|Define CheckUser Suggested Investigations event stream (T404177)]], [[gerrit:1196914|CheckUser UserInfoCard: Enable XTools menu link on SUL wikis (T406012)]] [production]
12:37 <marostegui@cumin1003> dbctl commit (dc=all): 'Remove es1029 from dbctl T407832', diff saved to https://phabricator.wikimedia.org/P84200 and previous config saved to /var/cache/conftool/dbconfig/20251021-123706-marostegui.json [production]
12:36 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-upload_eqiad and A:cp [production]
12:36 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_eqiad and A:cp [production]
12:36 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply [production]
12:35 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply [production]
12:35 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
12:34 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
12:32 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply [production]
12:32 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply [production]
12:31 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp40[50-52].ulsfo.wmnet} and A:cp [production]
12:30 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
12:29 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
12:29 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
12:29 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
12:29 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-misc: apply [production]
12:29 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-misc: apply [production]
12:28 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
12:27 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
12:27 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
12:23 <cgoubert@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
12:22 <cgoubert@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]