651-700 of 10000 results (75ms)
2025-05-12 ยง
14:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201', diff saved to https://phabricator.wikimedia.org/P75917 and previous config saved to /var/cache/conftool/dbconfig/20250512-143441-fceratto.json [production]
14:27 <bking@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cirrussearch1068 [production]
14:27 <bking@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1068 on all recursors [production]
14:27 <bking@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1068 on all recursors [production]
14:27 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:27 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1068 to cirrussearch1068 - bking@cumin2002" [production]
14:27 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1068 to cirrussearch1068 - bking@cumin2002" [production]
14:23 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
14:23 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
14:23 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
14:23 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1068 to cirrussearch1068 [production]
14:22 <volans@cumin1003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin1003.eqiad.wmnet with reason: Release v0.10.1 - volans@cumin1003 [production]
14:21 <volans@cumin1003> START - Cookbook sre.deploy.python-code homer to cumin1003.eqiad.wmnet with reason: Release v0.10.1 - volans@cumin1003 [production]
14:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1201 (T392806)', diff saved to https://phabricator.wikimedia.org/P75916 and previous config saved to /var/cache/conftool/dbconfig/20250512-141933-fceratto.json [production]
14:17 <tgr@deploy1003> Finished scap sync-world: Backport for [[gerrit:1144532|Improve session logging (T393038)]] (duration: 17m 24s) [production]
14:11 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1201 (T392806)', diff saved to https://phabricator.wikimedia.org/P75915 and previous config saved to /var/cache/conftool/dbconfig/20250512-141139-fceratto.json [production]
14:11 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:11 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T392806)', diff saved to https://phabricator.wikimedia.org/P75914 and previous config saved to /var/cache/conftool/dbconfig/20250512-141114-fceratto.json [production]
14:10 <tgr@deploy1003> tgr: Continuing with sync [production]
14:04 <tgr@deploy1003> tgr: Backport for [[gerrit:1144532|Improve session logging (T393038)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:04 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:01 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
13:59 <tgr@deploy1003> Started scap sync-world: Backport for [[gerrit:1144532|Improve session logging (T393038)]] [production]
13:56 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P75913 and previous config saved to /var/cache/conftool/dbconfig/20250512-135607-fceratto.json [production]
13:54 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
13:54 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
13:52 <fabfur@cumin1002> conftool action : set/pooled=no; selector: name=cp7001.magru.wmnet [production]
13:51 <fabfur@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp7001.magru.wmnet with reason: Testing in progress [production]
13:45 <hashar@deploy1003> Finished deploy [integration/docroot@21bebf5]: build: Updating mediawiki/mediawiki-codesniffer to 47.0.0 (duration: 00m 11s) [production]
13:45 <hashar@deploy1003> Started deploy [integration/docroot@21bebf5]: build: Updating mediawiki/mediawiki-codesniffer to 47.0.0 [production]
13:41 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P75912 and previous config saved to /var/cache/conftool/dbconfig/20250512-134100-fceratto.json [production]
13:34 <aokoth@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply [production]
13:34 <aokoth@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply [production]
13:33 <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1144481|htmlform: Fix rendering contents for cloner fields (T393790)]] (duration: 14m 50s) [production]
13:29 <pfischer@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:29 <pfischer@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T392806)', diff saved to https://phabricator.wikimedia.org/P75911 and previous config saved to /var/cache/conftool/dbconfig/20250512-132552-fceratto.json [production]
13:25 <lucaswerkmeister-wmde@deploy1003> stran, lucaswerkmeister-wmde: Continuing with sync [production]
13:22 <lucaswerkmeister-wmde@deploy1003> stran, lucaswerkmeister-wmde: Backport for [[gerrit:1144481|htmlform: Fix rendering contents for cloner fields (T393790)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:18 <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1144481|htmlform: Fix rendering contents for cloner fields (T393790)]] [production]
13:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1187 (T392806)', diff saved to https://phabricator.wikimedia.org/P75910 and previous config saved to /var/cache/conftool/dbconfig/20250512-131756-fceratto.json [production]
13:17 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
13:17 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T392806)', diff saved to https://phabricator.wikimedia.org/P75909 and previous config saved to /var/cache/conftool/dbconfig/20250512-131731-fceratto.json [production]
13:16 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
13:15 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
13:15 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
13:15 <ayounsi@cumin1002> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
13:14 <pfischer@deploy2002> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:14 <pfischer@deploy2002> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:12 <ayounsi@cumin1002> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]