2751-2800 of 10000 results (107ms)
2025-04-08 ยง
16:44 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/proton: apply [production]
16:41 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:41 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:40 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:38 <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1135066|Revert "Temporarily enable mobile sitenotice for fawiki"]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
16:32 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1209 (T391056)', diff saved to https://phabricator.wikimedia.org/P74733 and previous config saved to /var/cache/conftool/dbconfig/20250408-163210-fceratto.json [production]
16:31 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1135066|Revert "Temporarily enable mobile sitenotice for fawiki"]] [production]
16:24 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:24 <hnowlan> running 'ipvsadm --delete-service --tcp-service 10.2.2.26:443 && ipvsadm --delete-service --tcp-service 10.2.2.5:443' on eqiad lvs to remove videoscaler and jobrunner services [production]
16:24 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:24 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:23 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:22 <hnowlan> running 'ipvsadm --delete-service --tcp-service 10.2.2.26:443 && ipvsadm --delete-service --tcp-service 10.2.2.5:443' on codfw lvs to remove videoscaler and jobrunner services [production]
16:21 <dani@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:21 <dani@deploy2002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
16:20 <dani@deploy2002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
16:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1209 (T391056)', diff saved to https://phabricator.wikimedia.org/P74732 and previous config saved to /var/cache/conftool/dbconfig/20250408-162029-fceratto.json [production]
16:20 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1209.eqiad.wmnet with reason: Maintenance [production]
16:20 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T391056)', diff saved to https://phabricator.wikimedia.org/P74731 and previous config saved to /var/cache/conftool/dbconfig/20250408-162007-fceratto.json [production]
16:05 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203', diff saved to https://phabricator.wikimedia.org/P74730 and previous config saved to /var/cache/conftool/dbconfig/20250408-160501-fceratto.json [production]
15:49 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203', diff saved to https://phabricator.wikimedia.org/P74729 and previous config saved to /var/cache/conftool/dbconfig/20250408-154954-fceratto.json [production]
15:48 <cmooney@cumin1002> START - Cookbook sre.hosts.dhcp for host nokiatest2001.codfw.wmnet [production]
15:45 <herron@cumin1002> dbctl commit (dc=all): 'depooling db1246', diff saved to https://phabricator.wikimedia.org/P74728 and previous config saved to /var/cache/conftool/dbconfig/20250408-154509-herron.json [production]
15:39 <elukey@deploy1003> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
15:37 <elukey@deploy1003> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: sync [production]
15:34 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1203 (T391056)', diff saved to https://phabricator.wikimedia.org/P74727 and previous config saved to /var/cache/conftool/dbconfig/20250408-153446-fceratto.json [production]
15:22 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db1203 (T391056)', diff saved to https://phabricator.wikimedia.org/P74726 and previous config saved to /var/cache/conftool/dbconfig/20250408-152212-fceratto.json [production]
15:22 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1203.eqiad.wmnet with reason: Maintenance [production]
15:21 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192 (T391056)', diff saved to https://phabricator.wikimedia.org/P74725 and previous config saved to /var/cache/conftool/dbconfig/20250408-152150-fceratto.json [production]
15:06 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P74724 and previous config saved to /var/cache/conftool/dbconfig/20250408-150643-fceratto.json [production]
15:03 <brennen@deploy1003> Finished deploy [phabricator/deployment@99aa712]: deploy phab1004 for T391357 (duration: 00m 38s) [production]
15:03 <brennen@deploy1003> Started deploy [phabricator/deployment@99aa712]: deploy phab1004 for T391357 [production]
15:02 <brennen@deploy1003> Finished deploy [phabricator/deployment@99aa712]: test deploy phab2002 for T391357 (duration: 00m 42s) [production]
15:02 <arnaudb@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on phab2002.codfw.wmnet with reason: T391357 [production]
15:02 <brennen@deploy1003> Started deploy [phabricator/deployment@99aa712]: test deploy phab2002 for T391357 [production]
15:01 <arnaudb@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on phab1004.eqiad.wmnet with reason: T391357 [production]