701-750 of 10000 results (43ms)
2022-03-31 ยง
14:03 <mmandere@cumin1001> START - Cookbook sre.hosts.reimage for host cp5009.eqsin.wmnet with OS buster [production]
14:03 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:02 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:02 <moritzm> installing vim security updates on buster [production]
14:02 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:00 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon1002.wikimedia.org [production]
13:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:56 <Lucas_WMDE> UTC afternoon backport+config window done [production]
13:55 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.39.0-wmf.5/includes/changetags/ChangeTags.php: Backport: [[gerrit:775437|ChangeTags: Use localizer with correct page title to parse messages (T302754)]] (duration: 00m 51s) [production]
13:53 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:53 <mmandere> depool cp5009 for reimage - T290005 [production]
13:52 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:52 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netmon1002.wikimedia.org [production]
13:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:51 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon2001.wikimedia.org [production]
13:51 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.39.0-wmf.5/resources/src/mediawiki.special.createaccount/HtmlformChecker.js: Backport: [[gerrit:775432|Fix error/warning boxes on signup form (T305098)]] (duration: 00m 50s) [production]
13:41 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netmon2001.wikimedia.org [production]
13:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:31 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:31 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:27 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.39.0-wmf.5/extensions/CentralAuth/includes/Special/GlobalUsersPager.php: Backport: [[gerrit:775436|Revert "GlobalUsersPager: add gu_id to GROUP BY"]] (duration: 00m 50s) [production]
13:25 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:24 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:20 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.39.0-wmf.5/tests/phpunit/structure/SpecialPageFatalTest.php: Backport: [[gerrit:775435|Revert "Add SpecialPageFatalTest to @group Database"]] (no-op) (duration: 00m 50s) [production]
13:13 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:12 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:09 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:755453|Configure `mul` language code on Test Wikidata and its clients (T297393)]] (2/2) (duration: 00m 50s) [production]
13:08 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:755453|Configure `mul` language code on Test Wikidata and its clients (T297393)]] (1/2) (duration: 00m 51s) [production]
13:03 <mmandere> pool cp4023 with HAProxy as TLS termination layer - T290005 [production]
12:53 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4023.ulsfo.wmnet with OS buster [production]
12:53 <mmandere> pool cp3057 with HAProxy as TLS termination layer - T290005 [production]
12:50 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3057.esams.wmnet with OS buster [production]
12:48 <XioNoX> analytics1-b/c/d-eqiad: replace firewall filter with strict uRPF - T298087 [production]
12:31 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4023.ulsfo.wmnet with reason: host reimage [production]
12:28 <mmandere@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4023.ulsfo.wmnet with reason: host reimage [production]
12:25 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp3057.esams.wmnet with reason: host reimage [production]
12:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314 (T298557)', diff saved to https://phabricator.wikimedia.org/P24013 and previous config saved to /var/cache/conftool/dbconfig/20220331-122247-marostegui.json [production]
12:22 <mmandere@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp3057.esams.wmnet with reason: host reimage [production]
12:12 <mmandere@cumin1001> START - Cookbook sre.hosts.reimage for host cp4023.ulsfo.wmnet with OS buster [production]
12:07 <mmandere> depool cp4023 for reimage - T290005 [production]
12:07 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P24012 and previous config saved to /var/cache/conftool/dbconfig/20220331-120742-marostegui.json [production]
12:04 <moritzm> installing wireshark security updates [production]
11:54 <mmandere@cumin1001> START - Cookbook sre.hosts.reimage for host cp3057.esams.wmnet with OS buster [production]
11:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1146:3314', diff saved to https://phabricator.wikimedia.org/P24011 and previous config saved to /var/cache/conftool/dbconfig/20220331-115235-marostegui.json [production]