651-700 of 10000 results (46ms)
2022-04-14 ยง
16:13 <dancy@deploy1002> Started scap: (no justification provided) [production]
16:04 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
16:04 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
16:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
16:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:58 <krinkle@deploy1002> Synchronized private/PrivateSettings.php: (no justification provided) (duration: 00m 55s) [production]
15:15 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
15:06 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on restbase2021.codfw.wmnet with reason: Relocation [production]
15:06 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on restbase2021.codfw.wmnet with reason: Relocation [production]
15:06 <papaul> powerdown ganeti2020 for relocation [production]
15:05 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
14:55 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2021.codfw.wmnet [production]
14:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:38 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
14:37 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/logos.php: Config: [[gerrit:780844|Wikispecies: Fix logo ticket numbers (T306037)]] (2/2, expected no-op) (duration: 00m 55s) [production]
14:36 <lucaswerkmeister-wmde@deploy1002> Synchronized logos/config.yaml: Config: [[gerrit:780844|Wikispecies: Fix logo ticket numbers (T306037)]] (1/2, expected no-op) (duration: 00m 55s) [production]
14:32 <gmodena@deploy1002> Finished deploy [airflow-dags/research@b029f10]: (no justification provided) (duration: 00m 03s) [production]
14:32 <gmodena@deploy1002> Started deploy [airflow-dags/research@b029f10]: (no justification provided) [production]
13:53 <Lucas_WMDE> UTC afternoon backport+config window done [production]
13:52 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (4/4) (duration: 00m 53s) [production]
13:51 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/logos.php: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (3/4) (duration: 01m 00s) [production]
13:50 <lucaswerkmeister-wmde@deploy1002> Synchronized logos/config.yaml: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (2/4) (duration: 00m 55s) [production]
13:48 <lucaswerkmeister-wmde@deploy1002> Synchronized static/images/: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (1/4) (duration: 00m 56s) [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:37 <Lucas_WMDE> relogging four messages that stashbot missed: 13:26 mwdebug-deploy@deploy1002 helmfile [eqiad/codfw] START/DONE helmfile.d/services/mwdebug: apply [production]
13:18 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:780753|Read from the "unexpectedUnconnectedPage" page prop]] (duration: 00m 56s) [production]
13:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:11 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:06 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:06 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:36 <jayme> added ops members to deplotment group - T305729 [production]
08:07 <jayme> fleet wide update of scap to 4.6.1 - T305949 [production]
03:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24630 and previous config saved to /var/cache/conftool/dbconfig/20220414-035105-ladsgroup.json [production]
03:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24629 and previous config saved to /var/cache/conftool/dbconfig/20220414-033600-ladsgroup.json [production]
03:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24628 and previous config saved to /var/cache/conftool/dbconfig/20220414-032055-ladsgroup.json [production]
03:05 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24627 and previous config saved to /var/cache/conftool/dbconfig/20220414-030550-ladsgroup.json [production]
02:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24626 and previous config saved to /var/cache/conftool/dbconfig/20220414-021214-ladsgroup.json [production]
02:12 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1163.eqiad.wmnet with reason: Maintenance [production]
02:12 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1163.eqiad.wmnet with reason: Maintenance [production]
01:25 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
01:25 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]