|
2022-04-14
§
|
| 15:06 |
<hnowlan@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on restbase2021.codfw.wmnet with reason: Relocation |
[production] |
| 15:06 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on restbase2021.codfw.wmnet with reason: Relocation |
[production] |
| 15:06 |
<papaul> |
powerdown ganeti2020 for relocation |
[production] |
| 15:05 |
<btullis@deploy1002> |
helmfile [staging] START helmfile.d/services/datahub: apply on main |
[production] |
| 14:55 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=restbase2021.codfw.wmnet |
[production] |
| 14:38 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 14:38 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 14:38 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 14:38 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 14:37 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/logos.php: Config: [[gerrit:780844|Wikispecies: Fix logo ticket numbers (T306037)]] (2/2, expected no-op) (duration: 00m 55s) |
[production] |
| 14:36 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized logos/config.yaml: Config: [[gerrit:780844|Wikispecies: Fix logo ticket numbers (T306037)]] (1/2, expected no-op) (duration: 00m 55s) |
[production] |
| 14:32 |
<gmodena@deploy1002> |
Finished deploy [airflow-dags/research@b029f10]: (no justification provided) (duration: 00m 03s) |
[production] |
| 14:32 |
<gmodena@deploy1002> |
Started deploy [airflow-dags/research@b029f10]: (no justification provided) |
[production] |
| 13:53 |
<Lucas_WMDE> |
UTC afternoon backport+config window done |
[production] |
| 13:52 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (4/4) (duration: 00m 53s) |
[production] |
| 13:51 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/logos.php: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (3/4) (duration: 01m 00s) |
[production] |
| 13:50 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized logos/config.yaml: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (2/4) (duration: 00m 55s) |
[production] |
| 13:48 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized static/images/: Config: [[gerrit:780728|fawiki: Change wordmark & tagline (new Vector) and logo (legacy Vector) (T306030)]] (1/4) (duration: 00m 56s) |
[production] |
| 13:47 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:47 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 13:47 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:47 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 13:37 |
<Lucas_WMDE> |
relogging four messages that stashbot missed: 13:26 mwdebug-deploy@deploy1002 helmfile [eqiad/codfw] START/DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:18 |
<hoo@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:780753|Read from the "unexpectedUnconnectedPage" page prop]] (duration: 00m 56s) |
[production] |
| 13:11 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:11 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 13:11 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:11 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 13:06 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:06 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 13:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 13:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 08:36 |
<jayme> |
added ops members to deplotment group - T305729 |
[production] |
| 08:07 |
<jayme> |
fleet wide update of scap to 4.6.1 - T305949 |
[production] |
| 03:51 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24630 and previous config saved to /var/cache/conftool/dbconfig/20220414-035105-ladsgroup.json |
[production] |
| 03:36 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24629 and previous config saved to /var/cache/conftool/dbconfig/20220414-033600-ladsgroup.json |
[production] |
| 03:20 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P24628 and previous config saved to /var/cache/conftool/dbconfig/20220414-032055-ladsgroup.json |
[production] |
| 03:05 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24627 and previous config saved to /var/cache/conftool/dbconfig/20220414-030550-ladsgroup.json |
[production] |
| 02:12 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1163 (T298565)', diff saved to https://phabricator.wikimedia.org/P24626 and previous config saved to /var/cache/conftool/dbconfig/20220414-021214-ladsgroup.json |
[production] |
| 02:12 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1163.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:12 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1163.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:25 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance |
[production] |
| 01:25 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance |
[production] |
| 00:37 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1140.eqiad.wmnet with reason: Maintenance |
[production] |
| 00:37 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1140.eqiad.wmnet with reason: Maintenance |
[production] |
| 00:37 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1105:3311 (T298565)', diff saved to https://phabricator.wikimedia.org/P24625 and previous config saved to /var/cache/conftool/dbconfig/20220414-003750-ladsgroup.json |
[production] |
| 00:22 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1105:3311', diff saved to https://phabricator.wikimedia.org/P24624 and previous config saved to /var/cache/conftool/dbconfig/20220414-002245-ladsgroup.json |
[production] |
| 00:07 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1105:3311', diff saved to https://phabricator.wikimedia.org/P24623 and previous config saved to /var/cache/conftool/dbconfig/20220414-000740-ladsgroup.json |
[production] |