|
2022-09-23
§
|
| 13:32 |
<hashar@deploy1002> |
hashar and hashar: Backport for [[gerrit:834531|Stop using Elastica::Type and set the target indices (T318356)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 13:31 |
<hashar@deploy1002> |
Started scap: Backport for [[gerrit:834531|Stop using Elastica::Type and set the target indices (T318356)]] |
[production] |
| 13:29 |
<taavi@deploy1002> |
Finished deploy [horizon/deploy@9d02cd6]: wmf-proxy-dashboard improved error handling (duration: 03m 06s) |
[production] |
| 13:26 |
<taavi@deploy1002> |
Started deploy [horizon/deploy@9d02cd6]: wmf-proxy-dashboard improved error handling |
[production] |
| 13:24 |
<taavi@deploy1002> |
Finished deploy [horizon/deploy@9d02cd6] (dev): wmf-proxy-dashboard improved error handling (duration: 01m 11s) |
[production] |
| 13:23 |
<taavi@deploy1002> |
Started deploy [horizon/deploy@9d02cd6] (dev): wmf-proxy-dashboard improved error handling |
[production] |
| 09:26 |
<jynus> |
stopping db1117:s3 for maintenance T315713 |
[production] |
| 08:51 |
<Emperor> |
rebalance ms-eqiad swift rings T294550 |
[production] |
| 07:36 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db[2134,2160].codfw.wmnet,db[1117,1159].eqiad.wmnet with reason: Grants fixing |
[production] |
| 07:36 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4:00:00 on db[2134,2160].codfw.wmnet,db[1117,1159].eqiad.wmnet with reason: Grants fixing |
[production] |
| 06:10 |
<marostegui> |
Shutdown db1189 T317662 |
[production] |
| 06:09 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db1189.eqiad.wmnet with reason: on site maintenance |
[production] |
| 06:09 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db1189.eqiad.wmnet with reason: on site maintenance |
[production] |
|
2022-09-22
§
|
| 22:20 |
<joal@deploy1002> |
Finished deploy [airflow-dags/analytics@901f810]: (no justification provided) (duration: 00m 11s) |
[production] |
| 22:19 |
<joal@deploy1002> |
Started deploy [airflow-dags/analytics@901f810]: (no justification provided) |
[production] |
| 21:29 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:28 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 21:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 21:23 |
<dancy@deploy1002> |
backport aborted: (duration: 00m 05s) |
[production] |
| 20:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:56 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:55 |
<brennen> |
end of utc late backport & config window |
[production] |
| 20:55 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:54 |
<brennen@deploy1002> |
Finished scap: Backport for [[gerrit:834364|Restrict figure to the size of the media (T305357 T318300)]], [[gerrit:834366|Fix media alignment since disabling wgParserEnableLegacyMediaDOM (T318300)]] (duration: 06m 33s) |
[production] |
| 20:53 |
<joal@deploy1002> |
Finished deploy [airflow-dags/analytics@6c81e6f]: (no justification provided) (duration: 00m 10s) |
[production] |
| 20:53 |
<joal@deploy1002> |
Started deploy [airflow-dags/analytics@6c81e6f]: (no justification provided) |
[production] |
| 20:48 |
<brennen@deploy1002> |
brennen and arlolra: Backport for [[gerrit:834364|Restrict figure to the size of the media (T305357 T318300)]], [[gerrit:834366|Fix media alignment since disabling wgParserEnableLegacyMediaDOM (T318300)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 20:47 |
<brennen@deploy1002> |
Started scap: Backport for [[gerrit:834364|Restrict figure to the size of the media (T305357 T318300)]], [[gerrit:834366|Fix media alignment since disabling wgParserEnableLegacyMediaDOM (T318300)]] |
[production] |
| 20:36 |
<brennen@deploy1002> |
backport aborted: (duration: 02m 16s) |
[production] |
| 20:34 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:34 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:34 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:32 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:27 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:26 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:26 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:25 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:25 |
<brennen@deploy1002> |
Finished scap: Backport for [[gerrit:833817|Drops JS-side creation of "Source" link (T318266)]] (duration: 06m 09s) |
[production] |
| 20:19 |
<brennen@deploy1002> |
brennen and tpt: Backport for [[gerrit:833817|Drops JS-side creation of "Source" link (T318266)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet |
[production] |
| 20:19 |
<brennen@deploy1002> |
Started scap: Backport for [[gerrit:833817|Drops JS-side creation of "Source" link (T318266)]] |
[production] |
| 20:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 20:14 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 20:13 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 19:45 |
<bking@cumin2002> |
END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) |
[production] |
| 18:38 |
<jhuneidi@deploy1002> |
Started scap: testing |
[production] |
| 18:38 |
<dancy@deploy1002> |
Started scap: testing |
[production] |
| 18:37 |
<jhuneidi@deploy1002> |
Started scap: testing |
[production] |