|
2019-12-12
§
|
| 05:57 |
<aborrero@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 05:57 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:56 |
<aborrero@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 05:56 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:56 |
<aborrero@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 05:56 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:47 |
<marostegui> |
Deploy schema change on db1102:3314 |
[production] |
| 05:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1097:3314 after schema change T233135', diff saved to https://phabricator.wikimedia.org/P9861 and previous config saved to /var/cache/conftool/dbconfig/20191212-054708-marostegui.json |
[production] |
| 03:25 |
<ejegg> |
updated fundraising internal dashboard from 3917f7d9dc to c1ded3c473 |
[production] |
| 01:42 |
<volker-e@deploy1001> |
Finished deploy [design/style-guide@481eaf6]: Deploy design/style-guide: (duration: 00m 07s) |
[production] |
| 01:41 |
<volker-e@deploy1001> |
Started deploy [design/style-guide@481eaf6]: Deploy design/style-guide: |
[production] |
|
2019-12-11
§
|
| 23:42 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Add ability to load the DiscussionTools extension, disabled everywhere T240468 (duration: 01m 02s) |
[production] |
| 23:30 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Set wmgUseDiscussionTools false everywhere T240468 (duration: 01m 03s) |
[production] |
| 23:19 |
<jforrester@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.10 (duration: 01m 02s) |
[production] |
| 23:18 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.10 |
[production] |
| 23:13 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/CentralNotice/includes/CentralNoticeHooks.php: T240505 Remove CentralNotice's used of deprecated jquery.ui module aliases (duration: 01m 25s) |
[production] |
| 22:59 |
<cstone> |
civicrm revision changed from 7b971ac58c to 8c8aa0e6d3 |
[production] |
| 22:08 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@5ba7506]: (no justification provided) (duration: 01m 51s) |
[production] |
| 22:07 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@5ba7506]: (no justification provided) |
[production] |
| 22:04 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@5ba7506]: (no justification provided) (duration: 07m 13s) |
[production] |
| 21:57 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@5ba7506]: (no justification provided) |
[production] |
| 21:40 |
<arlolra> |
Updated Parsoid to af576d5 (T237693, T238777, T237306, T239875, T240053) |
[production] |
| 21:31 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@5ba7506]: Updating Parsoid to af576d5 (duration: 09m 12s) |
[production] |
| 21:21 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@5ba7506]: Updating Parsoid to af576d5 |
[production] |
| 21:17 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group1 back to 1.34.0-wmf.8 |
[production] |
| 21:16 |
<jforrester@deploy1001> |
sync-wikiversions aborted: group0 to 1.34.0-wmf.0 (duration: 00m 00s) |
[production] |
| 20:39 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: MachineVision: Remove testing group restriciton on commonswiki (duration: 01m 04s) |
[production] |
| 20:36 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: MachineVision: Show UploadWizard CTA on commonswiki (duration: 01m 03s) |
[production] |
| 20:32 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: MachineVision: Update labeling job delay to 48 hours (duration: 01m 05s) |
[production] |
| 20:11 |
<jforrester@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.10 (duration: 01m 02s) |
[production] |
| 20:10 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.10 |
[production] |
| 19:53 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1097:3314 for schema change T233135', diff saved to https://phabricator.wikimedia.org/P9858 and previous config saved to /var/cache/conftool/dbconfig/20191211-195306-marostegui.json |
[production] |
| 19:51 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1103:3314 after schema change T233135', diff saved to https://phabricator.wikimedia.org/P9857 and previous config saved to /var/cache/conftool/dbconfig/20191211-195130-marostegui.json |
[production] |
| 19:43 |
<awight> |
Morning SWAT complete |
[production] |
| 19:43 |
<eileen> |
re-enabled dedupe (off from last night benevity import attempt) |
[production] |
| 19:43 |
<eileen> |
process-control config revision is 8c073ae64a |
[production] |
| 19:34 |
<awight@deploy1001> |
Synchronized php-1.35.0-wmf.8/extensions/Cite: SWAT: [[gerrit:556372|Lazily fetch user interface language to prevent cache split (take 2) (T240426, T239988)]] (duration: 00m 40s) |
[production] |
| 19:33 |
<awight> |
Overriding scap canaries for T240426 |
[production] |
| 19:24 |
<awight@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 19:18 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: eaa4c2c: Remove unused wmgCheckUserForceSummary (duration: 01m 01s) |
[production] |
| 19:15 |
<urbanecm@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (duration: 01m 02s) |
[production] |
| 19:11 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (duration: 01m 02s) |
[production] |
| 19:10 |
<urbanecm@deploy1001> |
sync-file aborted: SWAT: c8fe811: Use wgCheckUserForceSummary instead of wmgCheckUserForceSummary (T239936) (duration: 00m 02s) |
[production] |
| 19:08 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 9ca31f4: Enable CheckUser Special:Investigate page on testwiki (T239936) (duration: 01m 02s) |
[production] |
| 18:53 |
<mholloway-shell@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/MachineVision: Fix no-JS warning message (T240210) (duration: 01m 02s) |
[production] |
| 16:43 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/Wikibase/lib/includes/Store/Sql/SqlEntityInfoBuilder.php: Consider any type of empty value as uncached in SqlEntityInfoBuilder (T237984) (duration: 01m 03s) |
[production] |
| 16:39 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.8/extensions/Wikibase/lib/includes/Store/Sql/SqlEntityInfoBuilder.php: Consider any type of empty value as uncached in SqlEntityInfoBuilder (T237984) (duration: 01m 03s) |
[production] |
| 16:28 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp1075.eqiad.wmnet,service=ats-be |
[production] |
| 16:28 |
<ema> |
cp1075 ats-be: temporarily switch to plain HTTP for api and appservers (apache directly instead of nginx) |
[production] |
| 16:24 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp1075.eqiad.wmnet,service=ats-be |
[production] |