|
2020-04-21
§
|
| 13:11 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 13:10 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 11:15 |
<mutante> |
recreating cert for contint/integration to add integration.mediawiki.org in addition to integration.wikimedia.org |
[production] |
| 11:06 |
<mutante> |
https://integration.wikimedia.org now also using TLS between ATS and contint1001 using envoy (T210411) |
[production] |
| 10:49 |
<_joe_> |
mwdebug1001:~# iptables -A INPUT -s 10.64.32.208 -m statistic --mode random --probability 0.1 -j DROP (T240684) |
[production] |
| 08:52 |
<ema> |
purged: rolling restart with 4 frontend workers |
[production] |
| 07:54 |
<ema> |
cp3050: restart purged with 4 frontend workers |
[production] |
| 07:47 |
<kormat> |
dropping old data and optimizing tables on pc1010 and pc2010 T247787 |
[production] |
| 07:26 |
<ema> |
cp4032: restart ats-tls and ats-be |
[production] |
| 07:06 |
<ema> |
cp4026: restart ats-tls and ats-be |
[production] |
| 06:30 |
<marostegui> |
Rename flagged* tables on mediawikiwiki on db1075 - T248298 |
[production] |
| 06:24 |
<XioNoX> |
restore eqsin/ulsfo OSPF metric - T250653 |
[production] |
| 05:46 |
<marostegui> |
Deploy schema change on s6 codfw master |
[production] |
| 05:34 |
<marostegui> |
Add db1095:3312, db1095:3320 to tendril - T250602 |
[production] |
| 05:32 |
<moritzm> |
installing git security updates |
[production] |
| 05:19 |
<marostegui> |
Deploy schema change on s2 codfw - T250055 |
[production] |
| 05:09 |
<vgutierrez> |
rolling restart of ats-tls to enable SSL_OP_PRIORITIZE_CHACHA |
[production] |
|
2020-04-20
§
|
| 23:29 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Update project wordmarks and icons (T249047) (duration: 01m 01s) |
[production] |
| 23:27 |
<catrope@deploy1001> |
Synchronized static/images/mobile/: Update project wordmarks and icons (T249047) (duration: 01m 02s) |
[production] |
| 23:14 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Add media.api.aucklandmuseum.com to $wgCopyUploadsDomains (T250646) (duration: 01m 08s) |
[production] |
| 21:11 |
<mepps> |
update civicrm from 1224b080c1 to e8a0b5395d |
[production] |
| 20:32 |
<ejegg|food> |
updated fundraising python tools from a93eec292d to c96813eda4 |
[production] |
| 20:14 |
<halfak@deploy1001> |
Finished deploy [ores/deploy@514f94a]: T250536 (duration: 14m 06s) |
[production] |
| 20:00 |
<halfak@deploy1001> |
Started deploy [ores/deploy@514f94a]: T250536 |
[production] |
| 19:53 |
<addshore> |
pool wdqs1006 again (caught up) |
[production] |
| 19:53 |
<cdanis@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=wdqs,name=eqiad |
[production] |
| 19:45 |
<jforrester@deploy1001> |
Synchronized wmf-config/PoolCounterSettings.php: Revert CirrusSearch-MoreLike pool conter numbers now rebuild is done (duration: 01m 01s) |
[production] |
| 19:43 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: cirrus: Move more_like from codfw back to eqiad, rebuild complete (duration: 01m 03s) |
[production] |
| 19:40 |
<rzl> |
mcrouter certs renewed on puppetmaster1001; puppet re-enabled on mcrouter hosts and will update certs naturally over the next 30m T248093 |
[production] |
| 18:39 |
<rzl> |
disabling puppet on all mcrouter hosts for cert renewal T248093 |
[production] |
| 18:38 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T248418 [testwiki] Force videojs-only mode for TimedMediaHandler (duration: 01m 01s) |
[production] |
| 18:36 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.28/extensions/MassMessage/includes/SpecialEditMassMessageList.php: T250710 Follow-up 95c772864: Fix RevisionRecord calls that differ from Revision (duration: 01m 02s) |
[production] |
| 18:27 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Adjust Parsoid/VE disable comment for wikitechwiki (duration: 01m 02s) |
[production] |
| 18:23 |
<otto@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 18:22 |
<otto@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 18:21 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 18:21 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 18:20 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Adjust dummy name of fake Parsoid extension to just 'Parsoid' (duration: 01m 01s) |
[production] |
| 18:19 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 18:19 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 18:14 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T236104 Wait to update the globals cache file for opcache regeneration (duration: 01m 02s) |
[production] |
| 18:11 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 02s) |
[production] |
| 18:06 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 02s) |
[production] |
| 18:05 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: DiscussionTools: EditAttemptStepSamplingRate increase for some wikis T250086 (duration: 01m 10s) |
[production] |
| 15:33 |
<Urbanecm> |
mwscript importImages.php --wiki=commonswiki --comment-ext=txt --user=Victorgrigas /home/urbanecm/upload (T250687) |
[production] |
| 15:10 |
<marostegui> |
Upgrade db2079 |
[production] |
| 14:57 |
<cdanis@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=wdqs,name=eqiad |
[production] |
| 14:54 |
<addshore> |
restart blazegraph on wdqs1006 |
[production] |
| 14:53 |
<addshore> |
depool wdqs1006 as it stopped updating |
[production] |
| 14:28 |
<marostegui> |
Upgrade db2096 (x1 codfw master) |
[production] |