|
2017-02-03
§
|
| 09:48 |
<marostegui> |
Restart mysql on db1064 to get its binary log changed to ROW - T153743 |
[production] |
| 09:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1064 - T153743 (duration: 00m 40s) |
[production] |
| 09:41 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db1064 - T153743 (duration: 00m 40s) |
[production] |
| 09:39 |
<moritzm> |
upgraded mwdebug* and mw1261 to the new HHVM package |
[production] |
| 09:22 |
<moritzm> |
uploaded hhvm_3.12.11+dfsg-1+wmf2 to apt.wikimedia.org |
[production] |
| 09:10 |
<elukey> |
Replace Redis/Memcached shards mc2008->2011 with mc2026->mc2029 |
[production] |
| 08:50 |
<moritzm> |
installing tomcat regression updates on trusty hosts (jessie update was fine) |
[production] |
| 08:15 |
<moritzm> |
restarting prometheus servers to pick up openssl update |
[production] |
| 08:05 |
<elukey> |
bootstrapping aqs1008-b (AQS Cassandra instance) |
[production] |
| 07:41 |
<moritzm> |
upgrading firejail on remaining wtp/Parsoid hosts |
[production] |
| 07:15 |
<marostegui> |
Stop MySQL db1095 to snapshot it to es1013:/srv/tmp - T153743 |
[production] |
| 02:38 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Feb 3 02:38:10 UTC 2017 (duration 5m 3s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.10) (duration: 12m 06s) |
[production] |
| 00:51 |
<dereckson@tin> |
Synchronized dblists/related-articles-footer-blacklisted-skins.dblist: Adjust RelatedArticles deployment scale for Mobile English Wikipedia (T154681) (duration: 00m 39s) |
[production] |
| 00:48 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Set site name for ku.wiktionary (T29878) (duration: 00m 39s) |
[production] |
| 00:45 |
<dereckson@tin> |
Synchronized wmf-config/: Adjust RelatedArticles deployment scale for Mobile English Wikipedia (T154681) (duration: 00m 42s) |
[production] |
| 00:42 |
<dereckson@tin> |
Synchronized dblists/related-articles-footer-blacklisted-skins.dblist: Enable RelatedArticles on Mobile French Wikipedia (T156362) (duration: 00m 44s) |
[production] |
| 00:33 |
<dereckson@tin> |
Synchronized static/apple-touch/wikipedia.png: Update apple touch icon for Wikipedia (T152538) (duration: 00m 39s) |
[production] |
| 00:24 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Limit page images on beta cluster to images in the lead section (no-op in prod) (duration: 00m 41s) |
[production] |
| 00:17 |
<dereckson@tin> |
Synchronized wmf-config/interwiki.php: Interwiki map update (duration: 00m 40s) |
[production] |
|
2017-02-02
§
|
| 23:51 |
<twentyafterfour> |
1.29.0-wmf.10 appears to be stable. Train deployment complete. |
[production] |
| 23:38 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 |
[production] |
| 23:33 |
<twentyafterfour@tin> |
Synchronized php-1.29.0-wmf.10/includes/cache/MessageCache.php: deploy I5b84b1ae4a9c7b710ee452c61d7d9d6076ec9e6a refs T156996 (duration: 00m 45s) |
[production] |
| 23:11 |
<greg-g> |
Gerrit: we'll be flushing session caches momentarily, sorry for the inconvenience |
[production] |
| 21:50 |
<gehel> |
reimaging relforge1002.eqiad.wmnet |
[production] |
| 20:35 |
<mutante> |
carbon - disabling puppet (to stop it from re-adding second IPv6 address causing issues with ferm rules) |
[production] |
| 20:17 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.29.0-wmf.9 |
[production] |
| 20:14 |
<twentyafterfour> |
rolling back to wmf.9 due to T156996 |
[production] |
| 20:10 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 |
[production] |
| 20:04 |
<twentyafterfour> |
deploying MediaWiki 1.29.0-wmf.10 to all wikis |
[production] |
| 19:29 |
<tgr> |
reset wikimedia 2FA for jdlrobson |
[production] |
| 19:24 |
<tgr> |
reset wikitech 2FA for jdlrobson |
[production] |
| 19:13 |
<hashar> |
Gracefully restarting Jenkins |
[production] |
| 19:09 |
<ejegg> |
updated fundraising tools from 931c8cf1db720723f90307f6a417184bd8c03bfc to 8a65e38807397d91a78f94cfb8013552d75d9772 |
[production] |
| 19:03 |
<ejegg> |
re-enabled thank you mail job |
[production] |
| 18:59 |
<ejegg> |
disabled thank you mail job |
[production] |
| 18:04 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) (duration: 00m 51s) |
[production] |
| 18:03 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) |
[production] |
| 18:01 |
<bearND> |
^ reverted previous deploy due to incorrect links in the news endpoint |
[production] |
| 18:00 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: (no justification provided) (duration: 01m 56s) |
[production] |
| 17:58 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: (no justification provided) |
[production] |
| 17:56 |
<jynus> |
upgrade & restart of db2059 T111654 |
[production] |
| 17:43 |
<jynus> |
upgrade & restart of db2052 T111654 |
[production] |
| 17:32 |
<mobrovac> |
restbase deploy end of 634faea2 |
[production] |
| 17:08 |
<mobrovac> |
restbase deploying 634faea2 |
[production] |
| 16:56 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.10/extensions/ConfirmEdit/maintenance/GenerateFancyCaptchas.php: Fix inclusion path (duration: 00m 41s) |
[production] |
| 16:24 |
<elukey> |
reboot mc2019->mc2025 to see if they come up cleanly (currently codfw replicas of eqiad redis shards) |
[production] |
| 16:13 |
<elukey> |
rebooting mc202[6789] (not serving any traffic) to see if they come up cleanly |
[production] |
| 16:00 |
<elukey> |
rebooting mc203[01234] (not serving any traffic) to see if they come up cleanly |
[production] |
| 15:43 |
<moritzm> |
upgrading firejail on remaining app servers |
[production] |