|
2017-06-09
§
|
| 12:36 |
<gehel> |
reducing high watermark on elasticsearch eqiad to rebalance shards |
[production] |
| 07:51 |
<elukey> |
run megacli -LDSetProp -Direct -LALL -aALL on analytics[1058-1068] - T166140 |
[production] |
| 07:40 |
<moritzm> |
upgrade app servers in codfw running HHVM 3.18 to +wmf5 |
[production] |
| 07:26 |
<elukey> |
run megacli -LDSetProp ADRA -LALL -aALL on analytics[1058-1068] - T166140 |
[production] |
| 07:15 |
<elukey> |
deleted /etc/logrotate.d/nova-manage from labtestvirt2003 to reduce cronspam (same solution used in T132422#2679434) |
[production] |
| 06:58 |
<moritzm> |
updating mw117* to HHVM 3.18+wmf5 |
[production] |
| 06:41 |
<moritzm> |
updating mw1161 to HHVM 3.18 |
[production] |
| 05:57 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1056 - T166206 (duration: 00m 41s) |
[production] |
| 05:51 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1074 - T166205 (duration: 00m 42s) |
[production] |
| 02:25 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Jun 9 02:25:29 UTC 2017 (duration 6m 27s) |
[production] |
| 02:19 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.4) (duration: 06m 04s) |
[production] |
| 00:36 |
<ejegg> |
disabled banner impressions loader |
[production] |
| 00:15 |
<mutante> |
mw1275 depooled (T124956) |
[production] |
| 00:08 |
<ejegg> |
updated CiviCRM from 5a83ee18da383b8a2e4381c82307c7a50d4b973b to dfc26f058327bb6248af44ad39a9864b6c3a6581 |
[production] |
| 00:01 |
<mutante> |
seeing "php: Lost parent, LightProcess exiting" in syslog on mw1275 today (T124956) |
[production] |
|
2017-06-08
§
|
| 23:48 |
<mutante> |
mw1275 - restarted hhvm (php: Lost parent, LightProcess exiting in syslog) |
[production] |
| 23:37 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: remaining wikis to wmf.4 |
[production] |
| 23:16 |
<demon@tin> |
Synchronized php-1.30.0-wmf.4/extensions/CirrusSearch/includes/Job/DeleteArchive.php: Fix array access bug (duration: 00m 43s) |
[production] |
| 23:15 |
<demon@tin> |
Synchronized php-1.30.0-wmf.4/extensions/GeoData/includes/Searcher.php: Temp hax to point GeoData at codfw DC (duration: 00m 43s) |
[production] |
| 22:56 |
<demon@tin> |
Synchronized php-1.30.0-wmf.4/extensions/RevisionSlider/src/RevisionSliderHooks.php: Re-syncing with permanent committed fix (duration: 00m 44s) |
[production] |
| 22:36 |
<ejegg> |
updated civicrm from c70ae650bdf2e670d1dcb77f471b3ac9c5fb05f9 to 5a83ee18da383b8a2e4381c82307c7a50d4b973b |
[production] |
| 22:29 |
<demon@tin> |
Synchronized php-1.30.0-wmf.4/extensions/RevisionSlider/src/RevisionSliderHooks.php: Livehack/test (duration: 00m 44s) |
[production] |
| 22:17 |
<demon@tin> |
Synchronized php-1.30.0-wmf.4/extensions/MobileFrontend/includes/specials/SpecialMobileDiff.php: (no justification provided) (duration: 00m 44s) |
[production] |
| 22:15 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@836b070]: Rate limiting, attempt #2 (duration: 01m 23s) |
[production] |
| 22:13 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@836b070]: Rate limiting, attempt #2 |
[production] |
| 21:56 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@dc1948f]: (no justification provided) (duration: 01m 39s) |
[production] |
| 21:54 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@dc1948f]: (no justification provided) |
[production] |
| 21:54 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@56f7511]: (no justification provided) (duration: 01m 32s) |
[production] |
| 21:52 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@56f7511]: (no justification provided) |
[production] |
| 21:50 |
<mobrovac@tin> |
Finished deploy [changeprop/deploy@56f7511]: (no justification provided) (duration: 00m 34s) |
[production] |
| 21:50 |
<mobrovac@tin> |
Started deploy [changeprop/deploy@56f7511]: (no justification provided) |
[production] |
| 21:42 |
<urandom> |
T160570: Rolling Cassandra restart, restbase-dev |
[production] |
| 21:35 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@56f7511]: Revert previous deploy (duration: 01m 07s) |
[production] |
| 21:34 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@56f7511]: Revert previous deploy |
[production] |
| 21:31 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@56f7511]: dc1948f6bc7b1 Revert previous deploy |
[production] |
| 21:29 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@56f7511]: dc1948f6bc7b1 (duration: 00m 16s) |
[production] |
| 21:29 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@56f7511]: dc1948f6bc7b1 |
[production] |
| 21:24 |
<ppchelko@tin> |
Finished deploy [changeprop/deploy@56f7511]: Rate limiting code and config. T161710 (duration: 01m 46s) |
[production] |
| 21:23 |
<ppchelko@tin> |
Started deploy [changeprop/deploy@56f7511]: Rate limiting code and config. T161710 |
[production] |
| 20:23 |
<RainbowSprinkles> |
gerrit2001: upgraded to 2.13.8+git1-wmf.5 / 2.13.8-1-g7c438d37a2 |
[production] |
| 20:12 |
<mutante> |
imported gerrit_2.13.8+git1-wmf.5_amd64 on apt.wikimedia.org (T158946) |
[production] |
| 19:26 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.4 |
[production] |
| 19:13 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: mw.org -> wmf.4 |
[production] |
| 19:05 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: New wordmark for mk/srwiki (duration: 00m 57s) |
[production] |
| 19:03 |
<demon@tin> |
Synchronized static/images/mobile/copyright/wikipedia-wordmark-sr.svg: new wordmark (duration: 00m 46s) |
[production] |
| 18:59 |
<maxsem@tin> |
Synchronized php-1.30.0-wmf.4/extensions/MobileFrontend/: https://gerrit.wikimedia.org/r/#/c/357846/ (duration: 00m 49s) |
[production] |
| 18:55 |
<maxsem@tin> |
scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
| 18:49 |
<urandom> |
Restarting Cassandra, restbase-dev1001-a to test alternative disk access mode |
[production] |
| 18:42 |
<mutante> |
built gerrit_2.13.8+git1-wmf.5 on copper (T158946) |
[production] |
| 18:40 |
<maxsem@tin> |
Synchronized php-1.30.0-wmf.4/extensions/LoginNotify/: https://gerrit.wikimedia.org/r/#/c/357743/ (duration: 00m 44s) |
[production] |