|
2017-10-25
§
|
| 10:32 |
<moritzm> |
upgrade remaining video scalers in eqiad to wikidiff2 1.5.1 |
[production] |
| 10:31 |
<mobrovac@tin> |
Started deploy [restbase/deploy@2ae5b0c]: Remove /title/{title}/ and double-process all summaries - T158100 |
[production] |
| 09:31 |
<moritzm> |
upgrade mw1221-mw1235 to wikidiff2 (API servers) |
[production] |
| 09:07 |
<gehel> |
rolling restart of all wdqs nodes for GC config change - T175919 |
[production] |
| 08:12 |
<moritzm> |
upgrade mw1238-mw1258 to wikidiff2 |
[production] |
| 08:02 |
<_joe_> |
decommissioning mw1168/69 as videoscalers, stopped jobrunner/jobchron, will stop hhvm/nginx/apache once current processing is done |
[production] |
| 07:42 |
<gehel@tin> |
Finished deploy [wdqs/wdqs@0bb2b5c]: wdqs-updater upgrade for jolokia - T167842 (duration: 01m 44s) |
[production] |
| 07:40 |
<gehel@tin> |
Started deploy [wdqs/wdqs@0bb2b5c]: wdqs-updater upgrade for jolokia - T167842 |
[production] |
| 07:05 |
<marostegui> |
Optimize pagelinks and templatelinks on db1021 - T174509 |
[production] |
| 06:15 |
<marostegui> |
Stop MySQL on db2038 to copy its data to db2084 - T178359 |
[production] |
| 06:08 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2035 - T178359 (duration: 00m 50s) |
[production] |
| 06:02 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 - T174509 (duration: 00m 50s) |
[production] |
| 05:44 |
<marostegui> |
Stop replication in sync on db1103 and db1077 to checksum data - T164488 |
[production] |
| 05:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1077 - T164488 (duration: 01m 00s) |
[production] |
| 03:22 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Oct 25 03:22:51 UTC 2017 (duration 7m 20s) |
[production] |
| 03:15 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.5) (duration: 16m 46s) |
[production] |
| 02:35 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.4) (duration: 08m 59s) |
[production] |
|
2017-10-24
§
|
| 22:54 |
<ejegg> |
updated civicrm from from 0546446640c8b7485c78b4f3836a38630248b44e to 25c7a33e3e3e9b8a5020d826982b3dbb64057614 |
[production] |
| 21:24 |
<ejegg> |
updated civicrm from 18edce1c58d5f71e7a8eed6ec18724fef834859e to 0546446640c8b7485c78b4f3836a38630248b44e |
[production] |
| 21:21 |
<mepps> |
updated payments-wiki from 101143408f744b4bc053b12bea413769bb14d427 to b88b805c3b223404578c3ef8bb675e710611aa2d |
[production] |
| 20:47 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@UNKNOWN]: (no justification provided) (duration: 00m 13s) |
[production] |
| 20:47 |
<arlolra@tin> |
Started deploy [parsoid/deploy@UNKNOWN]: (no justification provided) |
[production] |
| 20:29 |
<mutante> |
restarting gerrit to make gerrit-ssh listen on all IPs again |
[production] |
| 19:49 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@UNKNOWN]: Enabling logging for skwiki posts (duration: 00m 35s) |
[production] |
| 19:48 |
<arlolra@tin> |
Started deploy [parsoid/deploy@UNKNOWN]: Enabling logging for skwiki posts |
[production] |
| 19:46 |
<mutante> |
restarting gerrit on cobalt to apply change 354074 |
[production] |
| 19:13 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.5 |
[production] |
| 18:57 |
<awight@tin> |
Finished deploy [ores/deploy@fb55ab8]: Rollback ORES to Revscoring 1.0, T175180 (duration: 10m 13s) |
[production] |
| 18:47 |
<awight@tin> |
Started deploy [ores/deploy@fb55ab8]: Rollback ORES to Revscoring 1.0, T175180 |
[production] |
| 18:47 |
<ejegg> |
updated civicrm from b9d2067671dd68e1c3466863ffd10ab2748c7eaf to 18edce1c58d5f71e7a8eed6ec18724fef834859e |
[production] |
| 18:26 |
<awight@tin> |
Finished deploy [ores/deploy@fb55ab8]: Update ORES to revscoring 2.x, T175180 (take 2) (duration: 10m 03s) |
[production] |
| 18:16 |
<awight@tin> |
Started deploy [ores/deploy@fb55ab8]: Update ORES to revscoring 2.x, T175180 (take 2) |
[production] |
| 18:05 |
<arlolra> |
Updated Parsoid to a3be9cfc (T96923, T177784, T176568, T25467) |
[production] |
| 17:57 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@af55c4b]: Updating Parsoid to a3be9cfc (duration: 09m 16s) |
[production] |
| 17:48 |
<arlolra@tin> |
Started deploy [parsoid/deploy@af55c4b]: Updating Parsoid to a3be9cfc |
[production] |
| 17:28 |
<demon@tin> |
Finished scap: bootstrap wmf.5 (duration: 48m 34s) |
[production] |
| 17:18 |
<urandom> |
T178845: Rolling Cassandra restart, eqiad |
[production] |
| 17:07 |
<awight@tin> |
Started deploy [ores/deploy@fb55ab8]: Update ORES to revscoring 2.x, T175180 |
[production] |
| 16:50 |
<herron> |
upgrading puppet packages on codfw puppetmaster T177254 |
[production] |
| 16:39 |
<demon@tin> |
Started scap: bootstrap wmf.5 |
[production] |
| 16:10 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.3 [keeping static files] (duration: 01m 20s) |
[production] |
| 15:58 |
<elukey> |
drop MediaViewer_10867062_15423246 and MobileWebUIClickTracking_10742159_15423246 from the log database on db1046 (archived on hadoop) - T168303 |
[production] |
| 15:53 |
<urandom> |
T178845: Rolling Cassandra restart, codfw, row b |
[production] |
| 15:48 |
<elukey> |
drop table Edit_13457736_15423246 from the log database (Eventlogging) on db104[6,7], dbstore1002 |
[production] |
| 15:39 |
<elukey> |
set net.netfilter.nf_conntrack_tcp_timeout_time_wait=65 to mw[1308-1311] - T136094 |
[production] |
| 15:09 |
<gehel> |
restarting blazegraph on all wdqs nodes for GC config change - T175919 |
[production] |
| 14:48 |
<_joe_> |
also stopping HHVM, nginx, apache2 , and disabling all the services |
[production] |
| 14:46 |
<_joe_> |
stopping the jobrunner service on mw1161-67 |
[production] |
| 14:39 |
<marostegui> |
Optimize pagelinks templatelinks and recentchanges on db1030 - T174509 https://phabricator.wikimedia.org/T177772 |
[production] |
| 14:36 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T174509 (duration: 00m 45s) |
[production] |