|
2016-09-08
ยง
|
| 19:57 |
<bblack> |
repooling normal traffic to cache_upload in ulsfo |
[production] |
| 19:02 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.18 |
[production] |
| 18:23 |
<demon@tin> |
Synchronized multiversion/: So much junk to remove (duration: 01m 06s) |
[production] |
| 17:58 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase200[1-9]-b.codfw.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1013-b.eqiad.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1012-b.eqiad.wmnet |
[production] |
| 17:53 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1008-b.eqiad.wmnet |
[production] |
| 17:46 |
<chasemp> |
reboot labstore1004 & labstore1005 |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1011-b.eqiad.wmnet |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1010-b.eqiad.wmnet |
[production] |
| 17:45 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1007-b.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1015-a.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1014-a.eqiad.wmnet |
[production] |
| 17:41 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1009-a.eqiad.wmnet |
[production] |
| 17:11 |
<gehel> |
reverting deploying new LVS configuration for kartotherian.svc.eqiad.wmnet - puppet error, let's analyse slowly... |
[production] |
| 17:06 |
<gehel> |
deploying new LVS configuration for kartotherian.svc.eqiad.wmnet |
[production] |
| 17:04 |
<bd808> |
Updated Striker to 7d7c8ee |
[production] |
| 16:55 |
<demon@tin> |
Synchronized multiversion/: removing more junk - getMWVersion (duration: 01m 07s) |
[production] |
| 16:47 |
<demon@tin> |
Finished scap: removing obsolete p symlink (duration: 04m 25s) |
[production] |
| 16:43 |
<demon@tin> |
Started scap: removing obsolete p symlink |
[production] |
| 16:13 |
<godog> |
roll-restart cassandra instances on restbase-test cluster T143044 |
[production] |
| 16:07 |
<moritzm> |
uploaded linux-meta 1.10 to carbon (pointing to the new 4.4.19 kernel image) |
[production] |
| 14:48 |
<addshore@tin> |
Finished scap: SWAT: [[gerrit:309308|Update jquery.uls from upstream]] (duration: 50m 36s) |
[production] |
| 14:41 |
<gehel> |
deploying new DNS entries for kartotherian.svc.eqiad.wmnet |
[production] |
| 14:36 |
<godog> |
bounce restbase-test2001 cassandra-a instance T143044 |
[production] |
| 13:57 |
<addshore@tin> |
Started scap: SWAT: [[gerrit:309308|Update jquery.uls from upstream]] |
[production] |
| 13:43 |
<moritzm> |
powering down mw2075-mw2079 for hardware maintenance (T142726) |
[production] |
| 13:28 |
<ema> |
upgrading cache_upload ulsfo to varnish 4, dns depooled T131502 |
[production] |
| 13:15 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:304608|Enable mention status notifications everywhere]] (duration: 00m 47s) |
[production] |
| 13:12 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309047|Add massmessage-sender group to urwiki]] (duration: 00m 47s) |
[production] |
| 13:08 |
<addshore@tin> |
Synchronized wmf-config/extension-list: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 3/3 (duration: 00m 47s) |
[production] |
| 13:07 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 2/3 (duration: 00m 46s) |
[production] |
| 13:06 |
<addshore@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:309287|RESTBaseUpdateJobs: Un-deploy the extension]] 1/3 (duration: 00m 49s) |
[production] |
| 12:52 |
<gehel> |
redeploying wdqs on wdqs2002.codfw.wmnet - T144380 |
[production] |
| 12:44 |
<moritzm> |
uploaded new linux package for jessie (based on 4.4.19 with bumped kernel ABI=2) |
[production] |
| 11:35 |
<moritzm> |
reimaging mw2161, mw2162, mw2081, mw2082 to jessie |
[production] |
| 10:14 |
<mobrovac> |
change-prop deploying a991e25 |
[production] |
| 09:46 |
<godog> |
roll-reboot thumbor machines to apply memory cgroup enablement T144938 |
[production] |
| 08:52 |
<gehel> |
initial data mimport on wdqs codfw cluster - T144380 |
[production] |
| 08:23 |
<marostegui> |
Drop tables: ImageMetricsLoadingTime_10078363 and ImageMetricsCorsSupport_11686678 - T141407 |
[production] |
| 06:51 |
<moritzm> |
reimaging mw2212-mw2214 to jessie |
[production] |
| 06:44 |
<elukey> |
reimaging mw2208->mw2211 to jessie |
[production] |
| 03:33 |
<ottomata> |
merging dns change to point archiva.wikimedia.org at new archiva node meitnerium |
[production] |
| 03:24 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Sep 8 03:24:15 UTC 2016 (duration 7m 23s) |
[production] |
| 03:16 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.18) (duration: 18m 14s) |
[production] |
| 02:40 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.17) (duration: 17m 56s) |
[production] |
| 00:46 |
<krenair@tin> |
Synchronized php-1.28.0-wmf.18/extensions/VisualEditor/extension.json: https://gerrit.wikimedia.org/r/#/c/309213/ (duration: 00m 46s) |
[production] |
| 00:42 |
<yurik> |
kartotherian synced T145042 |
[production] |
| 00:15 |
<twentyafterfour> |
upgrade complete. Service restored and everything seems normal. |
[production] |
| 00:14 |
<twentyafterfour> |
phabricator upgrade is running database migrations now, taking longer than expected |
[production] |