|
2016-07-15
§
|
| 11:56 |
<bblack> |
varnish: starting rolling, depooled restart of text and upload frontend caches |
[production] |
| 11:03 |
<godog> |
swift codfw-prod: ms-be202[567] weight 2500 |
[production] |
| 10:30 |
<twentyafterfour> |
deployed rPHABacb736547c6595fe09e05bafd7a3b563d3cf67c8 and rPHABcf12fdf248df82dc414d96bddd147c058bc3d636 to address maniphest task dependency graphs. Now related tasks will be shown as a plain list when there are too many tasks to graph. |
[production] |
| 10:15 |
<mobrovac> |
restbase deploy end of 018864b |
[production] |
| 10:03 |
<mobrovac> |
restbase deploy start of 018864b |
[production] |
| 09:33 |
<jynus> |
renabling semisync replication throughout s4 |
[production] |
| 09:31 |
<jynus> |
restarted circular replication from db2019 -> db1040 |
[production] |
| 09:22 |
<jynus> |
updating dns record for s4-master.eqiad.wmnet |
[production] |
| 08:13 |
<jynus> |
reimporting x1 partial db copy on dbstore1002 from x1-master |
[production] |
| 07:29 |
<moritzm> |
installing PHP security updates on jessie systems |
[production] |
| 07:27 |
<_joe_> |
powercycling mw1280 |
[production] |
| 06:47 |
<moritzm> |
installing nspr security updates |
[production] |
| 06:08 |
<moritzm> |
installing libarchive security updates |
[production] |
| 02:35 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Jul 15 02:35:16 UTC 2016 (duration 6m 14s) |
[production] |
| 02:29 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.10) (duration: 07m 54s) |
[production] |
|
2016-07-14
§
|
| 23:10 |
<ebernhardson@tin> |
Synchronized php-1.28.0-wmf.10/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T137169: Turn of TextCat A/B test (duration: 00m 34s) |
[production] |
| 21:08 |
<matt_flaschen> |
Started backfillReadBundles.php on all group 2 wikis |
[production] |
| 21:07 |
<matt_flaschen> |
Started backfillUnreadWikis.php --rebuild on all group 2 wikis |
[production] |
| 20:40 |
<yurik> |
restarted graphoid with the new settings, enabling geoshape protocol |
[production] |
| 20:02 |
<ottomata> |
restarting hadoop-yarn-resourcemanager on analytics1002 and then analytics1001 to apply yarn log aggregation change |
[production] |
| 19:56 |
<aude@tin> |
Synchronized php-1.28.0-wmf.10/extensions/RevisionSlider: touching js and resource files (duration: 00m 28s) |
[production] |
| 19:22 |
<demon@tin> |
Synchronized wmf-config/CommonSettings-labs.php: maps geoshapes stuff for yurik (labs file for completeness) (duration: 00m 27s) |
[production] |
| 19:21 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: maps geoshapes stuff for yurik (duration: 00m 31s) |
[production] |
| 19:19 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Move remaining wikis to wmf.10 |
[production] |
| 19:00 |
<urandom> |
Dropping legacy Cassandra system_auth tables in RESTBase production to complete RBAC conversion : T139639 |
[production] |
| 15:52 |
<aude@tin> |
Synchronized wmf-config/CommonSettings-labs.php: (no message) (duration: 00m 32s) |
[production] |
| 15:50 |
<aude@tin> |
Synchronized dblists/clldefault.dblist: Enable compact language lists on more wikis (duration: 00m 51s) |
[production] |
| 15:40 |
<jynus> |
shutting down es2018, pc2004, es2005 for hardware maintenance T139714 |
[production] |
| 15:35 |
<aude@tin> |
Finished scap: Update i18n for RevisionSlider (duration: 46m 58s) |
[production] |
| 15:08 |
<jynus> |
shutting down es2014, es2015, es2016 for hardware maintenance T139714 |
[production] |
| 14:56 |
<bblack> |
cache_misc: manually raised default_ttl to 3600 (to match https://gerrit.wikimedia.org/r/#/c/298970/ without restarts) |
[production] |
| 14:48 |
<aude@tin> |
Started scap: Update i18n for RevisionSlider |
[production] |
| 14:48 |
<jynus> |
shutting down es2011, es2012, es2013 for hardware maintenance T139714 |
[production] |
| 14:47 |
<aude@tin> |
scap aborted: (no message) (duration: 00m 02s) |
[production] |
| 14:47 |
<aude@tin> |
Started scap: (no message) |
[production] |
| 14:45 |
<aude@tin> |
Synchronized wmf-config/CommonSettings.php: Enable RevisionSlider on test wikis (duration: 00m 28s) |
[production] |
| 14:44 |
<aude@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable RevisionSlider on test wikis (duration: 00m 27s) |
[production] |
| 14:38 |
<aude@tin> |
Synchronized wmf-config/extension-list: Add RevisionSlider to extension-list (duration: 00m 42s) |
[production] |
| 09:58 |
<godog> |
powercycle ms-be1012, adding back replaced disk |
[production] |
| 08:40 |
<Amir1> |
for ores |
[production] |
| 08:40 |
<Amir1> |
deploying 0e9555f to scb nodes |
[production] |
| 08:39 |
<elukey> |
restarted hhvm on mw1289 mw1280 mw1288 mw1284 mw1287 |
[production] |
| 08:18 |
<jynus> |
running "megacli -PDOffline -PhysDrv '[32:6]' -aALL" on dbstore1002 to debug issue T140337 |
[production] |
| 08:06 |
<elukey> |
upgrading cache misc to varnishkafka 1.0.11-1 |
[production] |
| 08:03 |
<_joe_> |
removing appservers mw1018-25 from service via conftool for decommissioning (T139353) |
[production] |
| 08:01 |
<elukey> |
removing api servers mw111[4-9] from service via conftool as first decom step (T139353) |
[production] |
| 07:55 |
<elukey> |
removing api servers mw112[0-9] from service via conftool as first decom step (T139353) |
[production] |
| 06:45 |
<moritzm> |
restarted hhvm on mw1170 |
[production] |
| 06:07 |
<moritzm> |
upgrading hhvm in codfw |
[production] |
| 04:22 |
<twentyafterfour> |
Phabricator hotfix: applied patch to disable task graph on tasks with > 100 related tasks. |
[production] |