|
2018-04-02
§
|
| 09:12 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Remove references to virt1000 (duration: 01m 16s) |
[production] |
| 08:50 |
<marostegui> |
Deploy schema change on s3 codfw master db2043 (this will generate lag on codfw) - T187089 T185128 T153182 |
[production] |
| 08:21 |
<jynus> |
stop mariadb at labsdb1009 and labsdb1010 |
[production] |
| 08:15 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Specify current m5 codfw master (duration: 01m 17s) |
[production] |
| 08:11 |
<jynus> |
depool labsdb1011 from web wikirreplicas |
[production] |
| 07:21 |
<apergos> |
restarted pdfrender on scb1004 after poking around there a bit |
[production] |
| 07:01 |
<apergos> |
restarted pdfrender on scb1001,2, service paged and no jobs were being processed |
[production] |
| 06:06 |
<marostegui> |
Drop localisation table from the hosts where it still existed - T119811 |
[production] |
| 02:50 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.26) (duration: 12m 53s) |
[production] |
|
2018-03-30
§
|
| 14:16 |
<akosiaris> |
T189076 upload apertium-fra-cat to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 12:47 |
<akosiaris> |
T189076 upload apertium-cat to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 12:47 |
<akosiaris> |
T189075 upload apertium-lex-tools to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 12:47 |
<akosiaris> |
T189075 upload apertium-separable to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 12:47 |
<akosiaris> |
T189076 upload apertium-fra to apt.wikimedia.org/jessie-wikimedia/main |
[production] |
| 11:44 |
<dcausse> |
running forceSearchIndex from terbium to cleanup elastic indices for (testwiki, mediawikiwiki, labswiki, labtestwiki, svwiki) (T189694) |
[production] |
| 11:40 |
<dcausse> |
elastic@codfw cluster restarts complete (T189239) |
[production] |
| 10:55 |
<dcausse> |
resuming elastic@codfw cluster restarts |
[production] |
| 10:17 |
<elukey> |
roll restart of zookeeper daemons on druid100[123] (Druid analytics cluster) to pick up the new prometheus jmx agent |
[production] |
| 09:31 |
<elukey> |
restart oozie/hive daemons on an1003 for openjdk-8 upgrades |
[production] |
| 08:38 |
<elukey> |
rolling restart of hadoop-hdfs-datanode on all the hadoop worker nodes after https://gerrit.wikimedia.org/r/423000 |
[production] |
| 07:39 |
<elukey> |
rolling restart of yarn-hadoop-nodemanagers on all the hadoop worker nodes after https://gerrit.wikimedia.org/r/423000 |
[production] |
|
2018-03-29
§
|
| 23:47 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: T189252: Enable perf oversampling for remaining countries in Asia (duration: 01m 16s) |
[production] |
| 23:40 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.27/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Start cirrus AB test (duration: 01m 16s) |
[production] |
| 23:37 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.26/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Start cirrus AB test (duration: 01m 16s) |
[production] |
| 23:12 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: T187148: Configure 5 buckets for cirrus AB test (duration: 01m 17s) |
[production] |
| 22:10 |
<andrew@tin> |
Finished deploy [horizon/deploy@14d3e7d]: Updating Horizon with possible fix for T189706 (duration: 03m 16s) |
[production] |
| 22:06 |
<andrew@tin> |
Started deploy [horizon/deploy@14d3e7d]: Updating Horizon with possible fix for T189706 |
[production] |
| 20:07 |
<robh> |
shuttdown cp2022 for hw testing |
[production] |
| 18:49 |
<maxsem@tin> |
Synchronized php-1.31.0-wmf.27/skins/MinervaNeue: https://gerrit.wikimedia.org/r/#/c/423012/ (duration: 01m 17s) |
[production] |
| 18:27 |
<maxsem@tin> |
Synchronized php-1.31.0-wmf.26/includes/: Shorten summary length to 500 (duration: 02m 06s) |
[production] |
| 18:22 |
<maxsem@tin> |
Synchronized php-1.31.0-wmf.27/includes/: Shorten summary length to 500 (duration: 02m 14s) |
[production] |
| 17:55 |
<dcausse> |
pausing restarts of elastic@codfw (6 nodes left) |
[production] |
| 17:35 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@af592d6]: Add bawikibooks - T191033 (duration: 30m 35s) |
[production] |
| 17:30 |
<demon@tin> |
Synchronized docroot/wwwportal/w/search-redirect.php: removing symlink indirection (duration: 01m 16s) |
[production] |
| 17:05 |
<mobrovac@tin> |
Started deploy [restbase/deploy@af592d6]: Add bawikibooks - T191033 |
[production] |
| 14:54 |
<mobrovac@tin> |
Synchronized wmf-config/jobqueue.php: Cleanup: Use only EventBus for refreshLinks - T185052 (duration: 01m 18s) |
[production] |
| 14:00 |
<moritzm> |
restarting parsoid and related service on ruthenium to pick up openssl update |
[production] |
| 13:52 |
<dcausse> |
reverted and rebased tin for undeployed patch due to scap issues (https://gerrit.wikimedia.org/r/#/c/422906/ https://gerrit.wikimedia.org/r/#/c/422929/) |
[production] |
| 13:34 |
<dcausse> |
aborted scap sync-dir php-1.31.0-wmf.27/extensions/CirrusSearch/ (was taking too much time at: waiting on sync-masters, ok: 1, left: 1) |
[production] |
| 12:54 |
<moritzm> |
installing ICU security updates on trusty |
[production] |
| 12:29 |
<dcausse> |
recreating replicas for skwiki_content in elastic@codfw due to stalled shard recovery |
[production] |
| 12:18 |
<ariel@tin> |
Finished deploy [dumps/dumps@982cebd]: ability to configure production of recombined metacurrent page content file (duration: 00m 02s) |
[production] |
| 12:18 |
<ariel@tin> |
Started deploy [dumps/dumps@982cebd]: ability to configure production of recombined metacurrent page content file |
[production] |