2151-2200 of 10000 results (52ms)
2018-04-02 §
08:11 <jynus> depool labsdb1011 from web wikirreplicas [production]
07:21 <apergos> restarted pdfrender on scb1004 after poking around there a bit [production]
07:01 <apergos> restarted pdfrender on scb1001,2, service paged and no jobs were being processed [production]
06:06 <marostegui> Drop localisation table from the hosts where it still existed - T119811 [production]
02:50 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.26) (duration: 12m 53s) [production]
2018-03-31 §
21:15 <mutante> bast1001 has been shutdown and decom'ed as planned. if you have any issues with shell access make sure you have replaced with bast1002 or any other bast host [production]
11:26 <urandom> removing corrupt commitlog segment, restbase1009-c [production]
11:25 <urandom> removing corrupt commitlog segment, restbase1009-b [production]
11:19 <urandom> starting restbase1009-c [production]
11:18 <urandom> truncating hints, restbase1009-a [production]
11:14 <urandom> restarting restbase1009-b [production]
11:13 <urandom> stopping restbase1009-a (high hints storage) [production]
2018-03-30 §
14:16 <akosiaris> T189076 upload apertium-fra-cat to apt.wikimedia.org/jessie-wikimedia/main [production]
12:47 <akosiaris> T189076 upload apertium-cat to apt.wikimedia.org/jessie-wikimedia/main [production]
12:47 <akosiaris> T189075 upload apertium-lex-tools to apt.wikimedia.org/jessie-wikimedia/main [production]
12:47 <akosiaris> T189075 upload apertium-separable to apt.wikimedia.org/jessie-wikimedia/main [production]
12:47 <akosiaris> T189076 upload apertium-fra to apt.wikimedia.org/jessie-wikimedia/main [production]
11:44 <dcausse> running forceSearchIndex from terbium to cleanup elastic indices for (testwiki, mediawikiwiki, labswiki, labtestwiki, svwiki) (T189694) [production]
11:40 <dcausse> elastic@codfw cluster restarts complete (T189239) [production]
10:55 <dcausse> resuming elastic@codfw cluster restarts [production]
10:17 <elukey> roll restart of zookeeper daemons on druid100[123] (Druid analytics cluster) to pick up the new prometheus jmx agent [production]
09:31 <elukey> restart oozie/hive daemons on an1003 for openjdk-8 upgrades [production]
08:38 <elukey> rolling restart of hadoop-hdfs-datanode on all the hadoop worker nodes after https://gerrit.wikimedia.org/r/423000 [production]
07:39 <elukey> rolling restart of yarn-hadoop-nodemanagers on all the hadoop worker nodes after https://gerrit.wikimedia.org/r/423000 [production]
2018-03-29 §
23:47 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: T189252: Enable perf oversampling for remaining countries in Asia (duration: 01m 16s) [production]
23:40 <ebernhardson@tin> Synchronized php-1.31.0-wmf.27/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Start cirrus AB test (duration: 01m 16s) [production]
23:37 <ebernhardson@tin> Synchronized php-1.31.0-wmf.26/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: SWAT: T187148: Start cirrus AB test (duration: 01m 16s) [production]
23:12 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: T187148: Configure 5 buckets for cirrus AB test (duration: 01m 17s) [production]
22:10 <andrew@tin> Finished deploy [horizon/deploy@14d3e7d]: Updating Horizon with possible fix for T189706 (duration: 03m 16s) [production]
22:06 <andrew@tin> Started deploy [horizon/deploy@14d3e7d]: Updating Horizon with possible fix for T189706 [production]
20:07 <robh> shuttdown cp2022 for hw testing [production]
18:49 <maxsem@tin> Synchronized php-1.31.0-wmf.27/skins/MinervaNeue: https://gerrit.wikimedia.org/r/#/c/423012/ (duration: 01m 17s) [production]
18:27 <maxsem@tin> Synchronized php-1.31.0-wmf.26/includes/: Shorten summary length to 500 (duration: 02m 06s) [production]
18:22 <maxsem@tin> Synchronized php-1.31.0-wmf.27/includes/: Shorten summary length to 500 (duration: 02m 14s) [production]
17:55 <dcausse> pausing restarts of elastic@codfw (6 nodes left) [production]
17:35 <mobrovac@tin> Finished deploy [restbase/deploy@af592d6]: Add bawikibooks - T191033 (duration: 30m 35s) [production]
17:30 <demon@tin> Synchronized docroot/wwwportal/w/search-redirect.php: removing symlink indirection (duration: 01m 16s) [production]
17:05 <mobrovac@tin> Started deploy [restbase/deploy@af592d6]: Add bawikibooks - T191033 [production]
14:54 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Cleanup: Use only EventBus for refreshLinks - T185052 (duration: 01m 18s) [production]
14:00 <moritzm> restarting parsoid and related service on ruthenium to pick up openssl update [production]
13:52 <dcausse> reverted and rebased tin for undeployed patch due to scap issues (https://gerrit.wikimedia.org/r/#/c/422906/ https://gerrit.wikimedia.org/r/#/c/422929/) [production]
13:34 <dcausse> aborted scap sync-dir php-1.31.0-wmf.27/extensions/CirrusSearch/ (was taking too much time at: waiting on sync-masters, ok: 1, left: 1) [production]
12:54 <moritzm> installing ICU security updates on trusty [production]
12:29 <dcausse> recreating replicas for skwiki_content in elastic@codfw due to stalled shard recovery [production]
12:18 <ariel@tin> Finished deploy [dumps/dumps@982cebd]: ability to configure production of recombined metacurrent page content file (duration: 00m 02s) [production]
12:18 <ariel@tin> Started deploy [dumps/dumps@982cebd]: ability to configure production of recombined metacurrent page content file [production]
11:02 <ariel@tin> Finished deploy [dumps/dumps@96ba844]: cleanup 'latest' links, rss files from old runs (duration: 00m 04s) [production]
11:02 <ariel@tin> Started deploy [dumps/dumps@96ba844]: cleanup 'latest' links, rss files from old runs [production]
10:50 <dcausse> restarting elastic@codfw for JVM and plugin upgrade (T189239) [production]
09:16 <elukey> roll restart aqs on aqs100* for icu/openssl upgrades [production]