3401-3450 of 10000 results (23ms)
2015-10-29 §
19:40 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.3 [production]
19:39 <twentyafterfour> rolling back to 1.27.0-wmf.3 due to increase in log errors [production]
19:31 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.4 [production]
18:59 <cmjohnson1> powering down aqs1001 for h/w maintenance [production]
17:53 <AaronSchulz> Touched/synced PrivateSettings.php symlink via touch -h [production]
17:47 <aaron@tin> Synchronized wmf-config/PrivateSettings.php: (no message) (duration: 00m 18s) [production]
17:36 <AaronSchulz> Did touch of InitialiseSettings.php [production]
17:33 <aaron@tin> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 18s) [production]
17:32 <aaron@tin> Synchronized private/PrivateSettings.php: (no message) (duration: 00m 17s) [production]
17:17 <kartik@tin> Synchronized wmf-config/PrivateSettings.php: Really sync right file this time (duration: 00m 17s) [production]
17:10 <kartik@tin> Synchronized private/PrivateSettings.php: Retry syncing for CX token (duration: 00m 17s) [production]
16:57 <YuviPanda> restart etherpad on etherpad1001 [production]
16:22 <moritzm> removed obsolete mysql 5.5 packages on mw102[2-9], mw1032, mw1053, mw1114, mw1163 [production]
16:19 <_joe_> moved purge_abusefilter from terbium to mw1152 [production]
15:48 <_joe_> moving purge_checkuser from terbium to mw1152 [production]
15:43 <_joe_> moving purge_securepoll from terbium to mw1152 [production]
15:15 <moritzm> removed openjdk-7 on restbase100[1-9] (it's using openjdk-8 for a while) [production]
13:17 <kartik@tin> Synchronized wmf-config/CommonSettings.php: Fix ContentTranslationCXServerAuth for CX (duration: 00m 18s) [production]
13:14 <kartik@tin> Synchronized private/PrivateSettings.php: Fix name of JWT token (duration: 00m 18s) [production]
12:33 <kartik@tin> Synchronized wmf-config/CommonSettings.php: Set ContentTranslationCXServerAuth for CX (duration: 00m 17s) [production]
11:24 <mobrovac> restbase rolling-restart after config change https://gerrit.wikimedia.org/r/249465 [production]
10:41 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 at 100% load. Reduce db1035 weight. (duration: 00m 17s) [production]
10:34 <_joe_> migrated jobqueue_stats_reporter to mw1152 [production]
10:21 <hashar> restarting Jenkins (java upgrade) [production]
10:20 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 after maintenance (duration: 00m 18s) [production]
10:14 <hashar> Upgrading java on gallium and restarting Jenkins [production]
10:04 <moritzm> removed openjdk-7 from cassandra test hosts (now using openjdk-8) [production]
10:00 <aude@tin> Synchronized wmf-config/InitialiseSettings.php: Enable nearby on wikidata (duration: 00m 18s) [production]
10:00 <aude@tin> Synchronized wmf-config/Wikibase.php: Config for fetching labels on mobile wikidata (duration: 00m 18s) [production]
09:51 <jynus> shutdown mw1083 to avoid querying the mysql servers with an outdated config/spaming the error logs [production]
09:13 <jynus> restarting db1065 for regular maintenace [production]
08:59 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 for maintenance (duration: 00m 17s) [production]
07:04 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Oct 29 07:04:04 UTC 2015 (duration 4m 3s) [production]
06:43 <YuviPanda> disabled two fr-tech related catchpoint tests per awight's request [production]
06:30 <aaron@tin> Synchronized rpc/RunJobs.php: 29ccbd248 (duration: 00m 17s) [production]
05:46 <ebernhardson> finished manually running 3M enwiki/enqueue, enwiki/wikibase-addUsagesForPage, and wikidatawiki/cirrusSearchLinksUpdatePrioritized jobs from mw1011 and mw1012 [production]
05:38 <ebernhardson> restarting elasticsearch on nobelium to attempt to clear up extra log GC pauses in the old generation (50s+) [production]
05:37 <ebernhardson> restarting elasticsearch on nobelium [production]
03:55 <gwicke> cassandra *staging*: testing DateTieredCompactionStrategy (https://labs.spotify.com/2014/12/18/date-tiered-compaction/) on wikipedia html and data-parsoid tables [production]
03:05 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.4) at 2015-10-29 03:05:52+00:00 [production]
03:02 <l10nupdate@tin> Synchronized php-1.27.0-wmf.4/cache/l10n: l10nupdate for 1.27.0-wmf.4 (duration: 06m 03s) [production]
02:59 <YuviPanda> start pybal on lvs1007 [production]
02:46 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-29 02:46:27+00:00 [production]
02:39 <l10nupdate@tin> Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 10m 47s) [production]
02:05 <AaronSchulz> Restarted stuck hhvm on mw1016; dump at /tmp/hhvm.25097.bt [production]
01:06 <gwicke> lowered gc_grace on wikipedia parsoid html and data-parsoid keyspaces to 24 hours [production]
2015-10-28 §
23:31 <ori@tin> Synchronized php-1.27.0-wmf.4/extensions/Translate/tag/PageTranslationHooks.php: I0e5f2d3b2 (duration: 00m 18s) [production]
23:29 <ebernhardson@tin> Synchronized php-1.27.0-wmf.4/extensions/WikimediaEvents/WikimediaEvents.php: https://gerrit.wikimedia.org/r/249642 (duration: 00m 17s) [production]
23:25 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: (no message) (duration: 00m 17s) [production]
23:22 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-common.php: (no message) (duration: 00m 17s) [production]