5951-6000 of 10000 results (41ms)
2015-10-22 §
14:46 <jynus> performing schema change on eventlogging database on db1046 [production]
14:41 <mutante> mw1083 - Error: Could not run Puppet configuration client: Read-only file system [production]
14:25 <jynus> setting thread_pool_size to 32 dynamically on all MariaDB hosts [production]
14:01 <jynus> performing schema change on officewiki-flow (s3) [production]
13:19 <jynus> performing schema change on x1-master (flowdb) [production]
12:31 <jynus> Rolling schema change for GeoData on all wikis (geo_tags) [production]
11:35 <mobrovac> restbase deployed 2bc05f40 [production]
07:41 <ori@tin> Synchronized php-1.27.0-wmf.3/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 00m 17s) [production]
07:41 <ori@tin> Synchronized php-1.27.0-wmf.2/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 07m 33s) [production]
06:17 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Oct 22 06:17:39 UTC 2015 (duration 17m 38s) [production]
06:14 <AaronSchulz> Restarted hhvm on mw1011, it was stuck doing nothing at 100 cpu [production]
05:10 <aaron@tin> Synchronized php-1.27.0-wmf.3/includes/deferred/LinksUpdate.php: fe323f9b68bbb (duration: 00m 17s) [production]
03:05 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-22 03:05:21+00:00 [production]
03:00 <l10nupdate@tin> Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 07m 52s) [production]
02:37 <AaronSchulz> Startin running 5 threads of enwiki refreshLinks jobs on tin [production]
02:35 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-22 02:35:41+00:00 [production]
02:30 <l10nupdate@tin> Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 44s) [production]
01:10 <krenair@mira> Synchronized README: testing sync from mira (duration: 00m 17s) [production]
01:00 <ori@tin> Synchronized php-1.27.0-wmf.2/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) [production]
01:00 <ori@tin> Synchronized php-1.27.0-wmf.3/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) [production]
00:56 <krenair@mira> Synchronized README: (no message) (duration: 00m 16s) [production]
00:55 <krenair@mira> Synchronized README: (no message) (duration: 00m 17s) [production]
00:49 <krenair@mira> Synchronized README: (no message) (duration: 00m 16s) [production]
00:20 <ori@tin> Synchronized wmf-config/CommonSettings.php: Ibf752b832: $wgMathCheckFiles = false (duration: 00m 18s) [production]
00:05 <ori@tin> Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) [production]
00:03 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) [production]
2015-10-21 §
23:33 <ebernhardson@tin> Synchronized php-1.27.0-wmf.2/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 19s) [production]
23:32 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 18s) [production]
23:25 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Provide category suggestions from the right wiki (duration: 00m 17s) [production]
23:16 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Rearrange messages to always display license name (duration: 00m 18s) [production]
23:08 <ebernhardson@tin> Synchronized wmf-config/throttle.php: Add throtle exception for eswiki (duration: 00m 18s) [production]
23:03 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) [production]
23:00 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) [production]
21:10 <ebernhardson> starting copy of elasticsearch eqiad indices to codfw [production]
20:46 <ebernhardson|lch> cancel copying elasticsearch eqiad to labsearch, looks to be writing to wrong disks and will fill up [production]
20:16 <AaronSchulz> Started running 8 threads of commonswiki refreshlinks jobs on terbium [production]
20:14 <ebernhardson|lch> starting copy of elasticsearch indices from eqiad cluster to labsearch cluster [production]
18:42 <ebernhardson> initializing elasticsearch index mapping for all wikis in the codfw and labsearch ES clusters [production]
16:53 <hoo> Attached WeiaR@enwiki to the global account of the same name. T115699 [production]
15:50 <ebernhardson@tin> Synchronized php-1.27.0-wmf.2/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) [production]
15:49 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/WikimediaEvents/: Revert SearchSatisfaction schema related changes due to suspected perf impact (duration: 00m 18s) [production]
15:38 <akosiaris> depooled mw1083 [production]
15:29 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: touch and re-sync InitialiseSettings.php to bust cache (duration: 00m 17s) [production]
15:24 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) [production]
15:24 <ebernhardson@tin> Synchronized wmf-config/CommonSettings.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) [production]
15:23 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-common.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) [production]
15:23 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: CirrusSearch multi-datacenter configuration (duration: 00m 17s) [production]
15:18 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/Cite/Cite_body.php: Do not double-parse error references duplicate key (duration: 00m 17s) [production]
15:16 <ebernhardson@tin> Synchronized php-1.27.0-wmf.2/extensions/Cite/Cite_body.php: Do not double-parse error references duplicate key (duration: 00m 19s) [production]
15:00 <aude> rsync failed on mw1083: "failed to set times on "/srv/mediawiki/wmf-config": Read-only file system" [production]