8951-9000 of 10000 results (46ms)
2015-10-22 §
15:13 <thcipriani@tin> Synchronized docroot/noc/conf: SWAT: noc: change Gitblit links to Diffusion [[gerrit:248027]] (duration: 00m 17s) [production]
15:11 <moritzm> uploaded openjdk-8 8u66-b17 for jessie-wikimedia to carbon [production]
14:46 <jynus> performing schema change on eventlogging database on db1046 [production]
14:41 <mutante> mw1083 - Error: Could not run Puppet configuration client: Read-only file system [production]
14:25 <jynus> setting thread_pool_size to 32 dynamically on all MariaDB hosts [production]
14:01 <jynus> performing schema change on officewiki-flow (s3) [production]
13:19 <jynus> performing schema change on x1-master (flowdb) [production]
12:31 <jynus> Rolling schema change for GeoData on all wikis (geo_tags) [production]
11:35 <mobrovac> restbase deployed 2bc05f40 [production]
10:36 <hashar> integration: cherry picked https://gerrit.wikimedia.org/r/#/c/244748/ "contint: install npm/grunt-cli with npm" , giving it a try one host a time [releng]
10:31 <hashar> integration disabling puppet <tt>salt --show-timeout --timeout=10 '*' cmd.run 'puppet agent --disable "install npm/grunt-cli via puppet https://gerrit.wikimedia.org/r/#/c/244748/"'</tt> [releng]
10:05 <hashar> salt-key -d deployment-logstash2.eqiad.wmflabs [releng]
10:05 <hashar> salt-key -d deployment-urldownloader.eqiad.wmflabs [releng]
10:04 <hashar> integration: clean up downloaded apt packages which are filing /var/cache/apt/archives on a few instances <tt>salt --show-timeout '*' cmd.run 'apt-get clean'</tt> [releng]
10:03 <hashar> beta: clean up downloaded apt packages which are filing /var/cache/apt/archives on a few instances (ex: 4GBytes on mediawiki02) <tt>salt --show-timeout '*' cmd.run 'apt-get clean'</tt> [releng]
10:01 <hashar> beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* [releng]
10:00 <hashar> beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* [releng]
09:50 <joal> restart cassandra on aqs1003 [analytics]
09:46 <hashar> beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* [releng]
07:41 <ori@tin> Synchronized php-1.27.0-wmf.3/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 00m 17s) [production]
07:41 <ori@tin> Synchronized php-1.27.0-wmf.2/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 07m 33s) [production]
06:17 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Oct 22 06:17:39 UTC 2015 (duration 17m 38s) [production]
06:14 <AaronSchulz> Restarted hhvm on mw1011, it was stuck doing nothing at 100 cpu [production]
05:10 <aaron@tin> Synchronized php-1.27.0-wmf.3/includes/deferred/LinksUpdate.php: fe323f9b68bbb (duration: 00m 17s) [production]
03:05 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-22 03:05:21+00:00 [production]
03:00 <l10nupdate@tin> Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 07m 52s) [production]
02:37 <AaronSchulz> Startin running 5 threads of enwiki refreshLinks jobs on tin [production]
02:35 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-22 02:35:41+00:00 [production]
02:30 <l10nupdate@tin> Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 44s) [production]
01:10 <krenair@mira> Synchronized README: testing sync from mira (duration: 00m 17s) [production]
01:00 <ori@tin> Synchronized php-1.27.0-wmf.2/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) [production]
01:00 <ori@tin> Synchronized php-1.27.0-wmf.3/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) [production]
00:56 <krenair@mira> Synchronized README: (no message) (duration: 00m 16s) [production]
00:55 <krenair@mira> Synchronized README: (no message) (duration: 00m 17s) [production]
00:49 <krenair@mira> Synchronized README: (no message) (duration: 00m 16s) [production]
00:20 <ori@tin> Synchronized wmf-config/CommonSettings.php: Ibf752b832: $wgMathCheckFiles = false (duration: 00m 18s) [production]
00:05 <ori@tin> Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) [production]
00:03 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) [production]
2015-10-21 §
23:33 <ebernhardson@tin> Synchronized php-1.27.0-wmf.2/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 19s) [production]
23:32 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 18s) [production]
23:25 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Provide category suggestions from the right wiki (duration: 00m 17s) [production]
23:16 <ebernhardson@tin> Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Rearrange messages to always display license name (duration: 00m 18s) [production]
23:08 <ebernhardson@tin> Synchronized wmf-config/throttle.php: Add throtle exception for eswiki (duration: 00m 18s) [production]
23:03 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) [production]
23:00 <ori@tin> Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) [production]
22:53 <milimetric> deployed EventLogging and tried to backfill data lost on 2015.10.14 but failed [analytics]
21:10 <ebernhardson> starting copy of elasticsearch eqiad indices to codfw [production]
20:46 <ebernhardson|lch> cancel copying elasticsearch eqiad to labsearch, looks to be writing to wrong disks and will fill up [production]
20:26 <legoktm> deploying https://gerrit.wikimedia.org/r/247916 [releng]
20:16 <AaronSchulz> Started running 8 threads of commonswiki refreshlinks jobs on terbium [production]