2015-10-22
§
|
15:13 |
<thcipriani@tin> |
Synchronized docroot/noc/conf: SWAT: noc: change Gitblit links to Diffusion [[gerrit:248027]] (duration: 00m 17s) |
[production] |
15:11 |
<moritzm> |
uploaded openjdk-8 8u66-b17 for jessie-wikimedia to carbon |
[production] |
14:46 |
<jynus> |
performing schema change on eventlogging database on db1046 |
[production] |
14:41 |
<mutante> |
mw1083 - Error: Could not run Puppet configuration client: Read-only file system |
[production] |
14:25 |
<jynus> |
setting thread_pool_size to 32 dynamically on all MariaDB hosts |
[production] |
14:01 |
<jynus> |
performing schema change on officewiki-flow (s3) |
[production] |
13:19 |
<jynus> |
performing schema change on x1-master (flowdb) |
[production] |
12:31 |
<jynus> |
Rolling schema change for GeoData on all wikis (geo_tags) |
[production] |
11:35 |
<mobrovac> |
restbase deployed 2bc05f40 |
[production] |
10:36 |
<hashar> |
integration: cherry picked https://gerrit.wikimedia.org/r/#/c/244748/ "contint: install npm/grunt-cli with npm" , giving it a try one host a time |
[releng] |
10:31 |
<hashar> |
integration disabling puppet <tt>salt --show-timeout --timeout=10 '*' cmd.run 'puppet agent --disable "install npm/grunt-cli via puppet https://gerrit.wikimedia.org/r/#/c/244748/"'</tt> |
[releng] |
10:05 |
<hashar> |
salt-key -d deployment-logstash2.eqiad.wmflabs |
[releng] |
10:05 |
<hashar> |
salt-key -d deployment-urldownloader.eqiad.wmflabs |
[releng] |
10:04 |
<hashar> |
integration: clean up downloaded apt packages which are filing /var/cache/apt/archives on a few instances <tt>salt --show-timeout '*' cmd.run 'apt-get clean'</tt> |
[releng] |
10:03 |
<hashar> |
beta: clean up downloaded apt packages which are filing /var/cache/apt/archives on a few instances (ex: 4GBytes on mediawiki02) <tt>salt --show-timeout '*' cmd.run 'apt-get clean'</tt> |
[releng] |
10:01 |
<hashar> |
beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* |
[releng] |
10:00 |
<hashar> |
beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* |
[releng] |
09:50 |
<joal> |
restart cassandra on aqs1003 |
[analytics] |
09:46 |
<hashar> |
beta-cluster: I have deleted some incorrect salt minions with: salt-key -d i-0000* |
[releng] |
07:41 |
<ori@tin> |
Synchronized php-1.27.0-wmf.3/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 00m 17s) |
[production] |
07:41 |
<ori@tin> |
Synchronized php-1.27.0-wmf.2/includes/jobqueue/JobQueueRedis.php: Ie7c544fc8: jobqueue: track real job inserts as inserts_actual & I627e8f6ce: JobQueueRedis::doBatchPush(): report metrics even when failures occur (duration: 07m 33s) |
[production] |
06:17 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Oct 22 06:17:39 UTC 2015 (duration 17m 38s) |
[production] |
06:14 |
<AaronSchulz> |
Restarted hhvm on mw1011, it was stuck doing nothing at 100 cpu |
[production] |
05:10 |
<aaron@tin> |
Synchronized php-1.27.0-wmf.3/includes/deferred/LinksUpdate.php: fe323f9b68bbb (duration: 00m 17s) |
[production] |
03:05 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-22 03:05:21+00:00 |
[production] |
03:00 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 07m 52s) |
[production] |
02:37 |
<AaronSchulz> |
Startin running 5 threads of enwiki refreshLinks jobs on tin |
[production] |
02:35 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-22 02:35:41+00:00 |
[production] |
02:30 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 44s) |
[production] |
01:10 |
<krenair@mira> |
Synchronized README: testing sync from mira (duration: 00m 17s) |
[production] |
01:00 |
<ori@tin> |
Synchronized php-1.27.0-wmf.2/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) |
[production] |
01:00 |
<ori@tin> |
Synchronized php-1.27.0-wmf.3/includes/Hooks.php: I0e5f2d3b2: Make hookErrorHandler() only care about serious signature errors (duration: 00m 17s) |
[production] |
00:56 |
<krenair@mira> |
Synchronized README: (no message) (duration: 00m 16s) |
[production] |
00:55 |
<krenair@mira> |
Synchronized README: (no message) (duration: 00m 17s) |
[production] |
00:49 |
<krenair@mira> |
Synchronized README: (no message) (duration: 00m 16s) |
[production] |
00:20 |
<ori@tin> |
Synchronized wmf-config/CommonSettings.php: Ibf752b832: $wgMathCheckFiles = false (duration: 00m 18s) |
[production] |
00:05 |
<ori@tin> |
Synchronized php-1.27.0-wmf.3/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) |
[production] |
00:03 |
<ori@tin> |
Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter: Ice1b6da43: AbuseFilter: don't install custom error handler and I0ecdcdd142: Use isset() to check array element exists rather than relying on @ operator (duration: 00m 18s) |
[production] |
2015-10-21
§
|
23:33 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.2/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 19s) |
[production] |
23:32 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/extensions/CirrusSearch: Performance tweaks for corss-dc copy process (duration: 00m 18s) |
[production] |
23:25 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Provide category suggestions from the right wiki (duration: 00m 17s) |
[production] |
23:16 |
<ebernhardson@tin> |
Synchronized php-1.27.0-wmf.3/resources/: mw.ForeignStructuredUpload: Rearrange messages to always display license name (duration: 00m 18s) |
[production] |
23:08 |
<ebernhardson@tin> |
Synchronized wmf-config/throttle.php: Add throtle exception for eswiki (duration: 00m 18s) |
[production] |
23:03 |
<ori@tin> |
Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) |
[production] |
23:00 |
<ori@tin> |
Synchronized php-1.27.0-wmf.2/extensions/AbuseFilter/AbuseFilter.parser.php: Ad-hoc debug logging of AbuseFilter exceptions (duration: 00m 17s) |
[production] |
22:53 |
<milimetric> |
deployed EventLogging and tried to backfill data lost on 2015.10.14 but failed |
[analytics] |
21:10 |
<ebernhardson> |
starting copy of elasticsearch eqiad indices to codfw |
[production] |
20:46 |
<ebernhardson|lch> |
cancel copying elasticsearch eqiad to labsearch, looks to be writing to wrong disks and will fill up |
[production] |
20:26 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/247916 |
[releng] |
20:16 |
<AaronSchulz> |
Started running 8 threads of commonswiki refreshlinks jobs on terbium |
[production] |