551-600 of 10000 results (33ms)
2015-08-15 §
04:38 <andrewbogott> killing some rsync processes on labstore1002 because iowaits are through the roof [production]
02:29 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf18) at 2015-08-15 02:29:05+00:00 [production]
02:25 <l10nupdate@tin> Synchronized php-1.26wmf18/cache/l10n: l10nupdate for 1.26wmf18 (duration: 06m 37s) [production]
01:15 <ottomata> starting broker on analytics1012, camus wasn't happy about that either. hrm. [production]
00:58 <ottomata> stopping kafka broker on analytics1012, it is causing consumption problems with camus, will look into why later. [production]
00:38 <marxarelli> Reloading Zuul to deploy I9ef82b6d3ea7d83de8e4a67c9715ccf335c00b88 [releng]
2015-08-14 §
23:46 <ori@tin> Synchronized php-1.26wmf18/includes/libs/ReplacementArray.php: (no message) (duration: 00m 27s) [production]
21:54 <mutante> restarted nutcracker on mw1010 [production]
21:26 <ori> deployed job runner 808d1ae08d40 [production]
19:29 <ori@tin> Synchronized php-1.26wmf18/includes/resourceloader/ResourceLoader.php: f72009a543: ResourceLoader: apply minify-js filter to config scripts (duration: 00m 13s) [production]
18:52 <thcipriani> disconnect/reconnect for deployment-bastion jenkins slave—left over stalled jobs went away [releng]
18:43 <greg-g> killed some of the queued jobs (beta-scap etc) via clicking on the red X [releng]
18:42 <thcipriani> disconnected and reconnected deployment-bastion jenkins slave [releng]
18:27 <ori@tin> Synchronized php-1.26wmf18/extensions/MultimediaViewer: 9ee0437bc6: Updated mediawiki/core Project: mediawiki/extensions/MultimediaViewer 645b6c9e93fae13e09e5b493547aecc5a2e933ae (duration: 00m 12s) [production]
18:24 <ori> Repooling mw1041 now that T108601 is resolved. [production]
17:59 <yurik> deployed latest kartotherian [production]
17:21 <andrewbogott> disabling grid jobqueue for tools-exec-1211 tools-exec-1212 tools-exec-1215 tools-exec-1403 tools-exec-1406 tools-master tools-shadow tools-webgrid-generic-1402 tools-webgrid-lighttpd-1203 tools-webgrid-lighttpd-1208 tools-webgrid-lighttpd-1403 tools-webgrid-lighttpd-1404 tools-webproxy-01 in anticipation of monday reboot of labvirt1004 [tools]
16:14 <ostriches> fixed deployment-cache-upload04 [releng]
15:20 <andrewbogott> Adding back to the grid engine queue: tools-exec-1216 tools-exec-1219 tools-exec-1407 tools-mail tools-services-02 tools-webgrid-generic-1401 tools-webgrid-lighttpd-1202 tools-webgrid-lighttpd-1207 tools-webgrid-lighttpd-1210 tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1407 [tools]
14:59 <andrewbogott> rebooting labvirt1003 [production]
14:43 <andrewbogott> killing remaining jobs on tools-exec-1216 tools-exec-1219 tools-exec-1407 tools-mail tools-services-02 tools-webgrid-generic-1401 tools-webgrid-lighttpd-1202 tools-webgrid-lighttpd-1207 tools-webgrid-lighttpd-1210 tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1407 [tools]
13:53 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1042 (vslow, dump) (duration: 00m 12s) [production]
13:13 <reedy@tin> Synchronized php-1.26wmf18/extensions/CirrusSearch/: Fix ElasticaQuery logspam (duration: 00m 13s) [production]
13:06 <reedy@tin> Synchronized php-1.26wmf18/extensions/GeoData: Fix ElasticaQuery logspam (duration: 00m 13s) [production]
13:06 <reedy@tin> Synchronized php-1.26wmf18/extensions/Flow: Fix ElasticaQuery logspam (duration: 00m 13s) [production]
12:30 <jynus> Restarting db1042 after data import [production]
12:11 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Load-balance db1036 roles (duration: 00m 11s) [production]
11:57 <reedy@tin> Synchronized php-1.26wmf18/extensions/Translate: Stop calling deprecated Elastica function (duration: 00m 13s) [production]
08:26 <akosiaris> upgraded and restarted apertium on sca100{1,2} [production]
08:11 <akosiaris> uploaded to apt.wikimedia.org jessie-wikimedia: apertium-apy_0.1+svn~61425-1 [production]
07:10 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Aug 14 07:10:37 UTC 2015 (duration 10m 36s) [production]
06:34 <Jamesofur> reset email/password for User:Auréola after multi factor user confirmation. [production]
05:21 <bd808> varnish-fe on deployment-cache-upload04.deployment-prep.eqiad.wmflabs not starting because nginx isn't starting because ssl cert is missing. No port 80 listener to serve images [releng]
02:35 <l10nupdate@tin> LocalisationUpdate completed (1.26wmf18) at 2015-08-14 02:35:19+00:00 [production]
02:31 <l10nupdate@tin> Synchronized php-1.26wmf18/cache/l10n: l10nupdate for 1.26wmf18 (duration: 06m 35s) [production]
01:49 <matt_flaschen> Resumed LQT->Flow conversion of mw:Project:Support_desk on mw1041 [production]
01:46 <ori@tin> Synchronized php-1.26wmf18/includes/OutputPage.php: I5e6c79c70: Optimize the order of styles and scripts in <head> (duration: 00m 12s) [production]
2015-08-13 §
23:27 <legoktm> deploying https://gerrit.wikimedia.org/r/230256 [releng]
23:16 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/228477/ and https://gerrit.wikimedia.org/r/#/c/231074/ (duration: 00m 12s) [production]
23:15 <krenair@tin> Synchronized w/static/images/project-logos/mrwikibooks.png: https://gerrit.wikimedia.org/r/#/c/228477/ (duration: 00m 12s) [production]
23:10 <krenair@tin> Synchronized php-1.26wmf18/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/231450/1 (duration: 00m 14s) [production]
23:03 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/227330/ (duration: 00m 12s) [production]
22:14 <Krenair> Running refreshLinks --dfn-only in a screen on terbium for T44180 [production]
21:47 <bd808> triggered beta-scap-eqiad jenkins job [releng]
21:46 <bd808> Primed keyholder agent via `sudo -u keyholder env SSH_AUTH_SOCK=/run/keyholder/agent.sock ssh-add /etc/keyholder.d/mwdeploy_rsa` [releng]
21:43 <ori@tin> Synchronized php-1.26wmf18/includes/OutputPage.php: Roll back: Test impact of I5e6c79c (duration: 00m 12s) [production]
21:37 <ori@tin> Synchronized php-1.26wmf18/includes/OutputPage.php: Test impact of I5e6c79c (duration: 00m 12s) [production]
21:16 <mutante> torrus broken - doing https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem [production]
21:14 <mutante> service gitblit restart on antimony (maybe that should be paging :) [production]
21:06 <bd808> `sudo /etc/init.d/ganglia-monitor restart` on logstash100[1-6] fixed ganglia data loss [production]