6751-6800 of 10000 results (53ms)
2016-08-12 §
09:32 <elukey> restarting Druid java daemons on druid100[123] for openjdk upgrades [production]
08:36 <akosiaris> roll restart parsoid to apply https://phabricator.wikimedia.org/rOPUPb32dd25950f1499a79e74fc811c050291b9ec6b8 [production]
08:25 <moritzm> install postgres security updates on maps clusters [production]
02:45 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Aug 12 02:45:40 UTC 2016 (duration 5m 57s) [production]
02:39 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.14) (duration: 18m 02s) [production]
02:04 <mattflaschen@tin> Synchronized php-1.28.0-wmf.14/extensions/Echo: Revert self-mentions pending further investigation and discussion, due to accidental self-mentions. (duration: 01m 04s) [production]
00:51 <yurik> deployed kartotherian & tilerator. maps100[134].eqiad are still down (non production) [production]
00:20 <dereckson@tin> Synchronized php-1.28.0-wmf.14/extensions/CentralNotice: CentralNotice deployment [[gerrit:304420]] (duration: 00m 49s) [production]
00:15 <dereckson@tin> Synchronized php-1.28.0-wmf.14/: VE: Fix TextState#getChangeTransaction bug (T141573) ; Echo: Revert "Hack around browser bug in IE breaking badge alignment in Monobook" ([[gerrit:304415]]) ; Core: Revert CSS fix ([[gerrit:304412]], T142750) (duration: 08m 58s) [production]
2016-08-11 §
23:47 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Remove 'gather-hidelist' user right [[gerrit:303803]] (duration: 00m 48s) [production]
23:42 <ostriches> gerrit: running puppet to pick up config change, gerrit will do a quick restart [production]
23:37 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: UrlShortener: Whitelist *.wikidata.org (T142055) (duration: 00m 47s) [production]
23:24 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Re-enable thank-you-edit notifications (T128249) (duration: 00m 58s) [production]
23:22 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Re-enable Echo footer notice (T141414) (duration: 00m 54s) [production]
20:25 <ejegg> updated SmashPig from 5c180de6e424be10f9d61052c2c8dca7e0e825af to 4ba14a10518f80fe7e20fadc493d78c796c15921 [production]
20:08 <yuvipanda> restart nova-compute on labvirt1010 [production]
20:06 <yuvipanda> tools restart rabbitmq-server on labcontrol1001 [production]
20:04 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.28.0-wmf.14 [production]
19:44 <twentyafterfour@tin> Synchronized php-1.28.0-wmf.14/extensions/CentralNotice: deploy https://gerrit.wikimedia.org/r/#/c/304130/ (duration: 00m 58s) [production]
18:18 <MaxSem> restarted hhvm on mw1017 to catch up with hhvm-wikidiff2 upgrade [production]
17:48 <ema> switched LVS schedulers for text, upload, maps and misc port 80 to source hash scheduling T108827 [production]
17:37 <ema> applying https://gerrit.wikimedia.org/r/#/c/297418/ to eqiad load balancers [production]
17:16 <ema> applying https://gerrit.wikimedia.org/r/#/c/297418/ to codfw load balancers [production]
17:02 <Amir1> restarting celery-ores-worker service in scb[12]00[12] T142361 [production]
17:00 <ema> applying https://gerrit.wikimedia.org/r/#/c/297418/ to ulsfo load balancers [production]
16:36 <ema> applying https://gerrit.wikimedia.org/r/#/c/297418/ to esams load balancers [production]
15:51 <ema> disabling puppet on lvs hosts to test https://gerrit.wikimedia.org/r/#/c/297418/ [production]
14:20 <jynus> disabling puppet on db2001-2009; preparing for decomission [production]
13:53 <chasemp> restarting nodepool to test stats collection [production]
13:02 <elukey> restarting cassandra on aqs100[123] for jvm upgrades [production]
10:26 <elukey> restarting statsv on hafnium (process stuck after kafka brokers restart) [production]
10:25 <elukey> kafka restarted on kafka200[12] for jvm upgrades [production]
09:34 <jynus> removing leftovers of unmaintained skrillex tool from mira and tin [production]
09:17 <elukey> restarting statsv on hafnium (blocked due to analytics kafka brokers restarts) [production]
09:01 <elukey> upgrading httpd to 2.4.10-10+deb8u6+wmf2 on mw126[234] [production]
08:50 <elukey> uploaded apache2 2.4.10-10+deb8u6+wmf2 to reprepro [production]
08:18 <elukey> restarting kafka on the kafka analytics cluster for jvm upgrades [production]
07:38 <elukey> increaseing traffic weight to 30 for mw1261 (current: 5) [production]
02:56 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Aug 11 02:56:27 UTC 2016 (duration 6m 54s) [production]
02:49 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.14) (duration: 10m 24s) [production]
02:27 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.13) (duration: 11m 12s) [production]
00:41 <aaron@tin> Synchronized php-1.28.0-wmf.14/maintenance/purgeChangedFiles.php: 91baa668219d8a77b1e300c257e969b04b4b1e3d (duration: 00m 47s) [production]
00:39 <aaron@tin> Synchronized php-1.28.0-wmf.13/maintenance/purgeChangedFiles.php: 4fe4f803541c4b21c5a118eab426d78d6c0c607b (duration: 00m 50s) [production]
00:10 <reedy@tin> Synchronized wikiversions.json: noop for mira (duration: 00m 49s) [production]
2016-08-10 §
23:59 <AaronSchulz> Running purgeChangedFiles.php on all wikis on a terbium screen (T142638) [production]
23:46 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: Reinstate .14 as T142638 is fixed [production]
23:44 <mutante> mw2086 - removing node from cluster failed - backend error, request requires authentication [production]
23:40 <reedy@tin> Synchronized php-1.28.0-wmf.14/extensions/VipsScaler: Remove old broken config causing T142638 (duration: 00m 50s) [production]
23:39 <yuvipanda> restarted rabbitmq on labcontrol1001 [production]
23:22 <mutante> connected to mw2086.mgmt (which icinga said was down since a couple hours). i saw it booting up..it came back but i did not powercyle or reboot, just view console [production]