4001-4050 of 10000 results (30ms)
2014-08-14 §
09:30 <_joe_> the hhvm jobrunner is back in production, seems healthy, see https://logstash.wikimedia.org/#/dashboard/elasticsearch/hhvm_jobrunner [production]
08:09 <_joe_> reactivated the jobrunner on mw1053, with promising results. Puppettization pending (in ~ 1 hour) [production]
03:12 <LocalisationUpdate> ResourceLoader cache refresh completed at Thu Aug 14 03:11:33 UTC 2014 (duration 11m 32s) [production]
02:31 <LocalisationUpdate> completed (1.24wmf16) at 2014-08-14 02:29:52+00:00 [production]
02:17 <LocalisationUpdate> completed (1.24wmf15) at 2014-08-14 02:16:34+00:00 [production]
2014-08-13 §
21:58 <manybubbles> cirrus index rebuild is proceeding without trouble - I'm going to let it continue over night. [production]
21:46 <andrewbogott> re-enabled puppetmaster on virt1000; apache changes seem stable now. [production]
21:18 <_joe_> stopped puppet on virt1000, our fail [production]
13:23 <springle> killed a mass of SpecialWhatLinksHere queries on enwiki [production]
12:51 <manybubbles> restarting rebuilding Cirrus indexes to pick up weighted all field [production]
10:35 <godog> bump swift weights for ms-be1013 ms-be1014 ms-be1015 to 2500 [production]
08:39 <hashar> gallium removing some sun-java6* packages coming from old lucid era [production]
07:47 <hashar> upgrading Java on contint servers gallium and lanthanum , restarting Jenkins related process [production]
04:03 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Aug 13 04:02:23 UTC 2014 (duration 2m 22s) [production]
03:12 <LocalisationUpdate> completed (1.24wmf16) at 2014-08-13 03:11:38+00:00 [production]
02:41 <LocalisationUpdate> completed (1.24wmf15) at 2014-08-13 02:40:36+00:00 [production]
2014-08-12 §
23:34 <hoo> Synchronized tests/multiversion/MWMultiVersionTest.php: (no message) (duration: 00m 11s) [production]
23:32 <hoo> Synchronized php-1.24wmf16/skins/Vector/skinStyles/mediawiki.special.preferences.less: Fix missing tab images on Special:Preferences (duration: 00m 10s) [production]
23:26 <hoo> Had to abort scap on mw1053 (which is depooled) manually [production]
23:26 <hoo> Finished scap: Update WikimediaMessages (superprotect messages for wmf16) (duration: 46m 16s) [production]
22:40 <hoo> Started scap: Update WikimediaMessages (superprotect messages for wmf16) [production]
22:22 <hoo> Synchronized php-1.24wmf16/extensions/ProofreadPage/: Fix JS error while editing (duration: 00m 10s) [production]
19:12 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.24wmf16 [production]
19:06 <reedy> Synchronized php-1.24wmf16/includes/specials/SpecialRecentchangeslinked.php: Fix FR bug (duration: 00m 14s) [production]
17:55 <AaronSchulz> populateBacklinkNamespace.php finished on all wikis [production]
17:13 <springle> restart mysqld on labsdb1002, upgrade to mariadb 10.0.13 for bugfix [production]
16:57 <Jeff_Green> removed aluminium.wikimedia.org from production [production]
16:50 <springle> restart mysqld on labsdb1001, upgrade to mariadb 10.0.13 for bugfix [production]
15:08 <bblack> flipping ulsfo traffic back to ulsfo [production]
11:51 <hoo> Synchronized wmf-config/InitialiseSettings.php: Set siteGroup for testwikidata (duration: 00m 11s) [production]
11:21 <hashar> Jenkins: clearing up some obsolete symbolic links under gallium.wikimedia.org:/var/lib/jenkins/jobs/*/builds/ Running in a screen as user jenkins [production]
05:01 <springle> rsync ~1TB labsdb1001 to labsdb1003, throttled ~25MB/s [production]
04:25 <springle> Synchronized wmf-config/db-eqiad.php: s2: repool db1009. s3: repool db1035. (duration: 00m 06s) [production]
03:45 <springle> Synchronized wmf-config/db-eqiad.php: s2: depool db1009. repool db1018. adjust db1036 load. (duration: 00m 07s) [production]
03:15 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Aug 12 03:14:34 UTC 2014 (duration 14m 33s) [production]
02:33 <LocalisationUpdate> completed (1.24wmf16) at 2014-08-12 02:32:09+00:00 [production]
02:19 <LocalisationUpdate> completed (1.24wmf15) at 2014-08-12 02:18:36+00:00 [production]
2014-08-11 §
22:33 <awight> update CRM schema to wmf_civicrm:7021 [production]
21:47 <andrewbogott> removed the old puppet-freshness check which should have no effect but may instead produce a torrent of alert spam https://gerrit.wikimedia.org/r/#/c/142560/ [production]
04:00 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Aug 11 03:59:17 UTC 2014 (duration 59m 16s) [production]
03:05 <LocalisationUpdate> completed (1.24wmf16) at 2014-08-11 03:04:15+00:00 [production]
02:34 <LocalisationUpdate> completed (1.24wmf15) at 2014-08-11 02:33:02+00:00 [production]
2014-08-10 §
23:47 <ori> Synchronized php-1.24wmf16/extensions/MassMessage/includes: Revert MassMessage to 9884fbb50a (duration: 00m 06s) [production]
23:36 <ori> Synchronized php-1.24wmf16/extensions/MassMessage: Update MassMessage for I840c98dca: Fix MassMessage::getMessengerUser() after Password API changes (duration: 00m 06s) [production]
22:59 <csteipp> Finished scap: Deploy Ibe28a69c9fbab00b81c53b1643df722a3f1fbf19 at Eriks request (duration: 26m 13s) [production]
22:33 <csteipp> Started scap: Deploy Ibe28a69c9fbab00b81c53b1643df722a3f1fbf19 at Eriks request [production]
16:25 <reedy> Finished scap: Rebuild l10n cache for WikimediaMessages (duration: 22m 12s) [production]
16:02 <reedy> Started scap: Rebuild l10n cache for WikimediaMessages [production]
15:01 <hoo> Synchronized php-1.24wmf16/extensions/CentralAuth/: (no message) (duration: 00m 25s) [production]
15:01 <hoo> Synchronized php-1.24wmf15/extensions/CentralAuth/: (no message) (duration: 00m 25s) [production]