5651-5700 of 10000 results (26ms)
2012-06-11 §
09:56 <apergos> shut down mysqld on db1047, reparing tables [production]
06:54 <pp-pdf2> upgraded mwlib to 0.13.8 [production]
06:54 <pp-pdf3> upgraded mwlib to 0.13.8 [production]
06:54 <pp-pdf1> upgraded mwlib to 0.13.8 [production]
02:24 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Mon Jun 11 02:24:06 UTC 2012 [production]
2012-06-10 §
02:22 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sun Jun 10 02:22:33 UTC 2012 [production]
2012-06-09 §
07:45 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sat Jun 9 07:45:17 UTC 2012 [production]
02:35 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sat Jun 9 02:35:29 UTC 2012 [production]
02:25 <Reedy> Running LU manually [production]
02:14 <Reedy> Cleared a bit of space on fenari by deleting checkouts from /tmp [production]
02:00 <logmsgbot_> LocalisationUpdate failed: git pull of core failed [production]
01:51 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: [production]
01:50 <logmsgbot_> reedy synchronized wikimedia.dblist [production]
01:49 <Reedy> fenari has a full / [production]
01:49 <logmsgbot_> reedy synchronized all.dblist [production]
2012-06-08 §
20:32 <Reedy> Updated php to point to php-1.20wmf4 rather than php-1.20wmf3 [production]
20:09 <logmsgbot_> reedy synchronized wikimedia.dblist [production]
20:08 <logmsgbot_> reedy synchronized all.dblist [production]
20:04 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: 2 wikimedia wikis to 1.20wmf4 [production]
19:57 <logmsgbot_> reedy Finished syncing Wikimedia installation... : Rebuilding localisation cache for message updates [production]
19:39 <logmsgbot_> reedy Started syncing Wikimedia installation... : Rebuilding localisation cache for message updates [production]
18:47 <logmsgbot_> reedy synchronized php-1.20wmf4/languages/messages/ 'Pushing out updated files upon siebrands request' [production]
16:30 <cmjohnson1> shutting down search32 to swap DIMM around [production]
10:19 <notpeter> ganglia down, restarting apache on nickel. [production]
09:32 <notpeter> stopping indexing on searchidx1001 to re-copy to searchidx2 [production]
08:45 <notpeter> reimaging searchidx2 with correct partitioning [production]
06:50 <Tim> on cp1001: disabled HTCP plugin in gmond for testing, seems to work so I will disable it properly [production]
03:55 <Tim> disabled LastModified extension due to overload on cp1005 [production]
03:51 <logmsgbot_> tstarling synchronized wmf-config/InitialiseSettings.php [production]
03:18 <Tim> restarting squid on cp1005, maybe out of FDs or something, cachemgr shows exactly 1000 open connections to 10.2.1.1 [production]
03:08 <Tim> stopped gmond on cp1001 with kill -STOP for memory leak debugging [production]
03:02 <Tim> on cp1002: killed gmond again, it was leaking memory again, already up to 27GB in the few minutes since I restarted it [production]
03:01 <Tim> on fenari: copied *.text and *.upload from /home/wikipedia/conf/squid/generated/clusters to /etc/dsh/group [production]
02:56 <Tim> cp1001: same as on cp1002, restarted gmond [production]
02:53 <Tim> on cp1002: killed gmond, which was using 100% CPU and 23GB RSS. Restarting squid which had died [production]
02:23 <logmsgbot_> LocalisationUpdate completed (1.20wmf3) at Fri Jun 8 02:23:09 UTC 2012 [production]
02:15 <SigmaWP> Hello, world! [production]
02:14 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Fri Jun 8 02:14:55 UTC 2012 [production]
2012-06-07 §
23:32 <Tim> deploying varnish configuration change https://gerrit.wikimedia.org/r/#/c/10672/ on cp1041, cp1042, cp1043, cp1044 [production]
20:46 <logmsgbot_> kaldari synchronized php-1.20wmf4/extensions/LastModified 'syncing LastModified extension' [production]
20:32 <logmsgbot_> kaldari synchronized wmf-config/InitialiseSettings.php 'turning on LastModified and E3Experiemnts for en.wiki' [production]
19:54 <logmsgbot_> kaldari synchronized php-1.20wmf4/extensions/LastModified/E3Experiments/js/ext.E3Experiments.Timestamp.js 'syncing js file for E3Experiments' [production]
18:58 <cmjohnson1_> shutting down search32 for testing [production]
16:52 <Ryan_Lane> added ldap automount entries for /public/datasets and /public/keys [production]
02:19 <logmsgbot_> LocalisationUpdate completed (1.20wmf3) at Thu Jun 7 02:19:52 UTC 2012 [production]
02:11 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Thu Jun 7 02:11:49 UTC 2012 [production]
2012-06-06 §
22:29 <logmsgbot_> aaron synchronized wmf-config/swift.php 'deployed 7dc77e431310580da0dbd368b8b290a293e3ee21' [production]
19:55 <cmjohnson1> shutting down search32 to reseat DIMM B2 [production]
19:18 <cmjohnson1> shutting down storage3 [production]
18:05 <logmsgbot_> aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Moved remaining wikis to 1.20wmf4 [production]