801-850 of 10000 results (16ms)
2012-06-11 §
16:02 <logmsgbot_> reedy Started syncing Wikimedia installation... : Rebuild messagecache for 1.20wmf5 [production]
15:55 <logmsgbot_> reedy Started syncing Wikimedia installation... : Rebuild messagecache for 1.20wmf5 [production]
15:54 <logmsgbot_> reedy Finished syncing Wikimedia installation... : Rebuild messagecache for 1.20wmf5 [production]
15:46 <mutante> hume /usr/local/apache is out of disk (just 5GB but more branches now). (LVM vg "tank" lv "tank-apache" ) but no free extents. could take from /archive but unsure about shrinking the xfs. [production]
15:35 <logmsgbot_> reedy Started syncing Wikimedia installation... : Rebuild messagecache for 1.20wmf5 [production]
15:30 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: test2wiki to 1.20wmf5 [production]
15:28 <logmsgbot_> reedy synchronized php-1.20wmf5/ [production]
15:20 <Reedy> running sync-dir php-1.20wmf5 [production]
15:13 <Reedy> Copying checkout of 1.20wmf5 onto NFS [production]
14:53 <mutante> running puppet on stat1. installs plotting packages [production]
09:56 <apergos> shut down mysqld on db1047, reparing tables [production]
06:54 <pp-pdf2> upgraded mwlib to 0.13.8 [production]
06:54 <pp-pdf3> upgraded mwlib to 0.13.8 [production]
06:54 <pp-pdf1> upgraded mwlib to 0.13.8 [production]
02:24 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Mon Jun 11 02:24:06 UTC 2012 [production]
2012-06-10 §
02:22 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sun Jun 10 02:22:33 UTC 2012 [production]
2012-06-09 §
07:45 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sat Jun 9 07:45:17 UTC 2012 [production]
02:35 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Sat Jun 9 02:35:29 UTC 2012 [production]
02:25 <Reedy> Running LU manually [production]
02:14 <Reedy> Cleared a bit of space on fenari by deleting checkouts from /tmp [production]
02:00 <logmsgbot_> LocalisationUpdate failed: git pull of core failed [production]
01:51 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: [production]
01:50 <logmsgbot_> reedy synchronized wikimedia.dblist [production]
01:49 <Reedy> fenari has a full / [production]
01:49 <logmsgbot_> reedy synchronized all.dblist [production]
2012-06-08 §
20:32 <Reedy> Updated php to point to php-1.20wmf4 rather than php-1.20wmf3 [production]
20:09 <logmsgbot_> reedy synchronized wikimedia.dblist [production]
20:08 <logmsgbot_> reedy synchronized all.dblist [production]
20:04 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: 2 wikimedia wikis to 1.20wmf4 [production]
19:57 <logmsgbot_> reedy Finished syncing Wikimedia installation... : Rebuilding localisation cache for message updates [production]
19:39 <logmsgbot_> reedy Started syncing Wikimedia installation... : Rebuilding localisation cache for message updates [production]
18:47 <logmsgbot_> reedy synchronized php-1.20wmf4/languages/messages/ 'Pushing out updated files upon siebrands request' [production]
16:30 <cmjohnson1> shutting down search32 to swap DIMM around [production]
10:19 <notpeter> ganglia down, restarting apache on nickel. [production]
09:32 <notpeter> stopping indexing on searchidx1001 to re-copy to searchidx2 [production]
08:45 <notpeter> reimaging searchidx2 with correct partitioning [production]
06:50 <Tim> on cp1001: disabled HTCP plugin in gmond for testing, seems to work so I will disable it properly [production]
03:55 <Tim> disabled LastModified extension due to overload on cp1005 [production]
03:51 <logmsgbot_> tstarling synchronized wmf-config/InitialiseSettings.php [production]
03:18 <Tim> restarting squid on cp1005, maybe out of FDs or something, cachemgr shows exactly 1000 open connections to 10.2.1.1 [production]
03:08 <Tim> stopped gmond on cp1001 with kill -STOP for memory leak debugging [production]
03:02 <Tim> on cp1002: killed gmond again, it was leaking memory again, already up to 27GB in the few minutes since I restarted it [production]
03:01 <Tim> on fenari: copied *.text and *.upload from /home/wikipedia/conf/squid/generated/clusters to /etc/dsh/group [production]
02:56 <Tim> cp1001: same as on cp1002, restarted gmond [production]
02:53 <Tim> on cp1002: killed gmond, which was using 100% CPU and 23GB RSS. Restarting squid which had died [production]
02:23 <logmsgbot_> LocalisationUpdate completed (1.20wmf3) at Fri Jun 8 02:23:09 UTC 2012 [production]
02:15 <SigmaWP> Hello, world! [production]
02:14 <logmsgbot_> LocalisationUpdate completed (1.20wmf4) at Fri Jun 8 02:14:55 UTC 2012 [production]
2012-06-07 §
23:32 <Tim> deploying varnish configuration change https://gerrit.wikimedia.org/r/#/c/10672/ on cp1041, cp1042, cp1043, cp1044 [production]
20:46 <logmsgbot_> kaldari synchronized php-1.20wmf4/extensions/LastModified 'syncing LastModified extension' [production]