5501-5550 of 10000 results (23ms)
2012-04-17 §
07:44 <apergos> restarted varnish service manually a bit a go on sq67 and sq70, the cron job didn't seem to have gone off. restarted morebots too while I was at it [production]
03:37 <Jeff_Green> dist-upgrade arsenic [production]
03:29 <LeslieCarr> restarting varnish on arsenic again [production]
03:12 <maplebed> started a script to delete old objects on ms-be1 for swift truncated object cleaning [production]
02:53 <Jeff_Green> dist-upgrade on strontium [production]
02:43 <LeslieCarr> restarted varnish on arsenic [production]
02:26 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Tue Apr 17 02:26:40 UTC 2012 [production]
02:17 <logmsgbot_> LocalisationUpdate completed (1.19) at Tue Apr 17 02:17:24 UTC 2012 [production]
01:44 <LeslieCarr> restarting varnish on niobium [production]
00:52 <LeslieCarr> reloading amslvs4 [production]
00:27 <logmsgbot_> aaron synchronized php-1.20wmf1/includes/filerepo 'deployed 552ff0f482f3e65e9795fe304dd810e9ae1b03fb' [production]
2012-04-16 §
23:31 <logmsgbot_> catrope synchronizing Wikimedia installation... : Now with a touch of the specific WikiEditor.i18n.php file [production]
23:11 <logmsgbot_> catrope synchronizing Wikimedia installation... : Hopefully fixing the WikiEditor messages this time, now with MessagesEn.php touch [production]
23:07 <logmsgbot_> catrope synchronizing Wikimedia installation... : Hopefully fixing the WikiEditor messages this time [production]
22:58 <logmsgbot_> awjrichards synchronizing Wikimedia installation... : Updating MobileFrontend to [[rev:114934|r114934]] [production]
22:49 <logmsgbot_> catrope synchronizing Wikimedia installation... : Need to run scap for this WikiEditor change, contains i18n changes [production]
22:39 <logmsgbot_> catrope synchronized php-1.20wmf1/extensions/WikiEditor/ 'Deploy WikiEditor revert' [production]
20:53 <logmsgbot_> catrope synchronized php-1.20wmf1/extensions/WikiEditor/ 'Actually deploy the recent WikiEditor fixes' [production]
18:58 <logmsgbot_> aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Commons Wiki to 1.20wmf1 [production]
18:47 <logmsgbot_> reedy synchronized php-1.20wmf1/resources/mediawiki/mediawiki.js [production]
18:46 <logmsgbot_> reedy synchronized php-1.20wmf1/extensions/WikiEditor [production]
18:37 <mutante> manually added iptables nat rules on nfs2 [production]
18:13 <notpeter> upgrade of udp2log on nfs1/2 complete. should be operating normally now. [production]
17:41 <mutante> LDAP on nfs2 warnings - opendj was _just_ started there when puppet was fixed with an unrelated issue [production]
17:38 <mutante> restarting opendj on nfs2 because it refused connections [production]
17:08 <logmsgbot_> preilly synchronized php-1.19/extensions/ZeroRatedMobileAccess/ 'zero and mobile changes' [production]
16:07 <notpeter> upgrading and restarting udp2log on nfs1/2 [production]
15:04 <mutante> puppet fresh on nfs[12] after removing nonexistent misc::mediawiki-logger class [production]
14:46 <mark> Shutdown db24 for memory testing by Chris [production]
13:27 <mark> Sending European bits traffic back to pmtpa [production]
12:24 <mark> Sending European bits traffic back to esams [production]
12:06 <mark> Testing sess_leak_fix2 patch with a snapshot varnish build on cp3001 [production]
11:56 <Reedy> Ran ddsh -cM -g mediawiki-installation -o -oSetupTimeout=30 -- "cd /usr/local/apache/common && sudo -u mwdeploy ln -s php php-1.18" to create symlink for php-1.18 [production]
11:51 <Reedy> Killing php-1.18 again [production]
11:48 <mutante> sq34 - System halted! Error: Internal Storage Slot, powered down, -> RT [production]
11:45 <logmsgbot_> reedy synchronized php-1.18/ 'Symlink php-1.18 back to php (our current main running version) as lots of requests on bits are for 1.18 resources' [production]
11:44 <mutante> sq34 was broken and died when connecting to mgmt, powercycling [production]
11:37 <mutante> nfs1 - Could not find class misc::mediawiki-logger for nfs1 [production]
10:57 <Krinkle> bits.wikimedia.org back up, mark fixed it. [production]
10:33 <Krinkle> bits.wikimedia.org serving Error 503 Service Unavailable on all load.php requests for mediawiki.org and nl.wikipedia.org, maybe more [production]
09:45 <logmsgbot_> reedy synchronized wmf-config/InitialiseSettings.php 'Set wgEnableJavaScriptTest to true for test2wiki' [production]
02:26 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Mon Apr 16 02:26:58 UTC 2012 [production]
02:18 <logmsgbot_> LocalisationUpdate completed (1.19) at Mon Apr 16 02:17:57 UTC 2012 [production]
2012-04-15 §
17:35 <logmsgbot_> reedy synchronized php-1.20wmf1/includes/api '/me whistles' [production]
17:20 <logmsgbot_> reedy synchronized php-1.20wmf1/includes/api [production]
02:25 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Sun Apr 15 02:25:58 UTC 2012 [production]
02:17 <logmsgbot_> LocalisationUpdate completed (1.19) at Sun Apr 15 02:17:19 UTC 2012 [production]
2012-04-14 §
18:14 <mark> Shifting european bits traffic back from esams to pmtpa, session leak is still there [production]
17:08 <mark> Shifting european bits traffic back from pmtpa to esams [production]
15:31 <mark> Reverted varnish to 3.0.2-2wm4 on cp3001; the race condition patch did not fix the problem [production]