251-300 of 10000 results (13ms)
2012-04-28 §
02:24 <Ryan_Lane> rebooting all mediawiki boxes that have uptimes affected by the bug are being rebooted at 8 minute intervals [production]
02:14 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Sat Apr 28 02:14:14 UTC 2012 [production]
01:33 <paravoid> powecycled mw29 [production]
01:21 <paravoid> powercycled mw38 [production]
00:17 <notpeter> db12 is sooooo sloooooow, starting innobackupex from db1017 to db60 for new s1 slave [production]
2012-04-27 §
22:15 <paravoid> upgraded ssl4 to nginx 0.7.65-5wmf1 and added it back to the pool [production]
21:45 <paravoid> rebooting ssl4 after upgrading (incl. a kernel update) [production]
20:00 <notpeter> starting innobackupex from db1040 to db1022 for new eqiad s6 snapshot slave, again [production]
19:59 <notpeter> starting innobackupex from db12 to db60 for new s1 slave, again [production]
19:58 <notpeter> starting innobackupex from db1017 to db59 for new s1 slave, again [production]
19:49 <paravoid> de-pooling ssl4 [production]
19:30 <mutante> test - added new gerrit interwiki prefix for SAL/wikitech - [[gerrit:6002]] [production]
19:14 <logmsgbot_> catrope synchronized wmf-config/CommonSettings.php 'Fix rights for afttest and afttest-hide groups' [production]
18:25 <logmsgbot_> reedy synchronized wmf-config/CommonSettings.php 'Cleanup enotif related settings' [production]
18:24 <logmsgbot_> reedy synchronized wmf-config/InitialiseSettings.php 'Set wgEnotifWatchlist to true for all wikis. Leaving wgShowUpdatedMarker set to false for all the big wikis' [production]
16:50 <logmsgbot_> reedy synchronized wmf-config/CommonSettings.php 'Simplify enotif code' [production]
16:45 <notpeter> starting innobackupex from db1040 to db1022 for new eqiad s6 snapshot slave [production]
16:45 <logmsgbot_> reedy synchronized wmf-config/InitialiseSettings.php 'wgEnotifWatchlist defaulting to true. Big wikis explicitly set to false' [production]
12:25 <mutante> fixing integration.mw testswarm and applying fixed erb template by hashar [production]
04:35 <Tim> added an account for myself on observium [production]
04:22 <logmsgbot_> tstarling synchronized wmf-config/mc.php 'increased wgMemCachedTimeout from 500ms to 3000ms for [[bugzilla:35900|bug 35900]]' [production]
02:13 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Fri Apr 27 02:13:51 UTC 2012 [production]
00:12 <Ryan_Lane> upgrading gluster on all instances [production]
00:09 <Ryan_Lane> upgrading gluster on labstore1-4 [production]
2012-04-26 §
23:46 <logmsgbot_> asher synchronized wmf-config/db.php 'raising db58 weight' [production]
23:09 <Reedy> Recreated resources directory symlinks in bits docroot [production]
21:21 <LeslieCarr> started deletion script on ms-be4 [production]
19:20 <notpeter> restarting puppet on db59 [production]
19:18 <Ryan_Lane> made LiquidThreads disabled by default on labsconsole, now users must add the special string to a page to enable it there. [production]
19:18 <Ryan_Lane> enabled NewUserMessage on labsconsole [production]
19:06 <logmsgbot_> catrope synchronized wmf-config/CommonSettings.php 'Add group permissions settings for AFTv5' [production]
18:33 <logmsgbot_> catrope synchronizing Wikimedia installation... : Deploy AFTv5 updates [production]
17:17 <LeslieCarr> reloaded varnish on mobile caches [production]
14:19 <notpeter> cleaned log space on search1017 and search1018 and started lucene [production]
14:04 <notpeter> stopping lucene on search1017 and 1018 to take that out of the equation [production]
13:57 <mutante> installing some (security) upgrades on fenari (apt,cron,samba,...) [production]
13:54 <notpeter> restartin lucene on search1017 and search1018 [production]
13:27 <logmsgbot_> nikerabbit synchronized wmf-config/InitialiseSettings.php 'Narayamon tewiki [[bugzilla:33480|bug 33480]]' [production]
13:23 <logmsgbot_> nikerabbit synchronized php-1.20wmf1/extensions/Narayam/ 'Updating Narayam' [production]
13:03 <notpeter> (re)starting innobackupex from db1017 to db59 for new s1 slave [production]
12:56 <mark> Created precise-wikimedia APT distribution [production]
08:27 <mark> Power cycled mw40 [production]
06:57 <binasher> restart pybal on amlvs1 with bgp disabled [production]
06:57 <binasher> restarted pybal on amlvs2 with bgp enabled [production]
06:47 <binasher> restarting pybal on amslvs2 [production]
06:26 <binasher> shifting all traffic out of esams [production]
02:14 <logmsgbot_> LocalisationUpdate completed (1.20wmf1) at Thu Apr 26 02:14:03 UTC 2012 [production]
01:42 <Ryan_Lane> starting mysql on db46 [production]
01:40 <Tim> on professor: restarted udpprofile collector [production]
01:37 <Ryan_Lane> powercycling db46 [production]