1151-1200 of 10000 results (15ms)
2013-06-05 §
16:49 <paravoid> upgrading Ceph to cuttlefish, ignore warnings for the next half/one hour [production]
15:31 <andrewbogott> upgraded adminbot on wikitech-static to 1.7.3. Should be more likely to survive netsplits. [production]
10:23 <paravoid> starting icinga [production]
03:57 <apergos> restarted morebots [production]
2013-06-04 §
02:36 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Jun 4 02:36:22 UTC 2013 [production]
02:16 <LocalisationUpdate> completed (1.22wmf4) at Tue Jun 4 02:16:08 UTC 2013 [production]
02:10 <LocalisationUpdate> completed (1.22wmf5) at Tue Jun 4 02:09:55 UTC 2013 [production]
2013-06-03 §
23:07 <mutante> DNS update - point contacts away from broken singer [production]
22:57 <kaldari> synchronized php-1.22wmf5/extensions/TimedMediaHandler/resources/mw.MediaWikiPlayerSupport.js 'syncing mw.MediaWikiPlayerSupport.js for TimedMediaHandler bug' [production]
22:25 <binasher> replaced redis-server in precise-wikimedia with 2.6.13 [production]
21:17 <binasher> upgrading php5-redis on all appservers to version bult from github master 2d0f29bdaf29b071aea29b8fb9ee4158c2b69d72 [production]
20:27 <LeslieCarr> dist-upgrading vanadium [production]
20:27 <LeslieCarr> allowing salt out of analytics subnet [production]
19:36 <aaron> synchronized php-1.22wmf5/includes/diff/DifferenceEngine.php '22a544be01809226c1069cff90cdc174df81b7e5' [production]
19:18 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: enwiki to 1.22wmf5 [production]
19:15 <aaron> synchronized php-1.22wmf5/includes/WebRequest.php '7715ffc9e4216497edc696fa686103dcc9698e9d' [production]
19:14 <aaron> synchronized php-1.22wmf4/includes/WebRequest.php '7f31f0029bdc4526b41ad09968e17e10838087a6' [production]
17:55 <binasher> dropped old rowiki db from s3, left over from the migration to s7 4+ years ago [production]
17:00 <cmjohnson1> ms-be1011 replacing disk at slot5 [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Jun 3 02:07:36 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf4) at Mon Jun 3 02:02:19 UTC 2013 [production]
02:01 <LocalisationUpdate> completed (1.22wmf5) at Mon Jun 3 02:01:35 UTC 2013 [production]
2013-06-02 §
23:00 <reedy> synchronized php-1.22wmf5/extensions/SecurePoll [production]
22:59 <reedy> synchronized php-1.22wmf4/extensions/SecurePoll [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jun 2 02:07:28 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf4) at Sun Jun 2 02:02:14 UTC 2013 [production]
02:01 <LocalisationUpdate> completed (1.22wmf5) at Sun Jun 2 02:01:30 UTC 2013 [production]
2013-06-01 §
15:55 <paravoid> staggered reboot of ms-fe1001-4, standard maintenance [production]
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jun 1 02:07:32 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf4) at Sat Jun 1 02:02:25 UTC 2013 [production]
02:01 <LocalisationUpdate> completed (1.22wmf5) at Sat Jun 1 02:01:38 UTC 2013 [production]
2013-05-31 §
21:33 <hashar> Zuul / Jenkins had some delay most probably related to a lot of patchsets being sent at the same time. Zuul catching up right now. [production]
21:15 <binasher> completed echo event_page_id schema migrations [production]
20:49 <binasher> restarted gerrit [production]
19:53 <AaronSchulz> Running a terbium script to copy missing files to swift as well as ceph [production]
19:24 <aaron> synchronized php-1.22wmf5/maintenance/copyFileBackend.php '82352634594d0a67d3b9f6597c3bb2c0911f8028' [production]
19:22 <aaron> synchronized php-1.22wmf4/maintenance/copyFileBackend.php '3d0e3f8e4d09d4a2462f583c25dd284e6ee3e466' [production]
14:41 <reedy> synchronized php-1.22wmf4/extensions/SecurePoll/ [production]
14:40 <reedy> synchronized php-1.22wmf5/extensions/SecurePoll/ [production]
14:33 <Reedy> Created bv2013_edit tables on all wikis [production]
14:29 <reedy> synchronized php-1.22wmf4/extensions/SecurePoll/ [production]
14:28 <reedy> synchronized php-1.22wmf5/extensions/SecurePoll/ [production]
12:04 <apergos> uh... it would help if I looked on tin, the actual deploy host so nm. anyways texvc now working [production]
12:00 <apergos> ran scap-recompile to get texvc built for 1.22wmf5 and btw this had to be done from fenari, there's no dsh on terbium [production]
06:56 <apergos> ceph osds 50 and 132 on ms-fe1002 are logging 'slow requests', don't know how to restart specific osds in bobtail though [production]
06:42 <Aaron|home> Running a script on terbium to list out files that were updated (overwritten) but are not synced on all wikis (it found none on commons/enwiki) [production]
05:25 <Tim> on msfe1001-1004: disabled apache_status ganglia module [production]
04:17 <Tim> on nickel: restarting gmetad to see if that fixes ceph cluster reporting [production]
04:01 <aaron> synchronized wmf-config/filebackend.php 'Disabled ceph backends and switched to just swift.' [production]
02:31 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri May 31 02:31:40 UTC 2013 [production]