951-1000 of 10000 results (17ms)
2012-04-30 ยง
23:38 <RoanKattouw> Moved /home/catrope/php-1.19 to /home/wikipedia/lazy-backups/php-1.19 [production]
23:38 <Reedy> mediawiki.org to 1.20wmf2 [production]
23:37 <logmsgbot_> reedy rebuilt wikiversions.cdb and synchronized wikiversions files: mw.org to 1.20wmf2 [production]
23:35 <RoanKattouw> Strike that, instead moving /home/w/common/php-1.19 to /home/catrope/php-1.19 [production]
23:34 <RoanKattouw> Removing /home/w/common/php-1.19 , NFS might freak out a bit [production]
23:31 <RoanKattouw> Removed php-1.19 from mw60 , synced it, and restarted Apache [production]
23:28 <RoanKattouw> Synced docroot and purged varnish for static-1.20wmf2, bits seems to be working for 1.20wmf2 now [production]
23:27 <RoanKattouw> mw60 has full disk, stopping Apache for now [production]
22:50 <Ryan_Lane> rebooting virt5 [production]
22:42 <Ryan_Lane> rebooting virt3 [production]
22:35 <Ryan_Lane> rebooting virt4 [production]
22:28 <Ryan_Lane> rebooting virt1 [production]
22:23 <Ryan_Lane> bringing down all instances (yay gluster) [production]
21:12 <pgehres> re-enabled Jenkins jobs on Aluminium after db1008 reboot [production]
21:11 <pgehres> CiviCRM back to normal after db1008 reboot [production]
21:07 <Jeff_Green> db1008 gets kernel update and reboot [production]
21:00 <pgehres> put CiviCRM on Aluminium in maintenance mode for db1008 reboot [production]
20:59 <logmsgbot_> reedy synchronized php-1.20wmf2/resources/startup.js 'touch' [production]
20:57 <pgehres> disabled all Jenkins jobs on Aluminium in prep for db1008 reboot [production]
20:50 <Jeff_Green> db1025 and storage3 get new kernels and reboot [production]
20:43 <notpeter> removing ssl4 from pool, stopping puppet on ssl4, adding 3rd udp2log host for testing, restarting nginx [production]
20:28 <notpeter> restarting, once again, innobackupex from db1034 to db57 for new s2 slave after fenari crash killed my screen [production]
20:24 <Reedy> Running ddsh -F30 -cM -g mediawiki-installation -o -oSetupTimeout=10 '/usr/bin/scap-1' in the hope it syncs all the files that would be nice to be on the app servers [production]
20:18 <logmsgbot_> reedy synchronized php-1.20wmf2/cache/ 'Synching whole cache directory' [production]
19:59 <notpeter> restarting nagios to get rid of some old checks [production]
19:57 <Jeff_Green> payments cluster gets kernel updates and reboots [production]
19:55 <logmsgbot_> reedy synchronizing Wikimedia installation... : Rebuiild l10n for 1.20wmf2 [production]
19:49 <logmsgbot_> reedy synchronized wmf-config/ExtensionMessages-1.20wmf2.php 'Syncing file' [production]
19:49 <logmsgbot_> reedy synchronized php-1.20wmf2/LocalSettings.php 'Pushing LocalSettings.php' [production]
19:48 <paravoid> upgraded & rebooted ssl3001, ssl3002, ssl3003 [production]
19:46 <logmsgbot_> reedy synchronizing Wikimedia installation... : Pushing out new symlinks etc, moving test2wiki to 1.20wmf2 [production]
19:30 <logmsgbot_> reedy synchronized php-1.20wmf2 'Syncing 1.20wmf2 live hack revisions' [production]
19:28 <logmsgbot_> reedy synchronized php-1.20wmf2 'Syncing 1.20wmf1 live hack revisions' [production]
19:26 <logmsgbot_> reedy synchronized php-1.20wmf2 'Syncing 1.20wmf2 for deployment' [production]
19:18 <Reedy> Syncing php-1.20wmf2 files from NFS to apaches. Likely to upset NFS (or the uplink for the switch nfs is on) for a little while... [production]
19:14 <paravoid> rebooting ssl1004 [production]
19:06 <paravoid> rebooting ssl1003 [production]
19:00 <paravoid> rebooting ssl1002 [production]
18:59 <notpeter> starting innobackupex from db1034 to db57 for new s2 slave [production]
18:50 <paravoid> rebooting ssl1001 [production]
18:42 <Jeff_Green> grosley gets new kernel + reboot [production]
18:35 <Jeff_Green> aluminium gets kernel update, yayyyyyyy! [production]
18:34 <paravoid> pooled back ssl1; depooling ssl3 and rebooting [production]
18:29 <binasher> rebooting mw45 for kernel upgrade [production]
18:27 <Jeff_Green> power cycling aluminium which faceplanted [production]
18:22 <binasher> rebooting mw45 [production]
18:21 <notpeter> rebuilding db57 again, this time with more correct raid level! [production]
18:19 <logmsgbot_> asher synchronized wmf-config/db.php 'adding db59,60 to s1 with low weights' [production]
18:16 <paravoid> depooled & rebooting ssl1 [production]
18:09 <logmsgbot_> aaron rebuilt wikiversions.cdb and synchronized wikiversions files: Sanity run after script changes. [production]