9851-9900 of 10000 results (25ms)
2010-12-16 §
23:42 <Ryan_Lane> stopping mysql on storage3 to replace the faulkner db [production]
23:33 <Ryan_Lane> starting mysql on storage3 [production]
23:07 <RobH> srv226-srv232 coming down for relocation [production]
23:06 <robh> synchronized php-1.5/wmf-config/mc.php 'moved servers around for relocation' [production]
22:38 <RobH> srv281 reinstalling [production]
22:24 <RobH> srv281 coming down for repair (isnt in memcached active pool) [production]
22:11 <Ryan_Lane> rebooting storage3 [production]
22:10 <Ryan_Lane> restating apparmor on storage3 to reload profiles [production]
21:09 <RobH> all power strips in row c and d sdtpa have been wired for serial [production]
20:18 <Ryan_Lane> stopping mysql on db10 and copying data to storage3 [production]
20:11 <Ryan_Lane> installing lvm on storage3 [production]
20:11 <tomaszf> killing long running civicrm queries on db9 [production]
19:59 <Ryan_Lane> creating LVM configuration using sda [production]
19:48 <Ryan_Lane> reformatting /dev/sda1 as xfs on storage3 [production]
19:48 <Ryan_Lane> unmounting /data on storage3 and mounting as /a [production]
19:44 <CodeBlock> installing puppetmaster and puppet on nova-controller [production]
19:35 <Ryan_Lane> installing mysql-client mysql-server mysql-common on storage3 [production]
2010-12-15 §
22:26 <Ryan_Lane> restarted slave on db10 [production]
22:25 <Ryan_Lane> killed mysqlcheck process on db10, as it was eating all available cpu [production]
22:09 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 26222 - Set $wgLogo to local logo on rowiki' [production]
21:55 <Ryan_Lane> restarted slave on db10 [production]
21:16 <Ryan_Lane> restarting mysqld on db10 [production]
21:16 <Ryan_Lane> enabling long query log on db10 [production]
20:43 <Ryan_Lane> stoped and started slave on db10 [production]
19:39 <RobH> pushing dns change to switch dumps to dataset1 from singer (download and all its various incarnations are all pointing at dumps [production]
19:17 <RobH> amaranth accidental reboot due to power removal [production]
18:50 <RobH> msw-b1-sdtpa power cycled due to power cable being moved within the rack [production]
18:41 <RobH> storage3 powering down to have its power distro fixed in rack [production]
18:30 <RobH> bringing down db41/db42, the power in rack B1-sdtpa is not balanced properly. [production]
17:52 <demon> synchronized php-1.5/extensions/CodeReview/backend/CodeRevision.php 'r78443' [production]
17:45 <demon> synchronized php-1.5/extensions/CodeReview/backend/CodeRevision.php 'Debugging pywikipedia failure' [production]
09:48 <domas> upgraded stuff on secure to fix ssl warnings [production]
02:37 <phuzion> Wrote configs for powerdns with ldap backend and restarted powerdns. [production]
02:34 <Ryan_Lane> restarting opendj on nova-controller.tesla [production]
02:34 <Ryan_Lane> adding the dnsdomain2 schema to opendj on nova-controller.tesla [production]
02:13 <phuzion> Instaled pdns-server and pdns-backend-ldap on nova-controller.tesla [production]
01:15 <awjrichards> synchronized php-1.5/extensions/ContributionReporting/FundraiserStatistics.js 'updating to r78421 so fundraising stats page defaults to 2010 fundraiser' [production]
01:15 <awjrichards> synchronized php-1.5/extensions/ContributionReporting/FundraiserStatistics_body.php 'updating to r78421 so fundraising stats page defaults to 2010 fundraiser' [production]
00:09 <awjrichards> synchronized php-1.5/extensions/ContributionReporting/FundraiserStatistics.js 'Revering to r64689 due to broken JS' [production]
2010-12-14 §
23:59 <awjrichards> synchronized php-1.5/extensions/ContributionReporting/FundraiserStatistics.js 'updating to r78414 so fundraising stats page defaults to 2010 fundraiser' [production]
22:36 <Ryan_Lane> installing python-crypto on nova-controller.tesla [production]
20:09 <catrope> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Raise $wgAPIMaxResultSize to 12MB temporarily because there are 10MB revs on enwiki even though $wgMaxArticleSize is 2MB' [production]
12:26 <Tim> spent the 5 minutes required to get MediaWiki tarball downloads working again from download.wikimedia.org [production]
2010-12-13 §
23:47 <apergos> dataset1 is up, ssh accessible, with the data partition mounted read only, rsync on tridge in a screen session dong rsync as root of /data/xmldatadumps from dataset1 to /data/XMLdumps on tridge. [production]
21:37 <Ryan_Lane> restarting pdns on ns1 [production]
21:36 <Ryan_Lane> changing IP address for payments.wikimedia.org in DNS [production]
20:54 <Ryan_Lane> restarting pybal on lvs4 [production]
20:33 <Ryan_Lane> intalling wikimedia-lvs-realserver on payments3 and payments4 [production]
20:31 <Ryan_Lane> adding payments configuration to pybal on lvs4 [production]
20:11 <Ryan_Lane> moving payments4 into public subnet and restarting network services [production]