3001-3050 of 10000 results (19ms)
2010-12-20 §
13:16 <tstarling> synchronized wmf-deployment/cache/trusted-xff.cdb [production]
13:14 <Tim> updating TrustedXFF [production]
12:14 <apergos> one hour later, 6.62GB has been copied of the XML dumps, out of 1T. Let's see how long it takes to get the whole thing over. [production]
11:13 <apergos> started copy to google storage of the last complete xml dumps for each project (note that "complete" may include "completed with failures"), from dataset1, in root screen session [production]
2010-12-19 §
18:58 <mark> Powercycled amssq42, 48, 57, 58 [production]
18:22 <mark> Fixed puppet on ekrem [production]
16:20 <mark> Fixed ganglia on spence again [production]
14:49 <mark> Fixed Ganglia on Spence [production]
14:21 <mark> Fixed puppet payments3 exported resource override issue [production]
14:02 <mark> Rebooting spence [production]
13:44 <mark> Starting dist upgrade from hardy to lucid on spence [production]
13:43 <mark> Stopping nagios on spence [production]
13:42 <mark> Removed mysql-server from spence [production]
13:29 <mark> Disabled Merlin Nagios module [production]
13:11 <mark> Rebooting spence [production]
13:02 <mark> Running apt-get dist-upgrade on spence [production]
12:57 <mark> Power cycled spence [production]
2010-12-18 §
23:11 <RobH> srv187-srv189 relocated and powering up [production]
22:27 <robh> synchronized php-1.5/wmf-config/db.php 'srv181-srv186 in' [production]
22:26 <mark> Updated smokeping with new rack layouts and contents [production]
22:21 <RobH> srv181-srv186 relocated and coming back online [production]
22:21 <RobH> srv187-srv189 coming down for relocation [production]
22:00 <robh> synchronized php-1.5/wmf-config/db.php 'srv153 srv154 in' [production]
21:58 <RobH> srv153, srv154 powering back up [production]
21:53 <RobH> shutting down srv153, srv154 power redistribution [production]
21:51 <robh> synchronized php-1.5/wmf-config/db.php 'srv154-srv153 out' [production]
21:28 <RobH> srv181-srv186 going offline for relocation [production]
21:27 <robh> synchronized php-1.5/wmf-config/db.php 'srv181-srv186 pulled when applicable' [production]
21:23 <hashar> synchronized php-1.5/wmf-config/abusefilter.php 'resyncing abusefilter.php for the offline apaches' [production]
21:20 <robh> synchronized php-1.5/wmf-config/db.php [production]
21:15 <RobH> srv157 accidental reboot, opps =P [production]
21:13 <robh> synchronized php-1.5/wmf-config/db.php 'commented out srv156, its coming down for power rebalancing' [production]
21:11 <robh> synchronized php-1.5/wmf-config/db.php 'srv178-srv180 back in' [production]
21:05 <RobH> srv175-srv180 relocated to new rack and coming online [production]
20:53 <robh> synchronized php-1.5/wmf-config/db.php 'srv177 back in' [production]
20:42 <robh> synchronized php-1.5/wmf-config/db.php 'srv175 srv176 back in' [production]
20:06 <hashar> synchronized php-1.5/wmf-config/abusefilter.php 'bug 26364: abuse filter privacy issue on hiwiki' [production]
20:02 <RobH> srv175-srv180 coming down for relocation [production]
20:02 <robh> synchronized php-1.5/wmf-config/db.php 'putting ms2 back into ES rotation, removing srv175-srv180' [production]
19:39 <hashar> synchronized php-1.5/wmf-config/InitialiseSettings.php 'bug 26364: abuse filter privacy issue on hiwiki' [production]
19:28 <RobH> hume back online in new rack [production]
18:38 <mark> DRBD failover to nfs2 successful, nfs2 is now primary [production]
18:38 <RobH> pdf2 relocated, powering up [production]
18:32 <mark> Starting DRBD failover of nfs1 to nfs2 [production]
18:20 <RobH> nfs2 reracked, powered up, online (replication check delayed until later) [production]
18:19 <RobH> pdf2 coming down for relocation, will be back online shortly [production]
17:51 <RobH> shutting down nfs2 for relocation [production]
17:42 <RobH> tridge moved, powering back up [production]
17:00 <RobH> streber & williams moved, powering up [production]
16:43 <RobH> williams and streber coming down for relocation (otrs and rt will be offline during this transition) [production]