|
2012-07-23
§
|
| 15:14 |
<Reedy> |
srv281 has a full / and hasn't had a puppet run in over 434298 minutes |
[production] |
| 15:10 |
<reedy> |
synchronized php-1.20wmf8/cache/ |
[production] |
| 15:06 |
<reedy> |
synchronized php-1.20wmf8/ 'Initial sync out of 1.20wmf8' |
[production] |
| 13:44 |
<RobH> |
authdns-update for ms-be eqiad hosts |
[production] |
| 12:46 |
<maplebed> |
rebooting ms-be10 for xfs errors and a clean boot |
[production] |
| 12:38 |
<maplebed> |
rebalanced swift rings moving more content to new object servers |
[production] |
| 12:26 |
<reedy> |
synchronized flaggedrevs.dblist |
[production] |
| 12:26 |
<reedy> |
synchronized wmf-config/flaggedrevs.php |
[production] |
| 12:25 |
<Reedy> |
Created trwikiquote flagged revs tables |
[production] |
| 12:23 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.20wmf6) at Mon Jul 23 02:22:45 UTC 2012 |
[production] |
| 02:22 |
<LocalisationUpdate> |
completed (1.20wmf7) at Mon Jul 23 02:22:33 UTC 2012 |
[production] |
|
2012-07-20
§
|
| 18:57 |
<paravoid> |
powerin on owa1/owa2 again, they're being used as ganglia aggregators for swift |
[production] |
| 18:11 |
<Ryan_Lane> |
starting gerrit |
[production] |
| 17:59 |
<binasher> |
db48 is now replicating from db1048 (and db1048 from db48) |
[production] |
| 17:26 |
<RobHalsell> |
authdns-update run for new servers |
[production] |
| 15:29 |
<paravoid> |
powering off the rest of mw10[0-9][0-9] |
[production] |
| 14:35 |
<mark> |
Added server hydrogen to the dns_rec eqiad LVS pool |
[production] |
| 14:22 |
<paravoid> |
powering off owa1/2/3, unused |
[production] |
| 13:54 |
<paravoid> |
powering off all of mw1[0-9][0-9][0-9].eqiad.wmnet, unused |
[production] |
| 13:36 |
<mark> |
Reinstalling hydrogen |
[production] |
| 13:19 |
<paravoid> |
powercycling hydrogen, down since yesterday |
[production] |
| 12:59 |
<paravoid> |
powercycling nescio/ns2, unresponsive network & console |
[production] |
| 10:38 |
<mark> |
Built new varnish 3.0.3~rc1+persistent1-wm1 packages and inserted them into the precise-wikimedia APT repository |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.20wmf6) at Fri Jul 20 02:23:39 UTC 2012 |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.20wmf7) at Fri Jul 20 02:23:27 UTC 2012 |
[production] |
|
2012-07-19
§
|
| 22:48 |
<catrope> |
Finished syncing Wikimedia installation... : |
[production] |
| 22:10 |
<catrope> |
Started syncing Wikimedia installation... : |
[production] |
| 22:02 |
<binasher> |
deploying new mobile redirector to pmtpa text squids (currently inactive) |
[production] |
| 21:39 |
<kaldari> |
Started syncing Wikimedia installation... : |
[production] |
| 21:36 |
<binasher> |
deploying new mobile redirector to eqiad text squids |
[production] |
| 21:36 |
<catrope> |
synchronized php-1.20wmf7/extensions/LastModified 'Remove E3Experiments cruft from LastModified' |
[production] |
| 21:07 |
<binasher> |
deploying new mobile redirector to esams text squids |
[production] |
| 18:52 |
<preilly> |
fixing subdomain check for zero vs m |
[production] |
| 18:52 |
<preilly> |
synchronized wmf-config/mobile.php 'fix subdomain check' |
[production] |
| 18:21 |
<RobH> |
updating dns with new zonefiles for legally won domain names |
[production] |
| 18:15 |
<Jeff_Green> |
storage3 dist-upgrade and reboot |
[production] |
| 17:01 |
<AaronSchulz> |
Running copyFileBackend.php for commons (shards c-f) |
[production] |
| 16:28 |
<cmjohnson1> |
mw60 powering down to replace DIMM B1 rt3287 |
[production] |
| 15:48 |
<RobH> |
hydrogen repaired per rt 3243 |
[production] |
| 15:37 |
<RobH> |
rebooting hydrogen to set bios redirection |
[production] |
| 14:18 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 13:42 |
<Jeff_Green> |
dist-upgrade and reboot hosts in payments cluster |
[production] |
| 13:12 |
<Reedy> |
Pointed /h/w/c/php to php-1.20wmf7 |
[production] |