|
2011-09-07
§
|
| 11:05 |
<mutante> |
db15 - dist-upgrade/kernel, reboot |
[production] |
| 10:54 |
<mutante> |
db15 - reset/power up via Sun LOM |
[production] |
| 10:20 |
<catrope> |
synchronized php/includes/SquidUpdate.php 'Revert emergency patch for [[bugzilla:30792|bug 30792]]' |
[production] |
| 10:19 |
<catrope> |
synchronized wmf-config/CommonSettings.php '[[bugzilla:30792|bug 30792]]: set $wgInternalServer' |
[production] |
| 09:19 |
<mutante> |
sq72 - powercycle,dist-upgrade/kernel,squid clean,reboot |
[production] |
| 02:53 |
<tstarling> |
synchronized php-1.17/extensions/OggHandler/OggHandler_body.php 'live patch to fix total breakage of OggHandler due to protocol-relative upload URLs' |
[production] |
| 02:45 |
<tstarling> |
synchronized php-1.17/includes/SquidUpdate.php 'emergency patch for [[bugzilla:30792|bug 30792]]' |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.17) at Wed Sep 7 02:24:09 UTC 2011 |
[production] |
| 01:40 |
<asher> |
synchronized 503.html 'running sync-file to test new wikimedia-task-appserver' |
[production] |
|
2011-09-06
§
|
| 22:38 |
<catrope> |
synchronized php/languages/messages/MessagesEn.php '[[rev:96194|r96194]]' |
[production] |
| 22:20 |
<ben> |
synchronized wmf-config/mc.php 'moved mc servers that passed mctest.php from the down list to the spares list. Whitespace cleanup. Linked to memcache wikitech page. -ben' |
[production] |
| 22:13 |
<binasher> |
wiped enwiki slave on db1048, re-enabled binlogging |
[production] |
| 20:06 |
<Jeff_Green> |
rebooting db1008 for kernel update |
[production] |
| 19:58 |
<catrope> |
synchronized wmf-config/InitialiseSettings.php 'Make wgUploadPath protocol-relative for commons, meta and test' |
[production] |
| 19:22 |
<catrope> |
synchronized wmf-config/InitialiseSettings.php 'Enable HTTPS on meta' |
[production] |
| 19:19 |
<catrope> |
synchronized php/includes/Title.php '[[rev:96360|r96360]]' |
[production] |
| 19:18 |
<catrope> |
synchronized php/extensions/CentralNotice/CentralNotice.php '[[rev:96360|r96360]]' |
[production] |
| 19:18 |
<catrope> |
synchronized php/extensions/Collection/Collection.body.php '[[rev:96360|r96360]]' |
[production] |
| 17:42 |
<robh> |
ns1 pdns restarted |
[production] |
| 17:42 |
<robh> |
ns1/linne pdns died. initial post sync check with dig showed new info populated, odd. |
[production] |
| 17:38 |
<robh> |
all dns servers still responsive after update |
[production] |
| 17:37 |
<robh> |
updating dns for sodium server per RT#1423 |
[production] |
| 07:56 |
<apergos> |
rsyncd set up and running on dataset2 for mirroring recent xml dumps |
[production] |
| 07:30 |
<apergos> |
restarted lighttpd on dataset2 |
[production] |
| 02:24 |
<LocalisationUpdate> |
completed (1.17) at Tue Sep 6 02:26:41 UTC 2011 |
[production] |
|
2011-09-05
§
|
| 18:35 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php '[[bugzilla:30756|bug 30756]] Enable wikilove on sewiki' |
[production] |
| 16:21 |
<RoanKattouw> |
Restarting indexer on searchidx2 |
[production] |
| 16:20 |
<RoanKattouw> |
Installing new build of LuceneSearch.jar on searchidx2. Contains fix for protocol-relative URLs that only applies to the indexer |
[production] |
| 15:48 |
<catrope> |
synchronized php-fatal-error.html 'Update for [[rev:96283|r96283]]' |
[production] |
| 15:42 |
<catrope> |
synchronized live-1.5/404.php 'Per [[bugzilla:30733|bug 30733]], fix HTTPS detection and make URLs protocol-relative. Grr, why is this file not versioned?' |
[production] |
| 13:31 |
<mutante> |
sq31 shutdown -> RT #1431 (degraded RAID, just on one disk and squid would not run anyways) |
[production] |
| 13:18 |
<mark> |
Extended /var LVM LV on lily by 5 GB |
[production] |
| 13:00 |
<mutante> |
sq33 - dist-upgrade/kernel, reboot | sq31 - hardware failure? ->RT #1431 |
[production] |
| 12:22 |
<mutante> |
sq31 - installed smartmontools to check disk health, squid backend does not start due to missing /dev/sdd | srv266 run puppet manually |
[production] |
| 11:42 |
<mutante> |
srv217,srv266 - fix NTP/ntpdate | sq31 - dist-upgrade/kernel, start squid |
[production] |
| 11:34 |
<mutante> |
srv266 - power cycle (too often since July) |
[production] |
| 11:25 |
<mutante> |
sq76 - power up,dist upgrade/kernel,squid clean,reboot |
[production] |
| 11:12 |
<mutante> |
also cleared paniclogs on mchenry (spamd socket fail on Aug31) and lily (temp. failure to write log due to disk space, see Tim's log entries Sep 2nd) |
[production] |
| 11:05 |
<mutante> |
reviewd paniclog on srv207 due to non-zero size. ran out of mem once on Aug 11, cleared logs to stop email alerts |
[production] |
| 10:43 |
<mutante> |
sq55 - power up,dist upgrade/kernel,squid clean,reboot |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.17) at Mon Sep 5 02:29:45 UTC 2011 |
[production] |