|
2011-05-25
§
|
| 11:58 |
<domas> |
rebooting db9, looks unhealthy |
[production] |
| 11:06 |
<apergos> |
so that was me on srv225: stopped apache, waited for puppet restart: it now syncs, then does the restart. oh btw srv225 isn't in the pybal apache conf file, weirdly... anyone know why? |
[production] |
| 09:15 |
<apergos> |
restarted front and backend squids on sq75 |
[production] |
| 08:47 |
<apergos> |
restarted front and back end squids on sq81, front end was 20gb and back end was out to lunch |
[production] |
| 08:35 |
<apergos> |
ekrem's root partition was full; cleared out some older logs from /var/log/apache2, compressed the most recently rotated (it had failed from disk full), reloaded puppet |
[production] |
| 07:20 |
<Tim> |
set read_only=1 on db10, it's a slave so it should be read only. Nagios says it was broken for 6 months. |
[production] |
| 07:07 |
<midom> |
synchronized php-1.17/wmf-config/db.php |
[production] |
| 05:09 |
<Tim> |
restarted nagios IRC bot |
[production] |
| 01:05 |
<Tim> |
created an account for myself in watchmouse |
[production] |
| 00:48 |
<Andrew> |
Running populateBv2011EditCount.php in a screen on hume |
[production] |
| 00:32 |
<Ryan_Lane> |
pruning binlogs on db9 |
[production] |
|
2011-05-24
§
|
| 23:12 |
<pdhanda> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'Bug 29129. Added a namespace alias for metawiki.' |
[production] |
| 20:36 |
<notpeter_> |
resyncing drbd nfs1 to nfs2 |
[production] |
| 20:28 |
<RobH> |
mobile4 awaiting final configurations for service, mobile5 installation done, not yet run puppet updates |
[production] |
| 20:20 |
<RobH> |
mobile4 is running puppet updates, mobile5 is mid-install |
[production] |
| 19:46 |
<RobH> |
mobile4 & mobile5 racked and accessible for mgmt. installing OS on mobile4 now |
[production] |
| 18:00 |
<Ryan_Lane> |
added new reverse zone for svc ips in esams; added entries for bits.svc.esams.wmnet and upload.svc.esams.wmnet |
[production] |
| 17:31 |
<Ryan_Lane> |
removing bits-lb and upload-lb public ip enties, and adding bits.svc.pmtpa.wmnet and upload.svc.pmtpa.wmnet entries for https testing |
[production] |
| 16:46 |
<mark> |
Upgraded cr2-eqiad to JUNOS 10.4R4.5 |
[production] |
| 16:44 |
<mark> |
PIM configuration was missing on some virtual interfaces on csw1-sdtpa, which broke purging to esams. Put back in place |
[production] |
| 16:09 |
<mark> |
Reloading re1.cr2-eqiad |
[production] |
| 16:01 |
<mark> |
Fixed tunnel hack between pmtpa and eqiad |
[production] |
| 15:01 |
<RobH> |
db20 networking restarted, back online |
[production] |
| 12:05 |
<mark> |
Upgraded bootrom and software on asw-d1-sdtpa and asw-a5-sdtpa |
[production] |
| 10:53 |
<mark> |
Copied existing 2.7.0.2 image to secondary flash, and installed 2.7.0.3a image on primary flash on csw5-pmtpa |
[production] |
| 10:42 |
<mark> |
Copied existing 2.6.0 image to secondary flash, and installed 2.7.0.3a image on primary flash on csw1-sdtpa |
[production] |
| 04:20 |
<demon> |
synchronized php-1.17/extensions/GoogleNewsSitemap/GoogleNewsSitemap_body.php 'r88707' |
[production] |
| 04:03 |
<tstarling> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 04:03 |
<Tim> |
enabling GoogleNewsSitemap on enwikinews |
[production] |
|
2011-05-23
§
|
| 21:18 |
<Ryan_Lane> |
added upload-lb.pmtpa.wm.o and bits-lb.pmtpa.wm.o addresses to reverse dns for https preparation |
[production] |
| 19:32 |
<reedy> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'bug 29003' |
[production] |
| 18:45 |
<apergos> |
reloading puppet on all hosts, with a minute sleep in between, running in screen on fenari as root. needed for enabling pluginsync on clients |
[production] |
| 18:20 |
<Ryan_Lane> |
moved ipv6 proxy from iris to maerlant |
[production] |
| 17:35 |
<RobH> |
db20 back online, needs mysql setup for replication on another cluster. created rt#836 |
[production] |
| 17:29 |
<RobH> |
db20 was offline from earlier hardware issues that appear to have been resolved. it is in no current deployment group. booting it online to see if it requires reinstallation |
[production] |
| 14:31 |
<demon> |
synchronized php-1.17/extensions/GoogleNewsSitemap/SitemapFeed.php |
[production] |
| 14:31 |
<demon> |
synchronized php-1.17/extensions/GoogleNewsSitemap/FeedSMItem.php 'r88640' |
[production] |
| 14:30 |
<demon> |
synchronized php-1.17/extensions/GoogleNewsSitemap/GoogleNewsSitemap_body.php 'r88640' |
[production] |
| 14:23 |
<hcatlin> |
Deploying code update to Mobile wikipedia |
[production] |
| 05:08 |
<Tim> |
in watchmouse: updated subversion monitoring, was broken since May 7 |
[production] |