|
2012-03-02
§
|
| 21:41 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'disabled logging hack' |
[production] |
| 20:47 |
<Jeff_Green> |
added redirect/301 from http://static.wikimedia.org --> http://dumps.wikimedia.org now that archival static html dumps are located there |
[production] |
| 19:53 |
<mark> |
Decommissioned csw5-pmtpa from AS14907 service. rest in pieces ;) |
[production] |
| 19:10 |
<mark> |
Did a hot cut to remove csw5-pmtpa out of the path of cr1-sdtpa -> csw1-sdtpa -> csw5-pmtpa -> cr2-pmtpa |
[production] |
| 17:46 |
<cmjohnson1> |
powering down msw1-pmtpa for relcocation to d1-pmtpa |
[production] |
| 17:40 |
<cmjohnson1> |
disconnecting management fiber from msw1-pmtpa |
[production] |
| 16:59 |
<reedy> |
synchronized php-1.19/extensions/CentralAuth/CentralAuth.php '[[rev:112904|r112904]]' |
[production] |
| 16:55 |
<RobH> |
ms-be4 boot order fixed, fixing ms-be5 & ms-be2 |
[production] |
| 16:49 |
<RobH> |
fixed boot order on ms-be3, fixing ms-be4 |
[production] |
| 16:33 |
<RobH> |
poking at bios on ms-be3 |
[production] |
| 16:06 |
<RobH> |
wikitech outage resolved |
[production] |
| 15:20 |
<RobH> |
shutdown frdev offsite vm per email to engineering last week |
[production] |
| 15:19 |
<RobH> |
backing up wikitech in hopes of upgrading some of its software |
[production] |
| 08:36 |
<apergos> |
on ms1004, low on space, HTCPpurger.log.1 had about 16 gb of nulls before any real content, I tailed off the real stuff and tossed the original. The current log file has the same problem, why? |
[production] |
| 02:34 |
<LocalisationUpdate> |
completed (1.18) at Fri Mar 2 02:34:34 UTC 2012 |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.19) at Fri Mar 2 02:17:51 UTC 2012 |
[production] |
| 01:36 |
<aaron> |
synchronized php-1.19/includes/filerepo/backend/lockmanager/LockManager.php 'deployed [[rev:112867|r112867]]' |
[production] |
| 00:41 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree 'deployed [[rev:112862|r112862]]' |
[production] |
|
2012-03-01
§
|
| 23:33 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'log agent' |
[production] |
| 23:29 |
<reedy> |
synchronizing Wikimedia installation... : Push message updates from [[rev:112848|r112848]] |
[production] |
| 23:23 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'logging fix' |
[production] |
| 23:22 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:20 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:17 |
<reedy> |
synchronized php-1.19/includes/filerepo/backend/FSFileBackend.php '[[rev:112850|r112850]]' |
[production] |
| 23:16 |
<reedy> |
synchronized php-1.19/includes/Article.php '[[rev:112850|r112850]]' |
[production] |
| 23:11 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:06 |
<reedy> |
synchronized php-1.19/extensions/MoodBar/ApiFeedbackDashboardResponse.php '[[rev:112848|r112848]]' |
[production] |
| 23:05 |
<reedy> |
synchronized php-1.19/extensions/Collection/Collection.body.php '[[rev:112848|r112848]]' |
[production] |
| 22:12 |
<aaron> |
synchronized php-1.19/includes/specials/SpecialContributions.php 'deployed [[rev:112844|r112844]]' |
[production] |
| 22:06 |
<aaron> |
synchronized php-1.19/includes/filerepo/backend 'deployed [[rev:112841|r112841]]' |
[production] |
| 21:04 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'enabled FileBackend debug log' |
[production] |
| 19:58 |
<cmjohnson1> |
replaced disk 3 labstore1 chassis |
[production] |
| 19:54 |
<cmjohnson1> |
removing disk 3 from labstore1 chassis |
[production] |
| 19:47 |
<Ryan_Lane> |
restarted memcached on virt0 |
[production] |
| 19:15 |
<reedy> |
synchronized php-1.19/cache/interwiki.cdb 'Updating interwiki cache' |
[production] |
| 17:39 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db25, db32, db33, db37 |
[production] |
| 17:36 |
<hashar> |
synchronized php-1.19/includes/EditPage.php '[[rev:112819|r112819]] - Bug 34849 diff during editing an old version compares to the old version instead of the current one' |
[production] |
| 17:36 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db13 |
[production] |
| 17:35 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db11 |
[production] |
| 17:25 |
<Jeff_Green> |
Removed 5.3GB /tmp/gmond.log on db1018 |
[production] |
| 17:24 |
<Jeff_Green> |
Removed 5.3GB /tmp/gmond.log on db1017 |
[production] |
| 17:13 |
<Jeff_Green> |
Removed 4.8GB /tmp/gmond.log on db1008. Tried to resist urge to make snarky comment about ganglia but failed. |
[production] |
| 14:54 |
<RobH> |
strontium server rebooting to set HT to enabled |
[production] |
| 14:26 |
<mark> |
Moving bits traffic back from pmtpa to eqiad |
[production] |
| 14:24 |
<mark> |
Cleared dnsmasq cache on virt2 |
[production] |
| 14:16 |
<mark> |
csw5-pmtpa: Mar 1 14:01:42:A:Power Supply 2 , 2nd from left, bad |
[production] |
| 14:14 |
<mark> |
mr1-pmtpa rebooted/lost power for some reason |
[production] |
| 14:07 |
<mark> |
pmtpa/sdtpa management network went down |
[production] |
| 13:54 |
<mark> |
Pooled new eqiad bits servers strontium and palladium |
[production] |