|
2012-03-02
§
|
| 16:55 |
<RobH> |
ms-be4 boot order fixed, fixing ms-be5 & ms-be2 |
[production] |
| 16:49 |
<RobH> |
fixed boot order on ms-be3, fixing ms-be4 |
[production] |
| 16:33 |
<RobH> |
poking at bios on ms-be3 |
[production] |
| 16:06 |
<RobH> |
wikitech outage resolved |
[production] |
| 15:20 |
<RobH> |
shutdown frdev offsite vm per email to engineering last week |
[production] |
| 15:19 |
<RobH> |
backing up wikitech in hopes of upgrading some of its software |
[production] |
| 08:36 |
<apergos> |
on ms1004, low on space, HTCPpurger.log.1 had about 16 gb of nulls before any real content, I tailed off the real stuff and tossed the original. The current log file has the same problem, why? |
[production] |
| 02:34 |
<LocalisationUpdate> |
completed (1.18) at Fri Mar 2 02:34:34 UTC 2012 |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.19) at Fri Mar 2 02:17:51 UTC 2012 |
[production] |
| 01:36 |
<aaron> |
synchronized php-1.19/includes/filerepo/backend/lockmanager/LockManager.php 'deployed [[rev:112867|r112867]]' |
[production] |
| 00:41 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree 'deployed [[rev:112862|r112862]]' |
[production] |
|
2012-03-01
§
|
| 23:33 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'log agent' |
[production] |
| 23:29 |
<reedy> |
synchronizing Wikimedia installation... : Push message updates from [[rev:112848|r112848]] |
[production] |
| 23:23 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'logging fix' |
[production] |
| 23:22 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:20 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:17 |
<reedy> |
synchronized php-1.19/includes/filerepo/backend/FSFileBackend.php '[[rev:112850|r112850]]' |
[production] |
| 23:16 |
<reedy> |
synchronized php-1.19/includes/Article.php '[[rev:112850|r112850]]' |
[production] |
| 23:11 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php |
[production] |
| 23:06 |
<reedy> |
synchronized php-1.19/extensions/MoodBar/ApiFeedbackDashboardResponse.php '[[rev:112848|r112848]]' |
[production] |
| 23:05 |
<reedy> |
synchronized php-1.19/extensions/Collection/Collection.body.php '[[rev:112848|r112848]]' |
[production] |
| 22:12 |
<aaron> |
synchronized php-1.19/includes/specials/SpecialContributions.php 'deployed [[rev:112844|r112844]]' |
[production] |
| 22:06 |
<aaron> |
synchronized php-1.19/includes/filerepo/backend 'deployed [[rev:112841|r112841]]' |
[production] |
| 21:04 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'enabled FileBackend debug log' |
[production] |
| 19:58 |
<cmjohnson1> |
replaced disk 3 labstore1 chassis |
[production] |
| 19:54 |
<cmjohnson1> |
removing disk 3 from labstore1 chassis |
[production] |
| 19:47 |
<Ryan_Lane> |
restarted memcached on virt0 |
[production] |
| 19:15 |
<reedy> |
synchronized php-1.19/cache/interwiki.cdb 'Updating interwiki cache' |
[production] |
| 17:39 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db25, db32, db33, db37 |
[production] |
| 17:36 |
<hashar> |
synchronized php-1.19/includes/EditPage.php '[[rev:112819|r112819]] - Bug 34849 diff during editing an old version compares to the old version instead of the current one' |
[production] |
| 17:36 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db13 |
[production] |
| 17:35 |
<Jeff_Green> |
Removed >5GB /tmp/gmond.log on db11 |
[production] |
| 17:25 |
<Jeff_Green> |
Removed 5.3GB /tmp/gmond.log on db1018 |
[production] |
| 17:24 |
<Jeff_Green> |
Removed 5.3GB /tmp/gmond.log on db1017 |
[production] |
| 17:13 |
<Jeff_Green> |
Removed 4.8GB /tmp/gmond.log on db1008. Tried to resist urge to make snarky comment about ganglia but failed. |
[production] |
| 14:54 |
<RobH> |
strontium server rebooting to set HT to enabled |
[production] |
| 14:26 |
<mark> |
Moving bits traffic back from pmtpa to eqiad |
[production] |
| 14:24 |
<mark> |
Cleared dnsmasq cache on virt2 |
[production] |
| 14:16 |
<mark> |
csw5-pmtpa: Mar 1 14:01:42:A:Power Supply 2 , 2nd from left, bad |
[production] |
| 14:14 |
<mark> |
mr1-pmtpa rebooted/lost power for some reason |
[production] |
| 14:07 |
<mark> |
pmtpa/sdtpa management network went down |
[production] |
| 13:54 |
<mark> |
Pooled new eqiad bits servers strontium and palladium |
[production] |
| 12:45 |
<hashar> |
synchronized php-1.19/includes/specials/SpecialWatchlist.php '[[rev:111882|r111882]] for Bug 34835 - watchlist shows times in UTC' |
[production] |
| 10:53 |
<tstarling> |
rebuilt wikiversions.cdb and synchronized wikiversions files: reverting sr* wikis back to 1.18 per Siebrand's recommendation due to [[bugzilla:34832|bug 34832]] |
[production] |
| 06:26 |
<tstarling> |
synchronized php-1.19/extensions/SpamBlacklist/SpamBlacklist.php '[[rev:112781|r112781]]' |
[production] |
| 05:46 |
<maplebed> |
started swift deletion run on owa1, 2, and 3. |
[production] |
| 02:33 |
<LocalisationUpdate> |
completed (1.18) at Thu Mar 1 02:33:53 UTC 2012 |
[production] |
| 02:16 |
<LocalisationUpdate> |
completed (1.19) at Thu Mar 1 02:16:52 UTC 2012 |
[production] |
| 02:15 |
<Ryan_Lane> |
vlan tagged virt5's eth0 and eth1 ports on csw1-sdtpa |
[production] |
| 02:12 |
<aaron> |
synchronized php-1.19/extensions/CategoryTree/CategoryTreeFunctions.php 'debug logging' |
[production] |