|
2011-10-22
§
|
| 17:45 |
<mark> |
storage1 rebooted, but didn't come back (probably iptables issue) |
[production] |
| 17:21 |
<mark> |
Moved storage1 to private subnet in SVN, and then reverted that change again |
[production] |
| 17:10 |
<mark> |
Running dist-upgrade on storage1 |
[production] |
| 17:03 |
<ben> |
synchronized wmf-config/db.php 'putting ms2 back in rotation after its reboot and RAID recovery' |
[production] |
| 16:41 |
<RobH> |
removed myself from nagios contacts and restarted nagios service, feels awesome. |
[production] |
| 16:34 |
<maplebed> |
copied mysql-at-facebook to ms2; it's now running that instead of the packaged version |
[production] |
| 16:19 |
<mark> |
ms2 back up |
[production] |
| 16:18 |
<mark> |
disk ata28 broken on ms2 |
[production] |
| 14:56 |
<maplebed> |
physically powercycling ms2; it's stuck at grub and the mgmt interface is unavailable. |
[production] |
| 04:02 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31862 - New logo for Tamil Wikibooks' |
[production] |
| 03:55 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31857 - Narayam for Odia Wiktionary' |
[production] |
| 02:21 |
<LocalisationUpdate> |
completed (1.18) at Sat Oct 22 02:24:14 UTC 2011 |
[production] |
| 02:15 |
<aaron> |
synchronized php-1.18/extensions/CheckUser 'pushed [[rev:100488|r100488]] code' |
[production] |
| 01:22 |
<ben> |
synchronized wmf-config/db.php 'taking ms2 out of rotation for a reboot - filesystem errors and an xfs kernel oops' |
[production] |
|
2011-10-21
§
|
| 22:11 |
<reedy> |
synchronized php-1.18/extensions/WikiLove/WikiLove.hooks.php '[[rev:100464|r100464]]' |
[production] |
| 20:14 |
<demon> |
synchronized php-1.18/extensions/Contest/includes/ContestContestant.php 'Push [[rev:100446|r100446]]. Shame on Reedy for deploying then going afk' |
[production] |
| 20:08 |
<Jeff_Green> |
taking payments4 out of pybal pool |
[production] |
| 19:36 |
<reedy> |
synchronizing Wikimedia installation... : Pushing [[rev:100440|r100440]] for contest |
[production] |
| 18:30 |
<mutante> |
powercycling snapshot3 - mgmt console just showed numbers !? |
[production] |
| 18:20 |
<mutante> |
snapshot3 - dist-upgrade/kernel,about to reboot... |
[production] |
| 18:06 |
<mutante> |
rebooting hume after dist-upgrade |
[production] |
| 15:58 |
<mutante> |
dataset2 - installed security upgrades/kernel, scheduled for reboot RT 1780 |
[production] |
| 15:44 |
<mutante> |
stafford - dist-upgrade/kernel,reboot |
[production] |
| 14:27 |
<mutante> |
hume - installed security updates but ask aaron for reboot (long running fixBug28348.php related process?) |
[production] |
| 14:06 |
<mutante> |
< Jeff_Green> alert: fundraising test is beginning |
[production] |
| 13:27 |
<mutante> |
srv285 - security updates,rebooting |
[production] |
| 13:01 |
<mutante> |
ekrem out of disk space (RT 1772), gzipped some apache logs, apache2 graceful,... |
[production] |
| 04:36 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Bug 31815 - Add rollbacker group for orwiki' |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.18) at Fri Oct 21 02:20:20 UTC 2011 |
[production] |
| 02:00 |
<reedy> |
synchronizing Wikimedia installation... : Pulling in [[rev:100403|r100403]] for contest |
[production] |
| 01:04 |
<Tim> |
on hume: made the files in /etc/cron.d/* not writable wikidev, since that allows privilege escalation from wikidev to root |
[production] |
|
2011-10-20
§
|
| 22:29 |
<reedy> |
synchronizing Wikimedia installation... : Checking all Contest code is up to date |
[production] |
| 22:04 |
<reedy> |
synchronized php-1.18/extensions/Contest/specials/SpecialContestant.php 'Temporary live hack to attempt to fix rating' |
[production] |
| 19:30 |
<aaron> |
synchronized wmf-config/flaggedrevs.php 'removed sysop autoreview settings that actually *are* redundant' |
[production] |
| 19:28 |
<aaron> |
synchronized wmf-config/flaggedrevs.php 'reverted [[rev:2520|r2520]]' |
[production] |
| 18:18 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php 'critical update to mobile frontend to support iPhone application' |
[production] |
| 18:05 |
<LeslieCarr> |
testing log abilities |
[production] |
| 17:57 |
<aaron> |
synchronized wmf-config/flaggedrevs.php 'removed redundant config' |
[production] |
| 17:48 |
<LeslieCarr> |
renamed ruthenium and rhodium to msfe1001 and msfe1002 and put onto public vlan |
[production] |
| 17:46 |
<reedy> |
synchronized php-1.18/extensions/Contest/includes/ContestContestant.php '[[rev:100355|r100355]]' |
[production] |
| 17:45 |
<reedy> |
synchronized php-1.18/extensions/Contest/includes/ContestantPager.php '[[rev:100355|r100355]]' |
[production] |
| 17:44 |
<reedy> |
synchronized php-1.18/extensions/Contest/specials/SpecialContest.php '[[rev:100355|r100355]]' |
[production] |
| 17:42 |
<aaron> |
synchronized wmf-config/flaggedrevs.php 'removed obsolete $wgFlaggedRevsReviewForDefault var' |
[production] |
| 17:35 |
<preilly> |
synchronized php-1.18/extensions/MobileFrontend/MobileFrontend.php 'critical update to mobile frontend to support iPhone application' |
[production] |
| 16:21 |
<aaron> |
synchronized wmf-config/flaggedrevs.php 'restored neverBlocked setting removed by mistake recently' |
[production] |
| 16:16 |
<mutante> |
bayes - installed security updates, need to ask ezachte for reboot, dont want to kill his perl/R procs |
[production] |
| 15:12 |
<mutante> |
knsq8,knsq9 - dist-upgrade/kernel,reboot |
[production] |
| 14:38 |
<cmjohnson1> |
nas1 - removing pcie cable and replacing |
[production] |
| 14:32 |
<mutante> |
knsq7 - dist-upgrade/kernel, reboot |
[production] |