|
2012-07-03
§
|
| 19:34 |
<asher> |
synchronized wmf-config/db.php 'lowering db36 weight' |
[production] |
| 19:31 |
<asher> |
synchronized wmf-config/db.php 're-add db36, db32 (low weight), es3 (innodb)' |
[production] |
| 19:15 |
<hashar> |
touched wmf-config/mwblocker.log |
[releng] |
| 19:05 |
<hashar> |
no machine send their syslog anywhere, some change got lost during the merge. See https://gerrit.wikimedia.org/r/14090 |
[releng] |
| 18:44 |
<hashar> |
Successfully deleted instance deployment-deb, but failed to remove deployment-deb DNS entry. ohno |
[releng] |
| 18:11 |
<RobH> |
virt1006 mgmt serial not set correctly, fixed |
[production] |
| 17:51 |
<RobH> |
investigating stat1001 power issue |
[production] |
| 17:22 |
<RobH> |
fluorine offlining to test disks |
[production] |
| 17:22 |
<RobH> |
pulling helium offline for disk testing with fluorine disks |
[production] |
| 17:10 |
<RobH> |
db1047 disk0 rebuild in progress |
[production] |
| 17:05 |
<RobH> |
replacing bad disk in db1047 |
[production] |
| 16:45 |
<reedy> |
synchronized wmf-config/ 'Various config changes' |
[production] |
| 16:31 |
<reedy> |
synchronized docroot/mediawiki/xml/export-0.7.xsd |
[production] |
| 16:15 |
<Jeff_Green> |
silicon gets dist-upgrade & reboot |
[production] |
| 16:15 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'wgCheckSerialized is deaded' |
[production] |
| 09:56 |
<hashar> |
Asked reboot for deployment-transcoding through labsconsole |
[releng] |
| 03:53 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 're-enable API action=purge on commonswiki' |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.20wmf6) at Tue Jul 3 02:27:02 UTC 2012 |
[production] |
|
2012-07-02
§
|
| 22:33 |
<binasher> |
rebooted db36 for kernel upgrade |
[production] |
| 22:25 |
<asher> |
synchronized wmf-config/db.php 'temp pulling db36' |
[production] |
| 22:03 |
<brion> |
fun with routers in tampa, wikis down |
[production] |
| 21:48 |
<maplebed> |
rebooted emery - it's been unresponsive for 3 days. |
[production] |
| 20:50 |
<hashar> |
restarting squid to purge whole cache (yeah I know that is lame) |
[releng] |
| 20:47 |
<hashar> |
Removed Hydriz from deployment-prep. Messed up the whole dblist files :-D Contact me! ;) |
[releng] |
| 20:46 |
<hashar> |
set back robots.txt to disallow / |
[releng] |
| 20:28 |
<hashar> |
deployed a hack in mw config using https://gerrit.wikimedia.org/r/#/c/13932/ . That is a simply git fetch, pending review. |
[releng] |
| 19:47 |
<hashar> |
hacking to get files on bits.beta |
[releng] |
| 18:34 |
<reedy> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 18:30 |
<hashar> |
set up ignore file in httpd configuration directory |
[production] |
| 18:23 |
<reedy> |
synchronized wmf-config/ 'Enable WikimediaShopLink on enwiki' |
[production] |
| 18:11 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: 273 wikipedias to 1.20wmf6 |
[production] |
| 18:03 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: enwiki to 1.20wmf6 |
[production] |
| 15:21 |
<hashar> |
synchronized wmf-config/CommonSettings.php '/etc/wikimedia-realm detection https://gerrit.wikimedia.org/r/13888' |
[production] |
| 15:18 |
<hashar> |
synchronized docroot/bits/static-master '([[bugzilla:37245|bug 37245]]) docroot 'static-master' for beta bits' |
[production] |
| 15:04 |
<mutante> |
authdns-update to switch jobs.wm redirect to wikimedia-lb to fix SSL cert mismatch (RT-3071) |
[production] |
| 14:55 |
<mark> |
Reboot of cr1-sdtpa did not fix the RE packet loss issue... therefore unlikely to be leap second related |
[production] |
| 14:41 |
<mark> |
Rebooting cr1-sdtpa |
[production] |
| 14:37 |
<mark> |
Shutdown PyBal BGP sessions on cr1-sdtpa |
[production] |
| 14:34 |
<mark> |
Shutdown BGP session to 2828 on cr1-sdtpa |
[production] |
| 13:36 |
<hashar> |
db12 suffering some 1400sec (and growing) replag. mysqldump in progress on that host. |
[production] |
| 12:35 |
<mutante> |
installing upgrades on fenari (linux-firmware linux-libc-dev..) |
[production] |
| 12:27 |
<mutante> |
rebooting gallium one more time to install kernel |
[production] |
| 12:26 |
<mutante> |
upgrading kernel on gallium |
[production] |
| 12:23 |
<hashar> |
synchronized live-1.5/CREDITS |
[production] |
| 11:31 |
<mark> |
Now we have packet loss within pmtpa/sdtpa... reverting change |
[production] |
| 10:57 |
<mark> |
Problems on one of two pmtpa-eqiad waves; raised OSPF metric to 60 to failover traffic to the other link |
[production] |
| 10:50 |
<Tim> |
fixing leap second issue on bastion1 by rebooting it |
[production] |
| 10:47 |
<Tim> |
fixed leap second issue on bastion-restricted |
[production] |
| 10:19 |
<hashar> |
Easy fix for the leap second bug: /etc/init.d/ntp stop; date `date +"%m%d%H%M%C%y.%S"`; /etc/init.d/ntp start |
[releng] |
| 10:06 |
<Hydriz> |
ukwiki was giving errors regarding flaggedrevs's flaggedpages table not existing. Fixed it by running mwscript update.php ukwiki. |
[releng] |