|
2012-03-15
§
|
| 19:00 |
<RobH> |
db1022 resetup and redeployed per rt 2537 and assigned back to asher |
[production] |
| 18:51 |
<reedy> |
synchronizing Wikimedia installation... : Running scap to deal with message changes earlier |
[production] |
| 18:19 |
<RobH> |
db1022 coming down for reinstall and resetup of raid per rt 2537 |
[production] |
| 17:55 |
<reedy> |
synchronized php-1.19/extensions/CentralAuth/ '[[rev:113940|r113940]]' |
[production] |
| 17:54 |
<reedy> |
synchronized php-1.19/extensions/CheckUser/ '[[rev:113940|r113940]]' |
[production] |
| 17:53 |
<reedy> |
synchronized php-1.19/extensions/wikihiero/modules/ext.wikihiero.css '[[rev:113940|r113940]]' |
[production] |
| 17:52 |
<reedy> |
synchronized php-1.19/extensions/NewUserMessage/NewUserMessage.class.php '[[rev:113940|r113940]]' |
[production] |
| 17:41 |
<reedy> |
synchronized php-1.19/includes/RecentChange.php '[[rev:113938|r113938]]' |
[production] |
| 17:38 |
<reedy> |
synchronized php-1.19/resources/mediawiki/mediawiki.util.js '[[rev:113936|r113936]]' |
[production] |
| 17:37 |
<reedy> |
synchronized php-1.19/includes/specials/SpecialUndelete.php '[[rev:113936|r113936]]' |
[production] |
| 17:32 |
<reedy> |
synchronized php-1.19/languages/messages/ '[[rev:113935|r113935]]' |
[production] |
| 17:31 |
<reedy> |
synchronized php-1.19/resources/ '[[rev:113935|r113935]]' |
[production] |
| 17:31 |
<reedy> |
synchronized php-1.19/includes/ '[[rev:113935|r113935]]' |
[production] |
| 17:16 |
<reedy> |
synchronized php-1.19/includes/SkinTemplate.php '[[rev:113932|r113932]]' |
[production] |
| 16:13 |
<reedy> |
synchronized php-1.19/extensions/WikimediaMaintenance/cleanupBug31576.php '[[rev:113929|r113929]]' |
[production] |
| 15:15 |
<mark> |
Created git repo operations/debs/varnish in gerrit |
[production] |
| 14:06 |
<apergos> |
disabled moodbar temporarily on en wikii, see [[bugzilla:35245|bug 35245]] |
[production] |
| 14:02 |
<ariel> |
synchronized wmf-config/InitialiseSettings.php 'emergency disable of feedback dashboard (right config var this time?)' |
[production] |
| 13:51 |
<ariel> |
synchronized wmf-config/InitialiseSettings.php 'emergency disable of feedback dashboard' |
[production] |
| 13:11 |
<apergos> |
on screen as root on dataset1001, copying to gluster volume; if this causes problems feel free to shoot it. ( cp -a 20120211 /mnt/glusterpublicdata/public/enwiki/ ) |
[production] |
| 09:08 |
<mutante> |
ran puppet on mw102 |
[production] |
| 08:12 |
<mutante> |
installing apache,apt,cron,mysql-client upgrades on spence |
[production] |
| 07:01 |
<mutante> |
uprading apache and apt on hume |
[production] |
| 02:17 |
<LocalisationUpdate> |
completed (1.19) at Thu Mar 15 02:17:35 UTC 2012 |
[production] |
| 01:26 |
<Ryan_Lane> |
labsconsole was missing libapache2-mod-php5. puppet must have tried to upgrade a package unsuccessfully |
[production] |
| 01:22 |
<mutante> |
planet back up (installed libapache2-mod-php5 which installed apache2-mpm-prefork and removed apache2-mpm-worker) |
[production] |
| 01:19 |
<mutante> |
planet down - apache on singer, syntax error in site config "Invalid command 'php_admin_flag'" |
[production] |
| 01:03 |
<mutante> |
fixing nrpe "unable to read output" raid check on srv197,207,243,,244,253.. (nrpe running as wrong user) |
[production] |
|
2012-03-14
§
|
| 23:16 |
<maplebed> |
installed the swiftcleaner to run daily from iron. see root's crontab for more info. |
[production] |
| 20:41 |
<binasher> |
disabled log_queries_not_using_indexes on all core dbs |
[production] |
| 20:33 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing header for image support debugging' |
[production] |
| 20:30 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing header for image support debugging' |
[production] |
| 19:29 |
<maplebed> |
rebooting ms-be1 to enable hyperthreading (and make it the same as all the other ms-be hosts) |
[production] |
| 19:06 |
<preilly> |
pushing x-images header for vary support |
[production] |
| 19:06 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing header for image support debugging' |
[production] |
| 19:05 |
<preilly> |
synchronized php-1.19/extensions/MobileFrontend/MobileFrontend.body.php 'zero needs to add x-images to vary header' |
[production] |
| 18:58 |
<maplebed> |
ms-be5 is back in rotatino |
[production] |
| 18:31 |
<preilly> |
push zero change for carrier testing |
[production] |
| 18:31 |
<preilly> |
synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php 'changes for zero needed for carrier testing' |
[production] |
| 16:19 |
<RobH> |
updating dns for new domain wikimediacommons.pt (nameservers not yet pointed at us) |
[production] |
| 16:04 |
<reedy> |
synchronized wmf-config/CommonSettings.php 'add vcs for extdist updates' |
[production] |
| 13:03 |
<RobH> |
cp1029-cp1035 all installed and ready for varnish deployment, puppet has been run |
[production] |
| 08:24 |
<mutante> |
running "apt-get -f install" on snapshot3 to fix dpkg, which installed mysql-client- and client-core-5.1 |
[production] |
| 08:02 |
<mutante> |
stop/start memcached on srv254,srv255,srv257 |
[production] |
| 07:51 |
<mutante> |
restarting mecached on marmontel |
[production] |
| 07:51 |
<mutante> |
fixing owa[1-3] Swift HTTP commands manually |
[production] |
| 03:44 |
<mutante> |
ekrem - user agent "AppleDictionaryService" requests cause temp. WAP outage ..it seems |
[production] |
| 03:38 |
<mutante> |
free some disk space on spence - deleted user.log.1 on spence, compressing messages.1, apt-get clean,... |
[production] |
| 02:52 |
<RobH> |
cp1032-cp1035 reinstall issue wiped mbr causing issues, will reinstall in my AM |
[production] |
| 02:49 |
<RobH> |
revoked, cp1032 is some reason in grub error, and its too late at night for me to work on it, will troubleshoot tomorrow |
[production] |