|
2016-01-16
§
|
| 15:22 |
<milimetric> |
restarted mysql on bohrium because it had stopped working (probably due to piwik performance problems) |
[production] |
| 09:12 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264448 |
[releng] |
| 09:01 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264446 and https://gerrit.wikimedia.org/r/264447 |
[releng] |
| 07:46 |
<legoktm> |
sudo -u jenkins-deploy mv /mnt/jenkins-workspace/workspace/mediawiki-core-phplint /mnt/jenkins-workspace/workspace/mediawiki-core-php53lint on all precise slaves |
[releng] |
| 07:17 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264444 |
[releng] |
| 06:31 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264441 |
[releng] |
| 06:10 |
<legoktm> |
added phpflavor-php53 label to all phpflavor-zend slaves |
[releng] |
| 04:50 |
<ircnotifier> |
legoktm: Deployed 9fde1aa8a06e27a8a08f5d2468cc5e00799dd43f Bump redis delay to 2 seconds to avoid flooding wb2-phab |
[tools.wikibugs] |
| 03:02 |
<l10nupdate@tin> |
l10nupdate@tin ResourceLoader cache refresh completed at Sat Jan 16 03:02:21 UTC 2016 (duration 6m 57s) |
[production] |
| 02:55 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 08m 35s) |
[production] |
| 02:35 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 18m 55s) |
[production] |
|
2016-01-15
§
|
| 22:43 |
<aaron@tin> |
aaron@tin Synchronized wmf-config/CommonSettings.php: Set $wgCentralAuthUseSlaves for testwiki (duration: 00m 33s) |
[production] |
| 22:38 |
<mutante> |
gadolinium - shutdown -h now |
[production] |
| 22:35 |
<mutante> |
erbium - killing from puppet/icinga/salt |
[production] |
| 21:54 |
<mutante> |
mira - starting salt |
[production] |
| 21:29 |
<mutante> |
protactinium - shut down, unused system with outdated software |
[production] |
| 21:28 |
<milimetric> |
importing db data to new prod server |
[wikimetrics] |
| 21:28 |
<milimetric> |
set up symlinks for static files on new prod server |
[wikimetrics] |
| 21:27 |
<milimetric> |
stopping old prod queue and scheduler |
[wikimetrics] |
| 21:09 |
<mutante> |
(ganglia for ulsfo will be affected, brb) |
[production] |
| 21:07 |
<mutante> |
bast4001 - reinstalling with jessie |
[production] |
| 18:54 |
<ori> |
disabled gzip in apache for javascript mime types and did an apache config reload |
[production] |
| 18:34 |
<chasemp> |
tools-mail-01 is locked up I am rebooting |
[tools] |
| 18:04 |
<ori@tin> |
ori@tin Synchronized docroot and w: Ie60638b0: Mirror homepage.js from 15.wikipedia.org (duration: 00m 42s) |
[production] |
| 16:01 |
<godog> |
bounce hhvm on mw1129 / mw1204 |
[production] |
| 15:41 |
<godog> |
reimage ms-be3001 with trusty |
[production] |
| 14:54 |
<godog> |
reimage ms-fe3002 with trusty |
[production] |
| 14:13 |
<mark> |
Temporarily paused md126 RAID check on labstore1001 (sync_action idle) |
[production] |
| 14:09 |
<chasemp> |
phab restart phd (reports as not running in phab itself) seems ok now |
[production] |
| 14:03 |
<mark> |
set sync_speed_min to 5000 for md126 on labstore1001 |
[production] |
| 13:28 |
<demon@tin> |
demon@tin Synchronized wmf-config/InitialiseSettings.php: w:he as import source for commonswiki (duration: 00m 49s) |
[production] |
| 12:17 |
<hashar> |
restarting Jenkins for plugins updates |
[production] |
| 12:17 |
<hashar> |
restarting Jenkins for plugins updates |
[releng] |
| 11:07 |
<_joe_> |
re-enabled puppet on mw1013, restarted HHVM to make it pick up our latest changes |
[production] |
| 10:01 |
<moritzm> |
installed ganeti security updates |
[production] |
| 09:18 |
<moritzm> |
installed git security updates on all jessie systems |
[production] |
| 03:10 |
<l10nupdate@tin> |
l10nupdate@tin ResourceLoader cache refresh completed at Fri Jan 15 03:10:09 UTC 2016 (duration 6m 48s) |
[production] |
| 03:03 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 16m 02s) |
[production] |
| 02:49 |
<bd808> |
Trying to fix submodules in deployment-bastion:/srv/mediawiki-staging/php-master/extensions for T123701 |
[releng] |
| 02:30 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryRecentChanges.php: https://gerrit.wikimedia.org/r/264231 (duration: 00m 42s) |
[production] |
| 02:29 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 14m 00s) |
[production] |
| 02:23 |
<YuviPanda> |
pull annualreport git repo on bromine for Krenair |
[production] |
| 02:20 |
<madhuvishy> |
Add rest of analytics team as wikimetrics project admins |
[wikimetrics] |
| 01:09 |
<madhuvishy> |
Found more config path issues for the scheduler. Fixed. All services are running on prod wikimetrics |
[wikimetrics] |
| 01:00 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryWatchlist.php: https://gerrit.wikimedia.org/r/#/c/264224/ (duration: 00m 31s) |
[production] |
| 00:53 |
<madhuvishy> |
Setup temporary proxy to metrics-prod.wmflabs.org. All good, web and queue are up, scheduler seems to be failing though |
[wikimetrics] |
| 00:49 |
<madhuvishy> |
Deploying to prod wikimetrics, which also restarts all services. So good so far |
[wikimetrics] |
| 00:47 |
<madhuvishy> |
Fixed some things in wikimetrics and wikimetrics-deploy for db creation and migration to work. Prod server initialize stage complete |
[wikimetrics] |
| 00:27 |
<krenair@tin> |
krenair@tin Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/263905/ (duration: 00m 32s) |
[production] |
| 00:24 |
<krenair@tin> |
krenair@tin Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 31s) |
[production] |