|
2016-01-16
§
|
| 18:55 |
<jzerebecki> |
reloadin zuul for 996c558..5f8eb50 |
[releng] |
| 15:57 |
<milimetric> |
piwik is taking events on bohrium but the interface can't complete the queries to load because there's too much data. Mysql is maxing the CPU but it seems ok for now, will check again Monday. |
[production] |
| 15:22 |
<milimetric> |
restarted mysql on bohrium because it had stopped working (probably due to piwik performance problems) |
[production] |
| 09:12 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264448 |
[releng] |
| 09:01 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264446 and https://gerrit.wikimedia.org/r/264447 |
[releng] |
| 07:46 |
<legoktm> |
sudo -u jenkins-deploy mv /mnt/jenkins-workspace/workspace/mediawiki-core-phplint /mnt/jenkins-workspace/workspace/mediawiki-core-php53lint on all precise slaves |
[releng] |
| 07:17 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264444 |
[releng] |
| 06:31 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264441 |
[releng] |
| 06:10 |
<legoktm> |
added phpflavor-php53 label to all phpflavor-zend slaves |
[releng] |
| 04:50 |
<ircnotifier> |
legoktm: Deployed 9fde1aa8a06e27a8a08f5d2468cc5e00799dd43f Bump redis delay to 2 seconds to avoid flooding wb2-phab |
[tools.wikibugs] |
| 03:02 |
<l10nupdate@tin> |
l10nupdate@tin ResourceLoader cache refresh completed at Sat Jan 16 03:02:21 UTC 2016 (duration 6m 57s) |
[production] |
| 02:55 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 08m 35s) |
[production] |
| 02:35 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 18m 55s) |
[production] |
|
2016-01-15
§
|
| 22:43 |
<aaron@tin> |
aaron@tin Synchronized wmf-config/CommonSettings.php: Set $wgCentralAuthUseSlaves for testwiki (duration: 00m 33s) |
[production] |
| 22:38 |
<mutante> |
gadolinium - shutdown -h now |
[production] |
| 22:35 |
<mutante> |
erbium - killing from puppet/icinga/salt |
[production] |
| 21:54 |
<mutante> |
mira - starting salt |
[production] |
| 21:29 |
<mutante> |
protactinium - shut down, unused system with outdated software |
[production] |
| 21:28 |
<milimetric> |
importing db data to new prod server |
[wikimetrics] |
| 21:28 |
<milimetric> |
set up symlinks for static files on new prod server |
[wikimetrics] |
| 21:27 |
<milimetric> |
stopping old prod queue and scheduler |
[wikimetrics] |
| 21:09 |
<mutante> |
(ganglia for ulsfo will be affected, brb) |
[production] |
| 21:07 |
<mutante> |
bast4001 - reinstalling with jessie |
[production] |
| 18:54 |
<ori> |
disabled gzip in apache for javascript mime types and did an apache config reload |
[production] |
| 18:34 |
<chasemp> |
tools-mail-01 is locked up I am rebooting |
[tools] |
| 18:04 |
<ori@tin> |
ori@tin Synchronized docroot and w: Ie60638b0: Mirror homepage.js from 15.wikipedia.org (duration: 00m 42s) |
[production] |
| 16:01 |
<godog> |
bounce hhvm on mw1129 / mw1204 |
[production] |
| 15:41 |
<godog> |
reimage ms-be3001 with trusty |
[production] |
| 14:54 |
<godog> |
reimage ms-fe3002 with trusty |
[production] |
| 14:13 |
<mark> |
Temporarily paused md126 RAID check on labstore1001 (sync_action idle) |
[production] |
| 14:09 |
<chasemp> |
phab restart phd (reports as not running in phab itself) seems ok now |
[production] |
| 14:03 |
<mark> |
set sync_speed_min to 5000 for md126 on labstore1001 |
[production] |
| 13:28 |
<demon@tin> |
demon@tin Synchronized wmf-config/InitialiseSettings.php: w:he as import source for commonswiki (duration: 00m 49s) |
[production] |
| 12:17 |
<hashar> |
restarting Jenkins for plugins updates |
[production] |
| 12:17 |
<hashar> |
restarting Jenkins for plugins updates |
[releng] |
| 11:07 |
<_joe_> |
re-enabled puppet on mw1013, restarted HHVM to make it pick up our latest changes |
[production] |
| 10:01 |
<moritzm> |
installed ganeti security updates |
[production] |
| 09:18 |
<moritzm> |
installed git security updates on all jessie systems |
[production] |
| 03:10 |
<l10nupdate@tin> |
l10nupdate@tin ResourceLoader cache refresh completed at Fri Jan 15 03:10:09 UTC 2016 (duration 6m 48s) |
[production] |
| 03:03 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 16m 02s) |
[production] |
| 02:49 |
<bd808> |
Trying to fix submodules in deployment-bastion:/srv/mediawiki-staging/php-master/extensions for T123701 |
[releng] |
| 02:30 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryRecentChanges.php: https://gerrit.wikimedia.org/r/264231 (duration: 00m 42s) |
[production] |
| 02:29 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 14m 00s) |
[production] |
| 02:23 |
<YuviPanda> |
pull annualreport git repo on bromine for Krenair |
[production] |
| 02:20 |
<madhuvishy> |
Add rest of analytics team as wikimetrics project admins |
[wikimetrics] |
| 01:09 |
<madhuvishy> |
Found more config path issues for the scheduler. Fixed. All services are running on prod wikimetrics |
[wikimetrics] |
| 01:00 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryWatchlist.php: https://gerrit.wikimedia.org/r/#/c/264224/ (duration: 00m 31s) |
[production] |
| 00:53 |
<madhuvishy> |
Setup temporary proxy to metrics-prod.wmflabs.org. All good, web and queue are up, scheduler seems to be failing though |
[wikimetrics] |
| 00:49 |
<madhuvishy> |
Deploying to prod wikimetrics, which also restarts all services. So good so far |
[wikimetrics] |
| 00:47 |
<madhuvishy> |
Fixed some things in wikimetrics and wikimetrics-deploy for db creation and migration to work. Prod server initialize stage complete |
[wikimetrics] |