|
2016-01-15
§
|
| 09:18 |
<moritzm> |
installed git security updates on all jessie systems |
[production] |
| 03:10 |
<l10nupdate@tin> |
l10nupdate@tin ResourceLoader cache refresh completed at Fri Jan 15 03:10:09 UTC 2016 (duration 6m 48s) |
[production] |
| 03:03 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.10) (duration: 16m 02s) |
[production] |
| 02:49 |
<bd808> |
Trying to fix submodules in deployment-bastion:/srv/mediawiki-staging/php-master/extensions for T123701 |
[releng] |
| 02:30 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryRecentChanges.php: https://gerrit.wikimedia.org/r/264231 (duration: 00m 42s) |
[production] |
| 02:29 |
<mwdeploy@tin> |
mwdeploy@tin sync-l10n completed (1.27.0-wmf.9) (duration: 14m 00s) |
[production] |
| 02:23 |
<YuviPanda> |
pull annualreport git repo on bromine for Krenair |
[production] |
| 02:20 |
<madhuvishy> |
Add rest of analytics team as wikimetrics project admins |
[wikimetrics] |
| 01:09 |
<madhuvishy> |
Found more config path issues for the scheduler. Fixed. All services are running on prod wikimetrics |
[wikimetrics] |
| 01:00 |
<krenair@tin> |
krenair@tin Synchronized php-1.27.0-wmf.10/includes/api/ApiQueryWatchlist.php: https://gerrit.wikimedia.org/r/#/c/264224/ (duration: 00m 31s) |
[production] |
| 00:53 |
<madhuvishy> |
Setup temporary proxy to metrics-prod.wmflabs.org. All good, web and queue are up, scheduler seems to be failing though |
[wikimetrics] |
| 00:49 |
<madhuvishy> |
Deploying to prod wikimetrics, which also restarts all services. So good so far |
[wikimetrics] |
| 00:47 |
<madhuvishy> |
Fixed some things in wikimetrics and wikimetrics-deploy for db creation and migration to work. Prod server initialize stage complete |
[wikimetrics] |
| 00:27 |
<krenair@tin> |
krenair@tin Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/263905/ (duration: 00m 32s) |
[production] |
| 00:24 |
<krenair@tin> |
krenair@tin Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 31s) |
[production] |
| 00:22 |
<krenair@tin> |
krenair@tin Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/264091/ (duration: 00m 32s) |
[production] |
| 00:06 |
<mobrovac> |
restbase started a dump of enwiki to populate storage with mobileapps renders |
[production] |
|
2016-01-14
§
|
| 23:56 |
<mobrovac> |
restbase end deploy of dac31a8c |
[production] |
| 23:49 |
<mobrovac> |
restbase start deploy of dac31a8c |
[production] |
| 23:35 |
<madhuvishy> |
Tried setting up prod server - figured mysql-client missing on prod - added to puppet |
[wikimetrics] |
| 23:26 |
<madhuvishy> |
Add role::wikimetrics(prod role), rerun puppet |
[wikimetrics] |
| 23:25 |
<madhuvishy> |
Make new prod instance wikimetrics-01.wikimetrics, force puppet run |
[wikimetrics] |
| 23:11 |
<madhuvishy> |
ran into some path issues - fixed in source - redeploying |
[wikimetrics] |
| 22:47 |
<madhuvishy> |
Last step: fab staging restart_wikimetrics, setup proxy again - and something is wrong |
[wikimetrics] |
| 22:38 |
<madhuvishy> |
Deployment step 2: Ran fab staging deploy - good again |
[wikimetrics] |
| 22:36 |
<madhuvishy> |
Deployment step 1: Ran fab staging initialize_server - all good |
[wikimetrics] |
| 22:35 |
<madhuvishy> |
Recreated wikimetrics-staging, force puppet run |
[wikimetrics] |
| 22:33 |
<madhuvishy> |
Recreated wikimetrics-staging, force puppet run |
[wikimetrics] |
| 22:30 |
<madhuvishy> |
Taking down wikimetrics-staging.wikimetrics to replace with non self hosted instance |
[wikimetrics] |
| 22:29 |
<YuviPanda> |
wikimetrics <whatever> |
[analytics] |
| 22:17 |
<csteipp> |
deployed patch for T122807 |
[production] |
| 20:06 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264122 |
[releng] |
| 19:55 |
<ottomata> |
restarted eventlogging_sync script to insert batches of 1000 |
[analytics] |
| 19:55 |
<ottomata> |
restarted eventlogging_sync script to insert batches of 1000 |
[production] |
| 19:50 |
<YuviPanda> |
add moritzm to project as projectadmin |
[ores] |
| 19:32 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264114 |
[releng] |
| 19:31 |
<dduvall@tin> |
dduvall@tin rebuilt wikiversions.php and synchronized wikiversions files: rollback labswiki to wmf.9 |
[production] |
| 19:18 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/264108 |
[releng] |
| 19:02 |
<dduvall@tin> |
dduvall@tin rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.27.0-wmf.10 |
[production] |
| 18:40 |
<bblack> |
removing old eqiad misc-web IP (DNS switched 50h ago (not 26 like above), TTLs are max 1h) |
[production] |
| 18:39 |
<bblack> |
removing old eqiad misc-web IP (DNS switched 26h ago, TTLs are max 1h) |
[production] |
| 18:01 |
<paravoid> |
turning up BGP with Zayo in eqiad |
[production] |
| 16:25 |
<demon@tin> |
demon@tin Synchronized wmf-config/throttle.php: (no message) (duration: 00m 49s) |
[production] |
| 15:48 |
<moritzm> |
installed DHCP security updates across the fleet |
[production] |
| 15:34 |
<halfak> |
deployed 4c643e8 with wikilabels:79b0cad |
[wikilabels] |
| 14:44 |
<_joe_> |
powercycling mw1013, console stuck |
[production] |
| 11:28 |
<godog> |
bounce uwsgi on labmon1001 |
[production] |
| 11:18 |
<godog> |
upgrade graphite-carbon / graphite-web on labmon1001 |
[production] |
| 10:38 |
<_joe_> |
restarting hhvm on odd-numbered jobrunners |
[production] |
| 10:29 |
<moritzm> |
installed DHCP security updates on carbon |
[production] |