|
2017-07-20
§
|
| 18:16 |
<thcipriani@tin> |
Synchronized static/images/project-logos: SWAT: [[gerrit:366545|Fix hywiki big and medium logos]] (duration: 00m 47s) |
[production] |
| 17:54 |
<arlolra> |
Updated Parsoid to a89a9cc4 (T169293) |
[production] |
| 17:48 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@97dbabb]: Updating Parsoid to a89a9cc4 (duration: 09m 09s) |
[production] |
| 17:39 |
<arlolra@tin> |
Started deploy [parsoid/deploy@97dbabb]: Updating Parsoid to a89a9cc4 |
[production] |
| 17:16 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: wikidata back to wmf.10 |
[production] |
| 17:14 |
<ottomata> |
killed tranquility instances tranq-banners and tranq-netflow running on druid1003 in joal's screen sessions |
[production] |
| 17:14 |
<ottomata> |
killed tranquility instances tranq-banners and tranq-netflow running on druid1003 in joal's screen sessions |
[analytics] |
| 16:42 |
<hashar> |
How to fix ssh access on beta cluster instances: https://phabricator.wikimedia.org/T171174#3456966 |
[releng] |
| 15:30 |
<hashar> |
deployment-prep : removing project wide puppet classes from https://horizon.wikimedia.org/project/puppet/ All are role::eventlogging::analytics::* |
[releng] |
| 15:08 |
<hashar> |
removed profile::recommendation_api from deployment-sca01 to try to fix the ssh access for mobrovac T171173 T171174 |
[releng] |
| 14:57 |
<zeljkof> |
reloading Zuul to deploy 80b9d85 |
[releng] |
| 14:41 |
<godog> |
upload diamond 4.0.515-4~bpo8+2 to jessie-wikimedia - T97635 |
[production] |
| 14:33 |
<ema@neodymium> |
conftool action : set/pooled=yes; selector: name=acamar.wikimedia.org |
[production] |
| 14:31 |
<ema@neodymium> |
conftool action : set/pooled=no; selector: name=acamar.wikimedia.org |
[production] |
| 14:31 |
<hashar> |
deployment-prep: manually cleaned out the puppet master configuration. It was all screwed up. Notably I removed bits about the puppetdb |
[releng] |
| 14:23 |
<godog> |
upload diamond 4.0.515-4~bpo8+1 to jessie-wikimedia - T97635 |
[production] |
| 14:10 |
<andrewbogott> |
upgrading apache on labs via "dpkg -s apache2 && apt-get -y install apache2" |
[production] |
| 14:07 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@5aa7bc1]: Translation API bug fix (duration: 07m 58s) |
[production] |
| 14:00 |
<godog> |
test diamond 4.0.515-4~bpo8+1 on cp1008 |
[production] |
| 13:59 |
<mobrovac@tin> |
Started deploy [restbase/deploy@5aa7bc1]: Translation API bug fix |
[production] |
| 13:59 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@5aa7bc1] (staging): (no justification provided) (duration: 01m 31s) |
[production] |
| 13:57 |
<mobrovac@tin> |
Started deploy [restbase/deploy@5aa7bc1] (staging): (no justification provided) |
[production] |
| 13:54 |
<andrewbogott> |
upgrading apache2 on tools-puppetmaster-01 |
[tools] |
| 13:52 |
<moritzm> |
uprading nodejs on wtp* |
[production] |
| 13:42 |
<ema> |
cp1050 stuck at 'Initializing firmware interfaces...', trying to powerdown/powerup |
[production] |
| 13:37 |
<zeljkof> |
EU SWAT finished |
[production] |
| 13:29 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:366546|Revert "Revert "Stop RelatedArticles A/B test and clean up config"" (T169948)]] (duration: 00m 46s) |
[production] |
| 13:29 |
<cmjohnson1> |
downtimed restbase-dev100[1-3] to power off and move ssds to newly racked restbase-dev100[4-6] phab task: T166181 |
[production] |
| 13:29 |
<ema> |
cp1050 stuck rebooting, power-cycling |
[production] |
| 13:28 |
<zfilipin@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:366546|Revert "Revert "Stop RelatedArticles A/B test and clean up config"" (T169948)]] (duration: 00m 47s) |
[production] |
| 13:12 |
<zfilipin@tin> |
Synchronized wmf-config/throttle.php: SWAT: [[gerrit:366529|Add new throttle rule (T171146)]] (duration: 00m 48s) |
[production] |
| 12:58 |
<ema@neodymium> |
conftool action : set/pooled=yes; selector: name=acamar.wikimedia.org |
[production] |
| 12:55 |
<ema@neodymium> |
conftool action : set/pooled=no; selector: name=acamar.wikimedia.org |
[production] |
| 12:37 |
<ema@neodymium> |
conftool action : set/pooled=yes; selector: name=acamar.wikimedia.org |
[production] |
| 12:25 |
<ema@neodymium> |
conftool action : set/pooled=no; selector: name=acamar.wikimedia.org |
[production] |
| 10:20 |
<zeljkof> |
Reloading Zuul to deploy 80b9d855443a2f572d877b280783110684344c5d |
[releng] |
| 09:17 |
<hashar> |
Spawning and pooling integration-slave-docker-1003 as replacement to integration-slave-docker-1000 (broken) - T150502 |
[releng] |
| 09:04 |
<ema> |
eqiad cache_text/upload: upgrade to varnish 4.1.7-1wm1 and reboot for kernel updates |
[production] |
| 09:04 |
<hashar> |
Restored CI cache storage (castor) on a fresh new instance. Cache is empty though so jobs will be a bit slower until the cache is populated - T171148 |
[production] |
| 09:03 |
<hashar> |
Restoring castorby updating all jobs to point to castor02 ( https://gerrit.wikimedia.org/r/366524 ) Starts with a cold cache :( - T171148 |
[releng] |
| 09:02 |
<moritzm> |
uploaded apache2 2.4.10-10+deb8u10+wmf1 (rebase of WMF-specific patches on top of latest DSA) to apt.wikimedia.org/jessie |
[production] |
| 08:53 |
<hashar> |
Created castor02.integration.eqiad.wmflabs with puppet role role::ci::castor::server and adding it to Jenkins. Will then update the Jenkins jobs to point to it - T171148 |
[releng] |
| 08:34 |
<marostegui> |
Force a BBU relearn on db1016 - T166344 |
[production] |
| 08:29 |
<ema@neodymium> |
conftool action : set/pooled=yes; selector: name=cp3048.esams.wmnet |
[production] |
| 08:25 |
<hashar> |
CI is restored albeit in degraded mode (lack of Castor cache) - T171148 |
[production] |
| 08:01 |
<marostegui> |
Stop replication on labsdb1011 for maintenance - T153743 |
[production] |
| 08:00 |
<hashar> |
Disabled castor entirely via https://gerrit.wikimedia.org/r/366520 . The instance is broken - T171148 |
[releng] |
| 07:55 |
<marostegui> |
Start importing s2 into labsdb1011 - T153743 |
[production] |
| 07:55 |
<hashar> |
Refreshing all Jenkins jobs defined in JJB in order to then disable castor entirely for T171148 |
[releng] |
| 07:48 |
<godog> |
restart diamond on serpens/seaborgium to pick up the updated CA |
[production] |