2017-08-02
ยง
|
17:26 |
<mobrovac@tin> |
Finished deploy [recommendation-api/deploy@8dfae34]: (no justification provided) (duration: 01m 36s) |
[production] |
17:25 |
<mobrovac@tin> |
Started deploy [recommendation-api/deploy@8dfae34]: (no justification provided) |
[production] |
17:18 |
<herron> |
installed libmail-spf-perl and restarted spamassassin service on mx[1,2]001 - T172299 |
[production] |
17:02 |
<bd808> |
Deleted a large number of mail.tools.drtrigonbot jobs stuck in 'qw' state for months |
[tools.drtrigonbot] |
16:59 |
<bd808> |
Force deleted 6 jobs suck in 'dr' state |
[tools] |
16:45 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(24|25|26|27).eqiad.wmnet |
[production] |
16:43 |
<gehel> |
depooling and shutting down elastic102[4567] - T168816 |
[production] |
16:27 |
<bd808> |
Deleted a bunch of flyt_overs and slet_overs jobs that looked stuck (running for >24 hours) |
[tools.dawikitool] |
15:41 |
<bd808> |
Killed 30+ overlapping mix-n-match-microsync jobs that seemed stuck |
[tools.mix-n-match] |
15:34 |
<mobrovac@tin> |
Finished deploy [cxserver/deploy@cf3e280]: (no justification provided) (duration: 00m 22s) |
[production] |
15:34 |
<mobrovac@tin> |
Started deploy [cxserver/deploy@cf3e280]: (no justification provided) |
[production] |
15:20 |
<paladox> |
disabling puppet on gerrit-mysql temp for icinga2 update (changed configuation needs change in the repo) |
[git] |
15:18 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Change db2051 IP - T169501 (duration: 00m 46s) |
[production] |
15:17 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Change db2051 IP - T169501 (duration: 00m 46s) |
[production] |
15:17 |
<nschaaf@tin> |
Finished deploy [recommendation-api/deploy@baa11c0]: source parameter validation (duration: 03m 22s) |
[production] |
15:14 |
<nschaaf@tin> |
Started deploy [recommendation-api/deploy@baa11c0]: source parameter validation |
[production] |
15:06 |
<marostegui> |
Poweroff db2051 to get it move to another rack - T169501 |
[production] |
14:46 |
<ema> |
upgrading cache_misc to varnish 4.1.8-1wm1 |
[production] |
14:34 |
<ottomata> |
beginning druid upgrade to 0.92 (take 2 :) ) |
[analytics] |
14:31 |
<ema> |
varnish 4.1.8-1wm1 (fixes VSV00001, DSA 3924-1) built and uploaded to apt.w.o |
[production] |
14:23 |
<elukey> |
restart hive-server to pick up JVM Xms4g change |
[analytics] |
14:22 |
<ottomata> |
suspending druid oozie jobs |
[analytics] |
14:12 |
<marostegui> |
Stop MySQL on db2051 in order to get it ready to move to another rack - T170351 |
[production] |
13:32 |
<Lokal_Profil> |
Upgdate deployed pywikibot to 3.0.20170403 (T112460) |
[tools.heritage] |
13:16 |
<hashar@tin> |
Synchronized wmf-config/Wikibase-production.php: Write to term_full_entity_id column in wb_terms table in prod too - T167229 (duration: 00m 46s) |
[production] |
13:07 |
<hashar@tin> |
Synchronized php-1.30.0-wmf.12/extensions/Wikidata: fix constraint type checks - T169326 (duration: 02m 13s) |
[production] |
12:59 |
<gehel> |
banning elastic102[67] - T168816 |
[production] |
12:41 |
<gehel> |
banning elastic102[45] - T168816 |
[production] |
11:42 |
<jynus> |
disabling autolearn on newest db1* hosts |
[production] |
11:39 |
<jynus> |
disabling autolearn on newest db2* hosts |
[production] |
11:33 |
<marostegui> |
Stop MySQL on db2051 for maintenance - T170351 |
[production] |
11:31 |
<hashar> |
Image snapshot-ci-jessie-1501673225 in wmflabs-eqiad is ready T169602 |
[releng] |
11:29 |
<jynus> |
setting all es hosts with disabled auto-learn bbu properties |
[production] |
11:22 |
<kartik@tin> |
(no justification provided) |
[production] |
11:21 |
<kartik@tin> |
(no justification provided) |
[production] |
11:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2051 - T170351 (duration: 00m 46s) |
[production] |
11:18 |
<kartik@tin> |
Finished deploy [cxserver/deploy@cf3e280]: Update cxserver to fe03ad7 (duration: 00m 56s) |
[production] |
11:17 |
<kartik@tin> |
Started deploy [cxserver/deploy@cf3e280]: Update cxserver to fe03ad7 |
[production] |
11:12 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Depool es2013 (duration: 00m 47s) |
[production] |
11:02 |
<hashar> |
Upgraded tox on CI to 2.5.0 |
[production] |
10:51 |
<hashar> |
Image snapshot-ci-jessie-1501670727 in wmflabs-eqiad is ready - T169602 |
[releng] |
10:49 |
<marostegui> |
Force a re-learn cycle on es2013 |
[production] |
10:18 |
<marostegui> |
Rename wikigrok tables on enwiki on db1089 - T172020 |
[production] |
09:03 |
<marostegui> |
Drop table click_tracking_user_properties wherever it exists - T115982 |
[production] |
09:02 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2057 - T170662 (duration: 00m 46s) |
[production] |
09:02 |
<hashar> |
Regenerating Nodepool Jessie image from scratch to get rid of tox 1.9.2 installed under /usr/local - T169602 |
[releng] |
08:51 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db2073 to s4 - T170662 (duration: 00m 47s) |
[production] |
08:50 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db2073 to s4 - T170662 (duration: 00m 57s) |
[production] |
08:44 |
<hashar> |
Image snapshot-ci-jessie-1501662758 in wmflabs-eqiad is ready - T169602 |
[releng] |
08:42 |
<hashar> |
- T169602 |
[releng] |