|
2018-05-29
ยง
|
| 19:16 |
<thcipriani> |
cutting branch for wmf.6, will not deploy wmf.6 as wmf.5 is not currently on group2 as the train is blocked on T195514 which is blocked on T195868 which is blocked on T195906 |
[production] |
| 18:56 |
<volans@tin> |
Finished deploy [debmonitor/deploy@fd06bd3]: Initial sync (2) (duration: 01m 42s) |
[production] |
| 18:55 |
<volans@tin> |
Started deploy [debmonitor/deploy@fd06bd3]: Initial sync (2) |
[production] |
| 18:22 |
<volans@tin> |
Finished deploy [debmonitor/deploy@e2efb6b]: Initial sync (duration: 00m 35s) |
[production] |
| 18:21 |
<volans@tin> |
Started deploy [debmonitor/deploy@e2efb6b]: Initial sync |
[production] |
| 18:04 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@e87f54d]: Reverting Parsoid to fd49ab4 (duration: 02m 29s) |
[production] |
| 18:01 |
<arlolra@tin> |
Started deploy [parsoid/deploy@e87f54d]: Reverting Parsoid to fd49ab4 |
[production] |
| 17:59 |
<ottomata> |
beginning rolling restarts of kafka main-codfw to enable SSL listener |
[production] |
| 17:36 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@e87f54d]: Updating Parsoid to bf3a2fd2 (duration: 09m 48s) |
[production] |
| 17:32 |
<moritzm> |
repooled mw2182 (was down for hardware maintenance) |
[production] |
| 17:26 |
<arlolra@tin> |
Started deploy [parsoid/deploy@e87f54d]: Updating Parsoid to bf3a2fd2 |
[production] |
| 17:25 |
<foks> |
Removing 2FA - T187312 |
[production] |
| 17:12 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@ac4c6be]: Update mobileapps to b2fb793 (T192664) (duration: 06m 28s) |
[production] |
| 17:05 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@ac4c6be]: Update mobileapps to b2fb793 (T192664) |
[production] |
| 16:59 |
<elukey> |
roll restart of kafka mirror maker on kafka-jumbo100* to pick up the new zookeeper settings |
[production] |
| 16:56 |
<XioNoX> |
bounced analytics1031 switchport to fix weird issue of that host not being able to receive traffic from analytics1001 |
[production] |
| 16:44 |
<elukey> |
roll restart of kafka mirror maker on kafka100[1-3] to pick up new zk settings |
[production] |
| 16:32 |
<thcipriani> |
upgrading blubber to 0.4.0 for integration machines |
[production] |
| 15:57 |
<addshore> |
really done with wb_terms related syncs now |
[production] |
| 15:52 |
<addshore@tin> |
Synchronized wmf-config/Wikibase.php: [[gerrit:435147|Revert - Dont load PropertySuggester]] T195520 (duration: 01m 19s) |
[production] |
| 15:48 |
<elukey> |
roll restart kafka on kafka-jumbo* to pick up new zookeeper settings |
[production] |
| 15:45 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/PropertySuggester: [[gerrit:436038|Use CirrusSearch for PropertySuggester]] (duration: 01m 21s) |
[production] |
| 15:26 |
<elukey> |
restart hadoop yarn/hdfs daemons to pick up the new zookeeper settings |
[production] |
| 15:11 |
<addshore> |
Wikibase - Re enable wb_terms things window done |
[production] |
| 14:57 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436007|TermSqlIndex::getMatchingTerms actually execute select]] (duration: 02m 19s) |
[production] |
| 14:57 |
<marostegui> |
Move s6 topology back to its normal status |
[production] |
| 14:49 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436006|TermSqlIndex::getMatchingTerms actually execute select]] (duration: 02m 18s) |
[production] |
| 14:32 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436004|Re add TermSqlIndex::getMatchingTerms select, but dont call]] (duration: 02m 18s) |
[production] |
| 14:29 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436003|Re add TermSqlIndex::getMatchingTerms select, but dont call]] (duration: 02m 13s) |
[production] |
| 14:24 |
<elukey> |
roll restart kafka on kafka100[1-3] (job queues) to pick up the new zookeeper settings |
[production] |
| 14:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool all databases in row C - T187962 (duration: 01m 19s) |
[production] |
| 14:13 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436001|track all wb_terms table access via statsd]] (duration: 02m 19s) |
[production] |
| 14:13 |
<gehel> |
comleted rolling restart of relforge for plugin upgrade - T193734 |
[production] |
| 14:10 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436000|track all wb_terms table access via statsd]] (duration: 02m 21s) |
[production] |
| 14:07 |
<addshore@tin> |
Synchronized php-1.32.0-wmf.4/extensions/CentralNotice: [[gerrit:435817|Convert numerical URL parameters to numbers]] for AndyRussG (was left on tin) (duration: 01m 25s) |
[production] |
| 14:03 |
<elukey> |
swap zookeeper from conf1003 to conf1006 |
[production] |
| 13:56 |
<XioNoX> |
rolling back ns0 and ping1001 redirects - T187962 |
[production] |
| 13:47 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:435693|Create 2 extra namespaces for bdwikimedia (T195700)]] (duration: 01m 39s) |
[production] |
| 13:42 |
<moritzm> |
upgrading remaining job runners in eqiad to hhvm-wikidiff 1.7.0 |
[production] |
| 13:39 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:435629|Revert "Revert "Revert "Temp rate limit for arwiki due to mass vandalism""" (T192668)]] (duration: 01m 51s) |
[production] |
| 13:32 |
<volans> |
restarted ircecho |
[production] |
| 13:28 |
<volans> |
puppet run on failed hosts completed |
[production] |
| 13:25 |
<moritzm> |
powered down mw2182 for hardware diagnosis |
[production] |
| 13:19 |
<gehel> |
rolling restart of relforge for plugin upgrade - T193734 |
[production] |
| 13:16 |
<volans> |
running puppet on failed only hosts |
[production] |
| 13:12 |
<volans> |
stopped ircecho temporarily |
[production] |
| 12:54 |
<moritzm> |
installing xdg-utils security updates |
[production] |
| 11:21 |
<marostegui> |
Restar db1125 mysql - T195595 |
[production] |
| 11:14 |
<moritzm> |
upgrading snapshot hosts to hhvm-wikidiff 1.7.0 (HHVM is unused, just for completeness) |
[production] |
| 11:08 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Disable read only on s6 T194939 T187962 (duration: 01m 37s) |
[production] |