351-400 of 10000 results (48ms)
2018-05-29 ยง
18:56 <volans@tin> Finished deploy [debmonitor/deploy@fd06bd3]: Initial sync (2) (duration: 01m 42s) [production]
18:55 <volans@tin> Started deploy [debmonitor/deploy@fd06bd3]: Initial sync (2) [production]
18:22 <volans@tin> Finished deploy [debmonitor/deploy@e2efb6b]: Initial sync (duration: 00m 35s) [production]
18:21 <volans@tin> Started deploy [debmonitor/deploy@e2efb6b]: Initial sync [production]
18:04 <arlolra@tin> Finished deploy [parsoid/deploy@e87f54d]: Reverting Parsoid to fd49ab4 (duration: 02m 29s) [production]
18:01 <arlolra@tin> Started deploy [parsoid/deploy@e87f54d]: Reverting Parsoid to fd49ab4 [production]
17:59 <ottomata> beginning rolling restarts of kafka main-codfw to enable SSL listener [production]
17:36 <arlolra@tin> Finished deploy [parsoid/deploy@e87f54d]: Updating Parsoid to bf3a2fd2 (duration: 09m 48s) [production]
17:32 <moritzm> repooled mw2182 (was down for hardware maintenance) [production]
17:26 <arlolra@tin> Started deploy [parsoid/deploy@e87f54d]: Updating Parsoid to bf3a2fd2 [production]
17:25 <foks> Removing 2FA - T187312 [production]
17:12 <bsitzmann@tin> Finished deploy [mobileapps/deploy@ac4c6be]: Update mobileapps to b2fb793 (T192664) (duration: 06m 28s) [production]
17:05 <bsitzmann@tin> Started deploy [mobileapps/deploy@ac4c6be]: Update mobileapps to b2fb793 (T192664) [production]
16:59 <elukey> roll restart of kafka mirror maker on kafka-jumbo100* to pick up the new zookeeper settings [production]
16:56 <XioNoX> bounced analytics1031 switchport to fix weird issue of that host not being able to receive traffic from analytics1001 [production]
16:44 <elukey> roll restart of kafka mirror maker on kafka100[1-3] to pick up new zk settings [production]
16:32 <thcipriani> upgrading blubber to 0.4.0 for integration machines [production]
15:57 <addshore> really done with wb_terms related syncs now [production]
15:52 <addshore@tin> Synchronized wmf-config/Wikibase.php: [[gerrit:435147|Revert - Dont load PropertySuggester]] T195520 (duration: 01m 19s) [production]
15:48 <elukey> roll restart kafka on kafka-jumbo* to pick up new zookeeper settings [production]
15:45 <addshore@tin> Synchronized php-1.32.0-wmf.5/extensions/PropertySuggester: [[gerrit:436038|Use CirrusSearch for PropertySuggester]] (duration: 01m 21s) [production]
15:26 <elukey> restart hadoop yarn/hdfs daemons to pick up the new zookeeper settings [production]
15:11 <addshore> Wikibase - Re enable wb_terms things window done [production]
14:57 <addshore@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436007|TermSqlIndex::getMatchingTerms actually execute select]] (duration: 02m 19s) [production]
14:57 <marostegui> Move s6 topology back to its normal status [production]
14:49 <addshore@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436006|TermSqlIndex::getMatchingTerms actually execute select]] (duration: 02m 18s) [production]
14:32 <addshore@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436004|Re add TermSqlIndex::getMatchingTerms select, but dont call]] (duration: 02m 18s) [production]
14:29 <addshore@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436003|Re add TermSqlIndex::getMatchingTerms select, but dont call]] (duration: 02m 13s) [production]
14:24 <elukey> roll restart kafka on kafka100[1-3] (job queues) to pick up the new zookeeper settings [production]
14:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool all databases in row C - T187962 (duration: 01m 19s) [production]
14:13 <addshore@tin> Synchronized php-1.32.0-wmf.4/extensions/Wikibase: [[gerrit:436001|track all wb_terms table access via statsd]] (duration: 02m 19s) [production]
14:13 <gehel> comleted rolling restart of relforge for plugin upgrade - T193734 [production]
14:10 <addshore@tin> Synchronized php-1.32.0-wmf.5/extensions/Wikibase: [[gerrit:436000|track all wb_terms table access via statsd]] (duration: 02m 21s) [production]
14:07 <addshore@tin> Synchronized php-1.32.0-wmf.4/extensions/CentralNotice: [[gerrit:435817|Convert numerical URL parameters to numbers]] for AndyRussG (was left on tin) (duration: 01m 25s) [production]
14:03 <elukey> swap zookeeper from conf1003 to conf1006 [production]
13:56 <XioNoX> rolling back ns0 and ping1001 redirects - T187962 [production]
13:47 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:435693|Create 2 extra namespaces for bdwikimedia (T195700)]] (duration: 01m 39s) [production]
13:42 <moritzm> upgrading remaining job runners in eqiad to hhvm-wikidiff 1.7.0 [production]
13:39 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:435629|Revert "Revert "Revert "Temp rate limit for arwiki due to mass vandalism""" (T192668)]] (duration: 01m 51s) [production]
13:32 <volans> restarted ircecho [production]
13:28 <volans> puppet run on failed hosts completed [production]
13:25 <moritzm> powered down mw2182 for hardware diagnosis [production]
13:19 <gehel> rolling restart of relforge for plugin upgrade - T193734 [production]
13:16 <volans> running puppet on failed only hosts [production]
13:12 <volans> stopped ircecho temporarily [production]
12:54 <moritzm> installing xdg-utils security updates [production]
11:21 <marostegui> Restar db1125 mysql - T195595 [production]
11:14 <moritzm> upgrading snapshot hosts to hhvm-wikidiff 1.7.0 (HHVM is unused, just for completeness) [production]
11:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Disable read only on s6 T194939 T187962 (duration: 01m 37s) [production]
10:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Enable read only on s6 T194939 T187962 (duration: 01m 35s) [production]