1101-1150 of 10000 results (43ms)
2017-04-27 ยง
18:23 <urandom> T163936: restarting cassandra-metrics-collector, restbase production [production]
18:22 <addshore@naos> Synchronized php-1.29.0-wmf.21/extensions/WikimediaEvents/extension.json: SWAT [[gerrit:350544|WMDE Spring campaign - Remove hook]] PT1/2 (duration: 00m 57s) [production]
18:21 <urandom> T163936: restarting cassandra-metrics-collector, restbase staging [production]
18:20 <addshore@naos> Synchronized php-1.29.0-wmf.21/includes/api/ApiQueryPagePropNames.php: SWAT [[gerrit:350585|Do not add limit to ApiQueryPagePropNames when database type is mysql]] (duration: 01m 04s) [production]
18:17 <twentyafterfour> restarting apache on iridium to hotfix T164005 [production]
18:07 <addshore@naos> Synchronized wmf-config/Wikibase-production.php: SWAT [[gerrit:350584|Fix echoIcon for wikibase in testwikis]] (duration: 01m 27s) [production]
17:44 <XenoRyet> Updated paymentswiki from ee7d402216f6eae71cc85137741187ab096ead33 to 030b2f90b155aea8fd3aea4aecf73d0a41d6482b [production]
17:36 <ladsgroup@naos> Finished deploy [ores/deploy@68cca85]: (no justification provided) (duration: 21m 50s) [production]
17:30 <_joe_> started pybal on lvs1006 after network was fixed [production]
17:25 <XenoRyet> reverted paymentswiki from 030b2f90b155aea8fd3aea4aecf73d0a41d6482b to ee7d402216f6eae71cc85137741187ab096ead33 [production]
17:20 <XenoRyet> Updated paymentswiki from ee7d402216f6eae71cc85137741187ab096ead33 to 030b2f90b155aea8fd3aea4aecf73d0a41d6482b [production]
17:15 <ladsgroup@naos> Started deploy [ores/deploy@68cca85]: (no justification provided) [production]
17:15 <Amir1> ladsgroup@naos:/srv/deployment/ores/deploy$ scap deploy (T163950) [production]
17:12 <demon@naos> Pruned MediaWiki: 1.29.0-wmf.18 [keeping static files] (duration: 00m 20s) [production]
17:08 <_joe_> stop pybal on lvs1006 to stop announcing via BGP [production]
17:08 <demon@naos> Pruned MediaWiki: 1.29.0-wmf.16 (duration: 00m 13s) [production]
17:04 <demon@naos> Synchronized scap/plugins/clean.py: One last fix (duration: 01m 04s) [production]
16:53 <gehel> unbanning all elasticsearch servers in eqiad row D - T148506 [production]
16:48 <demon@naos> Synchronized scap/plugins/clean.py: --keep-static is nice now. Also need a co-master sync (duration: 01m 28s) [production]
16:45 <andrewbogott> re-enabling labs instance creation/deletion [production]
16:42 <demon@naos> Pruned MediaWiki: 1.29.0-wmf.19 [keeping static files] (duration: 00m 15s) [production]
16:32 <gehel> unbanning elasticsearch servers in eqiad row D - elastic10(17|18|19|20) - T148506 [production]
15:56 <elukey> restart of jmxtrans on all the hadoop worker nodes [production]
15:51 <andrewbogott> disabling labs instance create/delete to avoid hilarity during network maintenance [production]
15:50 <elukey> forced 'service ferm start' on the failed analytics hosts [production]
15:46 <marostegui> Upgrade db1091 mariadb from 10.0.23 to 10.0.28 [production]
15:39 <marostegui> Upgrade db1089 mariadb from 10.0.23 to 10.0.28 [production]
15:34 <marostegui> Upgrade db1090 mariadb from 10.0.23 to 10.0.28 [production]
15:22 <jynus> stopping all replication channels on dbstore1001 for topology changes [production]
14:34 <ema> upgrade upload-codfw to varnish 4.1.5-1wm4 T145661 [production]
14:29 <marostegui> Stop MySQL and shutdown es2019 for HW replacement - T149526 [production]
14:26 <ema> varnish 4.1.5-1wm4 uploaded to apt.w.o T145661 [production]
14:08 <marostegui> Deploy alter table labswiki.revision on labtestweb2001 - T132416 [production]
14:04 <marostegui> Deploy alter table labswiki.revision on silver - T132416 [production]
13:57 <_joe_> restarting HHVM on mw2213, stuck in HPHP::Treadmill::getAgeOldestRequest [production]
13:52 <ladsgroup@naos> Synchronized wmf-config/Wikibase-production.php: SWAT: Set echoIcon for notification of wikibase in test wikis (T142102) (duration: 00m 57s) [production]
13:52 <Amir1> start of scap sync-file wmf-config/Wikibase-production.php 'SWAT: Set echoIcon for notification of wikibase in test wikis (T142102)' [production]
13:45 <ladsgroup@naos> Synchronized portals: (no justification provided) (duration: 01m 05s) [production]
13:44 <ladsgroup@naos> Synchronized portals/prod/wikipedia.org/assets: (no justification provided) (duration: 01m 21s) [production]
13:43 <Amir1> ladsgroup@naos:/srv/mediawiki-staging$ portals/sync-portals (T128546) [production]
12:53 <volans> disabled puppet on rdb* [production]
12:06 <marostegui> Upgrade es1011 and es1014 from mariadb 10.0.22 to mariadb 10.0.28 [production]
11:50 <marostegui> Upgrade mariadb from 10.0.22 to 10.0.28 on es1015 [production]
09:46 <moritzm> upgrading mysql on bohrium/piwik [production]
09:25 <_joe_> restarting all redis instances for jobqueues on eqiad to force a full resync with masters in codfw T163337 [production]
08:55 <jynus> deploying alter table to all wikis on s6 T163979 [production]
08:54 <_joe_> restarting redis rdb1001:6380 after cleaning up the current AOF files for investigation of T163337 [production]
08:50 <moritzm> installing django security updates [production]
08:29 <godog> ms-be1039 issue "controller slot=3 pd 1I:1:5 modify disablepd" to force failed sdc - T163690 [production]
08:25 <ema> restart varnish-be on cp2024 with expiry thread RT experiment enabled [production]