551-600 of 10000 results (55ms)
2019-02-28 §
06:18 <kart_> Finished manual run of unpublished ContentTranslation draft purge script (T216983) [production]
05:56 <marostegui> Upgrade MySQL on db1124 (Sanitarium) lag will be generated on s1,s3,s5,s8 [production]
03:03 <kart_> Manual run of unpublished ContentTranslation draft purge script (T216983) [production]
02:08 <bstorm_> clouddb1002 is now in place to replace labsdb1004 as replica for toolsdb but not wikilabels postgres yet T193264 [production]
01:43 <twentyafterfour> phabricator upgrade completed without issues (actually completed at 01:23 UTC but I failed to hit enter and submit this message) [production]
01:20 <twentyafterfour> deploying phabricator update 2019-02-27 [production]
01:03 <twentyafterfour> preparing to deploy phabricator-2019-02-27 [production]
00:55 <ebernhardson@deploy1001> Synchronized php-1.33.0-wmf.19/vendor/: vendor/ruflin/Elastica: Remove scalar return type hints (duration: 01m 33s) [production]
00:22 <ebernhardson@deploy1001> Synchronized vendor/: Remove scalar type hints from ruflin/Elastica (duration: 00m 58s) [production]
00:10 <ebernhardson@deploy1001> Synchronized wmf-config/CommonSettings.php: T215725 Remove mediawikiwiki from wgCentralAuthAutoCreateWikis (duration: 00m 54s) [production]
00:07 <ebernhardson@deploy1001> Synchronized wmf-config/: T215684 Add config for switching Wikibase search to WikibaseCirrusSearch codebase (duration: 00m 55s) [production]
2019-02-27 §
21:57 <XioNoX> delete local pref for peering sessions in eqiad - T204281 [production]
21:44 <eileen> civicrm revision is c81fe7a4fd, config revision is 050abdf9e8 [production]
21:26 <XioNoX> delete local pref for peering sessions in eqord - T204281 [production]
20:53 <XioNoX> delete local pref for peering sessions in codfw/eqdfw - T204281 [production]
20:50 <hashar> 1.33.0-wmf.19 not rolled to group1. Pending T217285 (Wikibase raising exception on commonswiki). To be figured out during European day time. [production]
20:50 <eileen> civicrm revision changed from 224bf15206 to c81fe7a4fd, config revision is d1826e371b [production]
20:14 <hashar@deploy1001> rebuilt and synchronized wikiversions files: (no justification provided) [production]
20:04 <hashar@deploy1001> Synchronized php: group1 wikis to 1.33.0-wmf.19 (duration: 00m 53s) [production]
20:04 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.19 [production]
19:49 <bstorm_> stopped slave on labsbd1004 for T193264 [production]
19:43 <bstorm_> downtimed labsdb1004 to stop mysql for transferring data for T193264 [production]
19:32 <SMalyshev> repooled wdqs1005, caught up [production]
19:26 <herron> replacing kafka on logstash1004 with logstash1010 T213898 [production]
18:56 <SMalyshev> depooled wdqs1005 to let it catch up [production]
18:36 <smalyshev@deploy1001> Finished deploy [wdqs/wdqs@465673b]: Redeploy GUI for T217161 (duration: 10m 51s) [production]
18:28 <cmjohnson1> powering off mw126[3-6] one at a time to move to different rack A5 T212348 [production]
18:25 <smalyshev@deploy1001> Started deploy [wdqs/wdqs@465673b]: Redeploy GUI for T217161 [production]
18:21 <cmjohnson1> powering off mw1262 to move to different rack A5 T212348 [production]
18:15 <cmjohnson1> powering off mw1261 to move to different rack A5 T212348 [production]
17:57 <niharika29@deploy1001> Synchronized php-1.33.0-wmf.19/extensions/Flow/: Make VisualEditor unwrap <section> tags T217206 (duration: 01m 00s) [production]
17:56 <elukey> roll restart hadoop hdfs namenodes on an-master100[1,2] to pick up the new rack config of analytics1071 [production]
17:37 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Welcome survey: add a control group to viwiki T216669 (duration: 00m 54s) [production]
17:34 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop collecting data for CitaitonUsage and CitationUsagePageLoad T213969 (duration: 00m 55s) [production]
17:22 <elukey> drain + shutdown of analytics1071 to allow its move to A5 - T212348 [production]
17:19 <cmjohnson1> powering off wtp1030 to move to different rack A5 T212348 [production]
17:14 <cmjohnson1> powering off wtp1029 to move to different rack A5 T212348 [production]
17:06 <cmjohnson1> powering off wtp1029 to move to different rack A5 T212348 [production]
17:05 <RoanKattouw> Running foreachwikiindblist dblists/echo.dblist extensions/Echo/maintenance/removeOrphanedEvents.php on mwmaint1002 [production]
16:58 <hashar@deploy1001> Synchronized php-1.33.0-wmf.19/extensions/Score: Revert "beautify lilypond error message output" - T217241 (duration: 00m 56s) [production]
16:49 <jijiki> Deploy LVS for eventgate-analytics - T211247 [production]
16:26 <volans> temporarily disabled puppet on icinga[12]001 to deploy g/493171 [production]
16:20 <volans> force-rebooting icinga1001 (to test some puppet changes) - T214760 [production]
15:34 <jbond42> rolling openssl security updates to jessie canary servers [production]
14:25 <marostegui> Deploy schema change on abuse_filter_log on s7 codfw - lag will be generated on codfw - T187295 [production]
14:01 <marostegui> Change indexes on abuse_filter_log on db1089 - T187295 [production]
14:00 <moritzm> uploaded openssl 1.0.2r to jessie-wikimedia [production]
12:08 <jbond42> correction: rolling updates of apache on mw api servers *not* jobrunners [production]
12:04 <jbond42> rolling updates of apache on mw jobrunners [production]
11:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1077 after MySQL upgrade (duration: 00m 53s) [production]