7751-7800 of 10000 results (67ms)
2017-11-30 ยง
21:35 <addshore@tin> Synchronized wmf-config: wdbuild: BETA ONLY (duration: 00m 47s) [production]
21:31 <jynus> upgrading labsdb1010 and restarting mariadb [production]
21:23 <mutante> powercycling kafka1018 (was down in Icinga and saw in SAL: reboot kafka10[12-22] for kernel + jvm updates - T179943) [production]
21:18 <jynus> upgrade and restart db2078 [production]
21:14 <addshore@tin> Synchronized wmf-config: wdbuild: BETA ONLY (duration: 00m 47s) [production]
21:01 <addshore@tin> Synchronized wmf-config: wdbuild: T173818: add switch to ease killing (again) (duration: 00m 46s) [production]
20:59 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: wdbuild: T173818: add switch to ease killing (again) (duration: 00m 45s) [production]
20:49 <XenoRyet> Updated tools from 6e604fd9f3ca57935e2c35e37b7e85b4ca438d6a to 626fe02a9f5ffcc24c200858644d697607679738 [production]
20:40 <bd808> Sending Toolforge survey final reminder emails from silver for T177126 [production]
20:32 <addshore@tin> Synchronized wmf-config: REVERT wdbuild: T173818: add switch to ease killing (duration: 00m 47s) [production]
20:30 <addshore@tin> Synchronized wmf-config: wdbuild: T173818: add switch to ease killing (duration: 00m 47s) [production]
20:13 <ejegg> re-adjusted Civi job timings. QC every odd min for 105 sec, TY every even min for 70 sec after 45 sec delay [production]
20:12 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.10 [production]
19:55 <ejegg> 105 seconds for each job [production]
19:55 <ejegg> adjusted timings of Civi jobs to let TY and QC run concurrently [production]
19:37 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:392185|Revert "Temporary disable remex html"]] T178632 (duration: 00m 49s) [production]
19:20 <thcipriani@tin> Synchronized php-1.31.0-wmf.10/includes/htmlform/fields/HTMLMultiSelectField.php: SWAT: [[gerrit:394339|HTMLMultiSelectField: Allow formatting in section headings in OOUI mode]] T181698 (duration: 00m 49s) [production]
19:11 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:393661|Enable MP3 uploads on Commons]] T120288 (duration: 00m 51s) [production]
17:57 <andrewbogott> upgrading labtestpuppetmaster2001 to puppet 4.8 [production]
17:47 <moritzm> uploaded prometheus-openldap-exporter 0+git20171128-1 for jessie-wikimedia (T181511) [production]
17:06 <herron> beginning cut over of esams to codfw puppet 4 masters [production]
16:44 <urandom> drop (erroneous) legacy tables from -ng cassandra cluster - T181689 [production]
16:12 <elukey> drain and reboot analytics1031->39 to pick up jvm+kernel updates - T179943 [production]
15:59 <jynus> setup prometheus with unix_socket on new server db1107 and db1108 [production]
15:19 <gehel> restart blazegraph on wdqs1004 [production]
15:16 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1110 load (duration: 00m 48s) [production]
15:11 <herron> beginning cut over of ulsfo to codfw puppet 4 masters [production]
14:50 <zeljkof> EU SWAT finished [production]
14:46 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:387618|Enable WikiLove Extension on pa.wiki (T178919)]] (duration: 00m 49s) [production]
14:28 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:394255|Add import sources to de.wiki (T181695)]] (duration: 00m 49s) [production]
14:20 <zfilipin@tin> Synchronized php-1.31.0-wmf.10/extensions/ContentTranslation/modules/dashboard/ext.cx.dashboard.js: SWAT: [[gerrit:394292|Set default languages after fetching valid languages]] (duration: 00m 49s) [production]
14:19 <marostegui> Deploy schema change on s3 - db1078 - T174569 [production]
13:23 <addshore@tin> Synchronized php-1.31.0-wmf.10/extensions/AdvancedSearch/modules/ext.advancedSearch.init.js: pre-swat: T181644 Force search profile advanced in AdvancedSearch [[gerrit:394297]] (duration: 00m 48s) [production]
13:22 <addshore@tin> Synchronized php-1.31.0-wmf.8/extensions/AdvancedSearch/modules/ext.advancedSearch.init.js: pre-swat: T181644 Force search profile advanced in AdvancedSearch [[gerrit:394299]] (duration: 00m 50s) [production]
13:18 <herron> cutting codfw puppet agents over to puppetmaster2001.codfw.wmnet [production]
12:07 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Tackle s4 DB weights to make them more equal (duration: 00m 48s) [production]
11:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1081 and reduce traffic for db1091 (duration: 00m 50s) [production]
10:33 <jynus> stopping replication on db1044 and db1095 (s3) [production]
09:16 <moritzm> installing exim security updates on stretch (jessie/trusty not affected) [production]
09:14 <elukey> drain and reboot analytics1029/1030 for jvm+kernel updates (Hadoop worker canaries) [production]
09:05 <godog> add 200G of space to graphite2002 carbon lv [production]
08:25 <moritzm> rolling restart of mw canaries to pick up curl security update [production]
08:21 <marostegui> Enable GTID on s8 eqiad hosts that do not have it enabled (db1109, db1104, db1101, db1092, db1087, db1063) - T177208 [production]
07:48 <moritzm> installing curl security updates [production]
07:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1056 (duration: 01m 18s) [production]
06:48 <marostegui> Deploy schema change on dbstore1001 s3 - T174569 [production]
06:26 <marostegui> Deploy schema change on s3 db1077 - T174569 [production]
02:48 <ebernhardson@tin> Finished deploy [search/mjolnir/deploy@7aa39b7]: (no justification provided) (duration: 03m 15s) [production]
02:45 <ebernhardson@tin> Started deploy [search/mjolnir/deploy@7aa39b7]: (no justification provided) [production]
02:29 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.8) (duration: 08m 43s) [production]