|
2017-11-30
ยง
|
| 21:31 |
<jynus> |
upgrading labsdb1010 and restarting mariadb |
[production] |
| 21:23 |
<mutante> |
powercycling kafka1018 (was down in Icinga and saw in SAL: reboot kafka10[12-22] for kernel + jvm updates - T179943) |
[production] |
| 21:18 |
<jynus> |
upgrade and restart db2078 |
[production] |
| 21:14 |
<addshore@tin> |
Synchronized wmf-config: wdbuild: BETA ONLY (duration: 00m 47s) |
[production] |
| 21:01 |
<addshore@tin> |
Synchronized wmf-config: wdbuild: T173818: add switch to ease killing (again) (duration: 00m 46s) |
[production] |
| 20:59 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: wdbuild: T173818: add switch to ease killing (again) (duration: 00m 45s) |
[production] |
| 20:49 |
<XenoRyet> |
Updated tools from 6e604fd9f3ca57935e2c35e37b7e85b4ca438d6a to 626fe02a9f5ffcc24c200858644d697607679738 |
[production] |
| 20:40 |
<bd808> |
Sending Toolforge survey final reminder emails from silver for T177126 |
[production] |
| 20:32 |
<addshore@tin> |
Synchronized wmf-config: REVERT wdbuild: T173818: add switch to ease killing (duration: 00m 47s) |
[production] |
| 20:30 |
<addshore@tin> |
Synchronized wmf-config: wdbuild: T173818: add switch to ease killing (duration: 00m 47s) |
[production] |
| 20:13 |
<ejegg> |
re-adjusted Civi job timings. QC every odd min for 105 sec, TY every even min for 70 sec after 45 sec delay |
[production] |
| 20:12 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 to wmf.10 |
[production] |
| 19:55 |
<ejegg> |
105 seconds for each job |
[production] |
| 19:55 |
<ejegg> |
adjusted timings of Civi jobs to let TY and QC run concurrently |
[production] |
| 19:37 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:392185|Revert "Temporary disable remex html"]] T178632 (duration: 00m 49s) |
[production] |
| 19:20 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.10/includes/htmlform/fields/HTMLMultiSelectField.php: SWAT: [[gerrit:394339|HTMLMultiSelectField: Allow formatting in section headings in OOUI mode]] T181698 (duration: 00m 49s) |
[production] |
| 19:11 |
<thcipriani@tin> |
Synchronized wmf-config: SWAT: [[gerrit:393661|Enable MP3 uploads on Commons]] T120288 (duration: 00m 51s) |
[production] |
| 17:57 |
<andrewbogott> |
upgrading labtestpuppetmaster2001 to puppet 4.8 |
[production] |
| 17:47 |
<moritzm> |
uploaded prometheus-openldap-exporter 0+git20171128-1 for jessie-wikimedia (T181511) |
[production] |
| 17:06 |
<herron> |
beginning cut over of esams to codfw puppet 4 masters |
[production] |
| 16:44 |
<urandom> |
drop (erroneous) legacy tables from -ng cassandra cluster - T181689 |
[production] |
| 16:12 |
<elukey> |
drain and reboot analytics1031->39 to pick up jvm+kernel updates - T179943 |
[production] |
| 15:59 |
<jynus> |
setup prometheus with unix_socket on new server db1107 and db1108 |
[production] |
| 15:19 |
<gehel> |
restart blazegraph on wdqs1004 |
[production] |
| 15:16 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1110 load (duration: 00m 48s) |
[production] |
| 15:11 |
<herron> |
beginning cut over of ulsfo to codfw puppet 4 masters |
[production] |
| 14:50 |
<zeljkof> |
EU SWAT finished |
[production] |
| 14:46 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:387618|Enable WikiLove Extension on pa.wiki (T178919)]] (duration: 00m 49s) |
[production] |
| 14:28 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:394255|Add import sources to de.wiki (T181695)]] (duration: 00m 49s) |
[production] |
| 14:20 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.10/extensions/ContentTranslation/modules/dashboard/ext.cx.dashboard.js: SWAT: [[gerrit:394292|Set default languages after fetching valid languages]] (duration: 00m 49s) |
[production] |
| 14:19 |
<marostegui> |
Deploy schema change on s3 - db1078 - T174569 |
[production] |
| 13:23 |
<addshore@tin> |
Synchronized php-1.31.0-wmf.10/extensions/AdvancedSearch/modules/ext.advancedSearch.init.js: pre-swat: T181644 Force search profile advanced in AdvancedSearch [[gerrit:394297]] (duration: 00m 48s) |
[production] |
| 13:22 |
<addshore@tin> |
Synchronized php-1.31.0-wmf.8/extensions/AdvancedSearch/modules/ext.advancedSearch.init.js: pre-swat: T181644 Force search profile advanced in AdvancedSearch [[gerrit:394299]] (duration: 00m 50s) |
[production] |
| 13:18 |
<herron> |
cutting codfw puppet agents over to puppetmaster2001.codfw.wmnet |
[production] |
| 12:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Tackle s4 DB weights to make them more equal (duration: 00m 48s) |
[production] |
| 11:58 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1081 and reduce traffic for db1091 (duration: 00m 50s) |
[production] |
| 10:33 |
<jynus> |
stopping replication on db1044 and db1095 (s3) |
[production] |
| 09:16 |
<moritzm> |
installing exim security updates on stretch (jessie/trusty not affected) |
[production] |
| 09:14 |
<elukey> |
drain and reboot analytics1029/1030 for jvm+kernel updates (Hadoop worker canaries) |
[production] |
| 09:05 |
<godog> |
add 200G of space to graphite2002 carbon lv |
[production] |
| 08:25 |
<moritzm> |
rolling restart of mw canaries to pick up curl security update |
[production] |
| 08:21 |
<marostegui> |
Enable GTID on s8 eqiad hosts that do not have it enabled (db1109, db1104, db1101, db1092, db1087, db1063) - T177208 |
[production] |
| 07:48 |
<moritzm> |
installing curl security updates |
[production] |
| 07:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1056 (duration: 01m 18s) |
[production] |
| 06:48 |
<marostegui> |
Deploy schema change on dbstore1001 s3 - T174569 |
[production] |
| 06:26 |
<marostegui> |
Deploy schema change on s3 db1077 - T174569 |
[production] |
| 02:48 |
<ebernhardson@tin> |
Finished deploy [search/mjolnir/deploy@7aa39b7]: (no justification provided) (duration: 03m 15s) |
[production] |
| 02:45 |
<ebernhardson@tin> |
Started deploy [search/mjolnir/deploy@7aa39b7]: (no justification provided) |
[production] |
| 02:29 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.8) (duration: 08m 43s) |
[production] |
| 01:17 |
<ejegg> |
updated fundraising tools from 6d4b6f388e64ff4dc9a6a501bc8339fc1294fe9f to 6e604fd9f3ca57935e2c35e37b7e85b4ca438d6a |
[production] |