3151-3200 of 10000 results (73ms)
2018-09-25 ยง
16:59 <gehel> forcing puppet run on all elastic nodes (including logstash) to recover prometheus metric exporter [production]
15:14 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Turn off EducationProgram T188411 T125618 (duration: 00m 57s) [production]
15:02 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.32.0-wmf.23 [production]
14:50 <marostegui> Stop MySQL on db1098 s6 and s7 for upgrade [production]
14:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 57s) [production]
14:39 <zfilipin@deploy1001> Finished scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache (duration: 20m 50s) [production]
14:38 <moritzm> rebooting mw1240-mw1258 for kernel security updates [production]
14:18 <zfilipin@deploy1001> Started scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache [production]
14:15 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.19 [keeping static files] (duration: 01m 29s) [production]
14:12 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.18 (duration: 03m 02s) [production]
14:10 <marostegui> Upgrade db1088 [production]
14:05 <marostegui> Stop db1088 and db1098:3316 in sync [production]
14:03 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 (duration: 00m 50s) [production]
14:02 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.16 (duration: 08m 27s) [production]
13:29 <marostegui> Deploy schema change on s2 eqiad - this might generate lag on s2 eqiad - T203709 [production]
13:13 <marostegui> Deploy schema change on s6 eqiad - this might generate lag on s6 eqiad - T203709 [production]
13:07 <marostegui> Deploy schema change on s5 eqiad - this might generate lag on s5 eqiad - T203709 [production]
12:51 <moritzm> rebooting mw1221-mw1239 for kernel security updates [production]
12:42 <moritzm> installing chromium security updates on proton* (tested the new Chromium version in deployment-prep) [production]
12:36 <raynor> EU SWAT finished [production]
12:34 <pmiazga@deploy1001> Finished scap: php-1.32.0-wmf.22/skins/MinervaNeue/includes SWAT: [[gerrit:462658|Minerva A/B tests are not subject to HTML caching time (T205355)]] (duration: 16m 51s) [production]
12:34 <godog> repair sde on ms-be2042 - T199198 [production]
12:17 <pmiazga@deploy1001> Started scap: php-1.32.0-wmf.22/skins/MinervaNeue/includes SWAT: [[gerrit:462658|Minerva A/B tests are not subject to HTML caching time (T205355)]] [production]
12:05 <pmiazga@deploy1001> Finished scap: php-1.32.0-wmf.22/skins/MinervaNeue/resources/skins.minerva.scripts/pageIssues.js SWAT: [[gerrit:462598|It should be possible to opt into new page issues treatment via query string parameter (T204746)]] (duration: 17m 39s) [production]
12:01 <elukey> end of the maintenance to swap Hadoop masters from analytics100[1,2] to an-master100[1,2] - T203635 [production]
11:47 <pmiazga@deploy1001> Started scap: php-1.32.0-wmf.22/skins/MinervaNeue/resources/skins.minerva.scripts/pageIssues.js SWAT: [[gerrit:462598|It should be possible to opt into new page issues treatment via query string parameter (T204746)]] [production]
11:20 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:462042|Increase sampling ratio for ReadingDepth (T205176)]] (duration: 00m 50s) [production]
10:53 <onimisionipe> onimisionipe: starting inplace reindex of eqiad enwiki - T204362 [production]
09:48 <banyek> upgrading & rebooting dbproxy1006 [production]
09:38 <Amir1> ladsgroup@mwmaint2001:~$ foreachwikiindblist all populateChangeTagDef.php --set-user-tags-only [production]
09:34 <banyek> rebooting again dbproxy1004, 1005, 1007, 1009 [production]
09:25 <banyek> upgrade and reboot dbproxy1008 [production]
09:18 <banyek> upgrade and reboot dbproxy1007 [production]
08:54 <banyek> upgrade & reboot dbproxy1005 [production]
08:52 <moritzm> installing libtirpc security updates [production]
08:49 <mobrovac@deploy1001> Finished deploy [restbase/deploy@40b81a8]: Do not dynamically generate Parsoid content if TID is provided, take #2 (duration: 12m 19s) [production]
08:39 <banyek> upgrade & reboot dbproxy1009 [production]
08:38 <moritzm> installing twitter-bootstrap3 security updates [production]
08:37 <mobrovac@deploy1001> Started deploy [restbase/deploy@40b81a8]: Do not dynamically generate Parsoid content if TID is provided, take #2 [production]
08:37 <mobrovac@deploy1001> Finished deploy [restbase/deploy@40b81a8]: Do not dynamically generate Parsoid content if TID is provided - T204880 (duration: 12m 00s) [production]
08:25 <mobrovac@deploy1001> Started deploy [restbase/deploy@40b81a8]: Do not dynamically generate Parsoid content if TID is provided - T204880 [production]
08:24 <moritzm> installing libapache2-mod-perl2 security updates [production]
08:23 <banyek> upgrading & rebooting dbproxy1004 [production]
08:21 <mobrovac@deploy1001> Finished deploy [restbase/deploy@40b81a8] (dev-cluster): Do not dynamically generate Parsoid content if TID is provided (duration: 02m 52s) [production]
08:18 <mobrovac@deploy1001> Started deploy [restbase/deploy@40b81a8] (dev-cluster): Do not dynamically generate Parsoid content if TID is provided [production]
08:03 <moritzm> installing reportbug DLA update on jessie hosts [production]
08:03 <elukey> start of the maintenance to swap Hadoop masters from analytics100[1,2] to an-master100[1,2] - T203635 [production]
07:54 <marostegui> Deploy schema change on s4 codfw - T204006 [production]
07:20 <godog> repair sdm sdi on ms-be2043 - T199198 [production]
07:13 <marostegui> Deploy schema change on s3 eqiad master (db1075), might generate lag on s3 eqiad - T204006 [production]