801-850 of 10000 results (50ms)
2018-07-26 §
00:01 <mutante> temp. disable puppet on netmon1002,netmon2001 before applying puppet ferm change out of abundance of caution. applied gerrit:439554 without issues on netmon1003 [production]
2018-07-25 §
23:35 <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.13/extensions/VisualEditor/modules/ve-mw/dm/nodes/ve.dm.MWInlineImageNode.js: SWAT: [[gerrit:447653|ve.dm.MWInlineImageNode: Fix undefined data-mw in toDomElements output]] T198941 T200214 (duration: 00m 57s) [production]
23:05 <mutante> added dchen to LDAP group "wmf" (was already in admins as shell user, so didn't have to be added in puppet repo) (T200366) [production]
20:23 <bblack> pooling cp5006 - T187157 [production]
20:05 <krinkle@deploy1001> Synchronized wmf-config/: Remove wgUploadThumbnailRenderHttpCustomDomain override - T200346 (duration: 00m 57s) [production]
18:59 <bstorm_> Added new disk shelf to labstore1007 [production]
17:53 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 54s) [production]
17:45 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.14/extensions/Cite/includes/Cite.php: (no justification provided) (duration: 00m 55s) [production]
17:07 <ejegg> Updated SmashPig settings: extended Ingenico Connect API timeout to 12 seconds [production]
16:49 <Amir1> morning SWAT is done [production]
16:49 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:447834|Enable reading from the new backend for Special:Tags in several large wikis (T199334)]] (duration: 00m 56s) [production]
16:40 <akosiaris> remove ORES abuser blocking T200338, let's reevaluate [production]
16:02 <joal@deploy1001> Finished deploy [analytics/refinery@9390b63]: Regular weekly deploy of Analytics-Hadoop scripts (duration: 17m 51s) [production]
15:49 <gehel> elasticsearch cluster restart on codfw completed - T156137 [production]
15:44 <joal@deploy1001> Started deploy [analytics/refinery@9390b63]: Regular weekly deploy of Analytics-Hadoop scripts [production]
15:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 (duration: 00m 55s) [production]
15:31 <anomie> running populateContentTables.php on testwiki for T183488 [production]
15:26 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 55s) [production]
15:21 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Set wgMultiContentRevisionSchemaMigrationStage to write-both read-old on testwiki (T197817) (duration: 00m 55s) [production]
14:45 <marostegui> Deploy schema change on db1098:3317 T144010 T51190 T199368 [production]
14:43 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 54s) [production]
14:39 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: (no justification provided) [production]
14:29 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1014 fully (duration: 00m 55s) [production]
14:00 <zfilipin@deploy1001> Synchronized php: group1 wikis to 1.32.0-wmf.14 (duration: 00m 55s) [production]
13:59 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.14 [production]
13:54 <jynus> running compare.py on all es3 databases [production]
13:48 <ema> text-eqiad: test alternate domains patch with varnish 5.1.3-1wm9 T164609 [production]
13:44 <Amir1> restarting ores celery workers on codfw [production]
13:34 <ema> repool cp1067 w/ alternate domains patch and varnish 5.1.3-1wm9 T164609 [production]
13:27 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.32.0-wmf.14 [production]
13:26 <ema> depool cp1067 and test alternate domains patch with varnish 5.1.3-1wm9 T164609 [production]
13:00 <gehel> resetting postgres data on maps1002 after failing replication - T200228 [production]
12:21 <Amir1> start of ladsgroup@mwmaint1001:~$ foreachwikiindblist s5 populateChangeTagDef.php --sleep 2 (T193873) [production]
12:19 <zfilipin@deploy1001> Finished scap: testwiki to php-1.32.0-wmf.14 and rebuild l10n cache (duration: 59m 27s) [production]
11:20 <zfilipin@deploy1001> Started scap: testwiki to php-1.32.0-wmf.14 and rebuild l10n cache [production]
11:16 <dcausse> EU SWAT done [production]
11:14 <dcausse@deploy1001> Synchronized ./wmf-config/CirrusSearch-common.php: [cirrus] allow term_freq and remove deprecated settings (duration: 00m 48s) [production]
11:01 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.10 [keeping static files] (duration: 05m 13s) [production]
10:21 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1014 with low load after maintenance (duration: 00m 47s) [production]
10:07 <marostegui> Deploy schema change on db2040 (s7 codfw master) with replication, this will generate lag on s7 codfw T144010 T51190 T199368 [production]
10:05 <ema> upgrade varnish to 5.1.3-1wm9 on text-eqiad T164609 [production]
09:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1121 (duration: 00m 47s) [production]
09:53 <godog> bounce grafana on krypton [production]
09:31 <ema> upload varnish 5.1.3-1wm9 to apt.w.o (fixing POST requests w/ separate VCL) T164609 [production]
09:20 <gehel> restarting elasticsearch cluster restart on codfw - T156137 [production]
08:41 <jynus> stop es1014 for reimage [production]
08:14 <marostegui> Deploy schema change on db1121 with replication, this will generate lag on labsdb hosts for s4 T144010 T51190 T199368 [production]
08:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1121 (duration: 00m 47s) [production]
08:10 <Amir1> start of ladsgroup@mwmaint1001:~$ foreachwikiindblist s4 populateChangeTagDef.php --sleep 2 (T193873) [production]
08:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 db1091 (duration: 00m 47s) [production]