751-800 of 10000 results (51ms)
2018-12-18 ยง
23:49 <XioNoX> remove BGP session to AS50629 from cr2-esams (not in AMS-IX anymore) [production]
20:33 <otto@deploy1001> Finished deploy [eventlogging/analytics@104adb5]: Send JSON string of event for validation errors in EventError (duration: 00m 04s) [production]
20:33 <otto@deploy1001> Started deploy [eventlogging/analytics@104adb5]: Send JSON string of event for validation errors in EventError [production]
19:43 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@963d704]: Parse summaries from lead objects only (T202642) (duration: 05m 26s) [production]
19:38 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@963d704]: Parse summaries from lead objects only (T202642) [production]
19:30 <robh> migration of ulsfo pdus complete [production]
19:19 <sbisson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:480106|Production configuration for GrowthExperiments Help Panel]] (duration: 00m 52s) [production]
19:06 <XioNoX> redirect ns1 back to authdns2001 - T210447 [production]
18:51 <moritzm> installing libx11 security updates [production]
18:48 <XioNoX> depool ulsfo - T209101 [production]
18:42 <XioNoX> repool codfw - T210447 [production]
18:40 <XioNoX> Revert "Redirect eqsin/ulsfo caches to eqiad" - T210447 [production]
18:05 <chasemp> stat1004:~# umount /mnt/T211327 [production]
17:58 <XioNoX> shutdown fpc4 for replacement - T210447 [production]
17:51 <bblack> deploying php7 cache-splitter patch to cache_text - https://gerrit.wikimedia.org/r/c/operations/puppet/+/478680 - T206339 [production]
17:49 <godog> bounce rsyslog on lithium, tls listener timeout [production]
17:34 <volans> triggered restart of ircecho on icinga1001 while applying https://gerrit.wikimedia.org/r/480509 [production]
16:37 <jijiki> librsvg* 2.40.20-3+wmf1+stretch1 uploaded to components/thumor to stretch-wikimedia - T209886 [production]
16:22 <bblack> powercycle cp1075 from console (crashed, apparently) [production]
16:07 <XioNoX> starting codfw row A recabling - T210447 [production]
16:05 <ejegg> updated fundraising python tools from af5dbee8eb to 5f44d9dd43 [production]
15:53 <XioNoX> redirect ns1 to authdns1001 for T210447 [production]
15:47 <XioNoX> redirect eqsin/ulsfo caches to eqiad for T210447 [production]
15:44 <XioNoX> depool codfw for T210447 [production]
15:30 <akosiaris> empty ganeti2005, ganeti2006 for T210447 [production]
15:16 <Amir1> mwscript extensions/WikibaseQualityConstraints/maintenance/ImportConstraintEntities.php --wiki=testwikidatawiki --config-format=wgConf | tee WikibaseQualityConstraints-config.php [production]
14:55 <akosiaris> restart pybal on lvs1006, lvs2003 for blubberoid LVS deployment. T205919 [production]
14:40 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.9 [production]
14:26 <akosiaris> restart ircecho, seems to have croaked with Dec 17 19:39:52 icinga1001 ircecho[861]: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 174: ordinal not in range(128) [production]
14:25 <zfilipin@deploy1001> Finished scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache (duration: 34m 11s) [production]
14:15 <akosiaris> restart pybal on lvs1016, lvs2006 for blubberoid LVS deployment. T205919 [production]
13:51 <zfilipin@deploy1001> Started scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache [production]
13:48 <zfilipin@deploy1001> Pruned MediaWiki: 1.33.0-wmf.4 (duration: 11m 13s) [production]
13:12 <addshore@deploy1001> Synchronized php-1.33.0-wmf.8/extensions/Wikibase/lib/includes/Formatters/ControlledFallbackEntityIdFormatter.php: T201930 ControlledFallbackEntityIdFormatter, track unique value formats (duration: 00m 46s) [production]
12:52 <Amir1> deployed a patch on wmf.8 for T207814 [production]
12:41 <filippo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 45s) [production]
12:17 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478630|Perform even more PHP constraint checks before falling back (T209504)]] (duration: 00m 46s) [production]
12:16 <moritzm> installing fuse updates from stretch point release [production]
11:41 <moritzm> installing remaining libgd2 security updates [production]
09:38 <godog> swift eqiad-prod: initial weights for ms-be10[44-50].eqiad.wmnet - T209618 [production]
08:44 <marostegui> Enable GTID on s7 codfw master (db2040) - T211973 [production]
08:26 <marostegui> Enable GTID on es3 - T211973 [production]
08:23 <marostegui> Enable GTID on es2 - T211973 [production]
07:57 <elukey> restart cassandra-{a,b} on aqs1004 for openjdk upgrades [production]
07:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1078 T86338 T202167 (duration: 00m 45s) [production]
07:49 <marostegui> Deploy schema change on db1075 (s3 master) T86338 T202167 [production]
06:07 <marostegui> Deploy schema change on db1078 T86338 T202167 [production]
06:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1078 T86338 T202167 (duration: 00m 45s) [production]
06:03 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2038 after mysql and kernel upgrade (duration: 00m 47s) [production]
00:13 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:479997|Disable MediaViewer thumbnail URL guessing for private wikis (T212099)]] (duration: 00m 45s) [production]