5351-5400 of 10000 results (77ms)
2019-04-16 ยง
13:42 <gehel@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
13:41 <gehel@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
13:39 <gehel> restetting cookbooks repo on cumin1001 (local changes) [production]
13:34 <jijiki> Disabling puppet on thumbor* to merge 504284 [production]
13:13 <ema> cp-ats: upgrade fifo-log-demux to 0.2 and restart services [production]
13:10 <ema> fifo-log-demux 0.2 uploaded to stretch-wikimedia [production]
13:03 <arturo> T220095 renaming/reimaging labtestcontrol2003 as cloudcontrol2003-dev [production]
12:58 <moritzm> installing ghostscript update on thumbor1001 [production]
12:54 <gehel> cleanup redundant prometheus-elasticsearch units on elasticsearch servers [production]
12:52 <godog> swift eqiad-prod continue ms-be1013 decom - T220590 [production]
12:17 <moritzm> installing OpenSSL 1.0.2 updates on cp* Varnish hosts [production]
12:07 <arturo> rebooting cloudvirt200[123]-dev because deep changes in config [production]
11:18 <hoo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add wgWikibaseMusicalNotationLineWidthInches to config (T218191) (duration: 00m 52s) [production]
11:10 <hoo@deploy1001> Synchronized wmf-config/Wikibase.php: Revert "WikibaseClient: Conditionally enable mapframe support" (T218051) (duration: 00m 51s) [production]
11:07 <hoo@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable signatures in 2019: NS (ID 128) for wikimaniawiki (T221062) (duration: 00m 52s) [production]
10:49 <gilles> T221065 eswiki purge finished [production]
10:45 <moritzm> installing libjs-bootstrap updates from Stretch point release [production]
10:21 <gilles> T221065 mwscript purgeList.php eswiki --all --verbose on mwmaint1002 [production]
10:21 <moritzm> installing xapian-core update from stretch point release [production]
10:18 <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T221065 Set up origin trials on Spanish Wikipedia mobile site (duration: 00m 52s) [production]
09:59 <jijiki> Enabling puppet again on on dbproxy* and thumbor* [production]
09:51 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Reduce db1078 load (duration: 00m 53s) [production]
09:37 <jijiki> Disabling puppet on dbproxy* and thumbor* to merge 502972 [production]
09:26 <fsero> [late logging] swift container-to-container synchronization enabled between docker_registry_eqiad and docker_registry_codfw swift containers at 08:15:00 UTC [production]
09:05 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp1076.eqiad.wmnet,service=varnish-fe [production]
09:05 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp1076.eqiad.wmnet,service=nginx [production]
09:05 <ema> cp1076: repool varnish-fe pointing to Varnish T213263 [production]
08:57 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp1076.eqiad.wmnet,service=varnish-fe [production]
08:57 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp1076.eqiad.wmnet,service=nginx [production]
08:57 <ema> cp1076: depool varnish-fe in preparation of traffic switchback to Varnish T213263 [production]
08:40 <hoo> Updated the Wikidata property suggester with data from the 2019-04-08 JSON dump and applied the T132839 workarounds [production]
08:33 <moritzm> rebooting ms-be1020 for combined kernel/glibc/OpenSSL update [production]
08:01 <moritzm> rebooting Swift frontends in codfw for combined kernel/glibc/OpenSSL security updates [production]
07:50 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
07:50 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx [production]
07:50 <ema> cp2002: repool varnish-fe pointing to Varnish T213263 [production]
07:47 <moritzm> rebooting Swift frontends in eqiad combined kernel/glibc/OpenSSL security updates [production]
07:45 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
07:45 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx [production]
07:45 <ema> cp2002: depool varnish-fe in preparation of traffic switchback to Varnish T213263 [production]
07:36 <marostegui> Upgrade db2093 [production]
07:33 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2005.codfw.wmnet,service=varnish-fe [production]
07:33 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2005.codfw.wmnet,service=nginx [production]
07:32 <ema> cp2005: repool varnish-fe pointing to Varnish T213263 [production]
07:25 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2005.codfw.wmnet,service=varnish-fe [production]
07:25 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2005.codfw.wmnet,service=nginx [production]
07:25 <ema> cp2005: depool varnish-fe in preparation of traffic switchback to Varnish T213263 [production]
07:11 <moritzm> upgrading Java on Hadoop/Kafka/Jumbo/Druid clusters [production]
05:02 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool pc1007 (duration: 00m 31s) [production]
01:46 <aaron@deploy1001> Synchronized php-1.33.0-wmf.25/includes/parser/Parser.php: 73529ae6c5ffb6 (duration: 00m 53s) [production]