7151-7200 of 10000 results (103ms)
2019-03-13 ยง
20:14 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@5f8e4e6]: Update mobileapps to 5865552 (7074964 d6dc3cd fbc6262) (duration: 01m 49s) [production]
20:03 <herron> increased index.mapping.total_fields.limit to 1350 on index logstash-2019.03.13 [production]
19:46 <jijiki> Pooling mw2206 - T215415 [production]
19:26 <herron> performing rolling restart of eqiad logstash instances [production]
18:51 <jijiki> Depool mw1280 and mw2206 to hardware issues - T215415 T218006 [production]
18:44 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enabling api-request logging to eventgate-analytics for group1 wikis (duration: 00m 58s) [production]
18:30 <robh> thumbor1004 memtest in progress via T215411 [production]
18:29 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
18:29 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx [production]
18:28 <ema> cp2002: depool varnish-fe after 1 hour ATS experiment T213263 [production]
18:09 <bstorm_> rebooting labstore1006 T217473 [production]
18:07 <bstorm_> downtime labstore1006 for troubleshooting T217473 [production]
17:57 <XioNoX> set interface description on fasw-c-codfw:ge-0/0/47 [production]
17:43 <XioNoX> s/29073/202425/ on AMS-IX [production]
17:34 <XioNoX> add missing sandbox1-b-eqiad interface to ospf(3) passive on cr1/2-eqiad [production]
17:19 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
17:19 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx [production]
17:18 <ema> cp2002: pool varnish-fe for user traffic, routed through ATS backends T213263 [production]
17:05 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
17:05 <otto@deploy1001> scap-helm eventgate-analytics cluster eqiad completed [production]
17:05 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] [production]
17:01 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
17:01 <otto@deploy1001> scap-helm eventgate-analytics cluster codfw completed [production]
17:01 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] [production]
16:59 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
16:58 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
16:58 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
16:56 <robh> mw2206.codfw.wmnet is being powered down for firmware update, relying on auto depool function from clean shutdown for mw api server via T215415 [production]
16:42 <robh> mw2206.codfw.wmnet is being powered down for firmware update, relying on auto depool function from clean shutdown for mw api server via T215415 [production]
16:36 <addshore> SWAT done [production]
16:36 <addshore@deploy1001> Synchronized php-1.33.0-wmf.21/includes/api/ApiMain.php: SWAT: T214080 T212529 ApiMain.php api/request logging event changes [[gerrit:496197]] (duration: 00m 57s) [production]
16:32 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:32 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
16:32 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] [production]
16:19 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:19 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
16:19 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
16:16 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] [production]
16:15 <jijiki> Depool thumbor1004 to investigate memory issues - T215411 [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver cluster eqiad completed [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver finished [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver cluster codfw completed [production]
16:04 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] [production]