2251-2300 of 10000 results (67ms)
2019-07-01 ยง
15:27 <elukey@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
15:27 <elukey@cumin1001> START - Cookbook sre.ganeti.makevm [production]
15:19 <moritzm> draining restbase2016 for eventual reboot for MDS kernel updates [production]
15:15 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:15 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:11 <moritzm> draining restbase2015 for eventual reboot for MDS kernel updates [production]
14:54 <moritzm> draining restbase2014 for eventual reboot for MDS kernel updates [production]
14:50 <moritzm> installing openjdk-8 security updates on stretch-based restbase hosts [production]
14:45 <ejegg> updated payments-wiki from 86381aeeff to 5f974d2386 [production]
14:44 <moritzm> draining restbase2013 for eventual reboot for MDS kernel updates [production]
14:41 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:41 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:25 <ema> depool cp2017 and reimage as upload_ats T226637 [production]
14:24 <moritzm> draining restbase2012 for eventual reboot for MDS kernel updates [production]
14:10 <moritzm> rolling reboot of docker registry nodes to pick up MDS-enabled qemu [production]
14:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:08 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:02 <moritzm> draining restbase2011 for eventual reboot for MDS kernel updates [production]
13:54 <moritzm> draining restbase2010 for eventual reboot for MDS kernel updates [production]
13:53 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:53 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:43 <ottomata> modified dt format of webrequest logs to use 'Z' suffix for timezone offset - T217040 [production]
13:42 <jbond42> rolling update of expat [production]
13:41 <fsero> uploading helmfile to jessie as well [production]
13:38 <moritzm> draining restbase2009 for eventual reboot for MDS kernel updates [production]
13:38 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:38 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:20 <akosiaris> repool eqiad after kubernetes upgrades. T226256 [production]
13:20 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=eqiad [production]
12:51 <akosiaris> depool eqiad for kubernetes upgrades. T226256 [production]
12:51 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=eqiad [production]
12:49 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=codfw [production]
12:49 <akosiaris> repool codfw after kubernetes upgrades. T226256 [production]
12:01 <akosiaris> depool codfw for kubernetes upgrades. T226256 [production]
12:01 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=codfw [production]
11:36 <Urbanecm> EU SWAT done [production]
11:36 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:519509|Clean up wgNamespaceAliases]] (T226765) (duration: 00m 49s) [production]
11:27 <apergos> urbanecm@deploy1001 Synchronized php-1.34.0-wmf.11/includes/: SWAT: [[:gerrit:519953|Join slot and content tables when dumping XML]] (T220493) (duration: 01m 14s) [production]
11:24 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.11/includes/: SWAT: [[:gerrit:519953|Join slot and content tables when dumping XML]] (T220493) (duration: 01m 14s) [production]
11:12 <jbond42> rolling upgrade of facter3 [production]
11:12 <jbond42> upload facter_3.11.0-2~debu9u2+wmf1 to stretch-wikimedia component/facter3 [production]
11:10 <urbanecm@deploy1001> Synchronized wmf-config/abusefilter.php: [[:gerrit:519767|Add abusefilter-view-private to checkusers on arwiki]] (T226899) (duration: 00m 49s) [production]
11:06 <urbanecm@deploy1001> Synchronized dblists/: [[:gerrit:518715|Close wikimania2018.wikimedia.org]] (T201188) (duration: 00m 49s) [production]
10:04 <elukey> remove burrow-analytics.service from kafkamon1001 (the analytics cluster has been decommed) [production]
09:55 <elukey> reboot kafkamon1001 with 4g of dedicated ram (was 8g) - T224988 [production]
09:54 <elukey> reboot kafkamon2001 with 4g of dedicated ram (was 8g) - T224988 [production]
09:54 <godog> swift eqiad-prod eqiad-prod: put back ms-be1033 - T223518 [production]
09:33 <_joe_> removing python-conftool from all hosts where it's still installed [production]
09:16 <_joe_> update python3-etcd, python3-conftool to their latest versions T226965 [production]
09:13 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:514038|Noop: Do not load InitialiseSettings-labs.php multiple times (T224899)]] (duration: 00m 51s) [production]