951-1000 of 10000 results (58ms)
2019-07-01 §
13:43 <ottomata> modified dt format of webrequest logs to use 'Z' suffix for timezone offset - T217040 [production]
13:42 <jbond42> rolling update of expat [production]
13:41 <fsero> uploading helmfile to jessie as well [production]
13:38 <moritzm> draining restbase2009 for eventual reboot for MDS kernel updates [production]
13:38 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:38 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:20 <akosiaris> repool eqiad after kubernetes upgrades. T226256 [production]
13:20 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=eqiad [production]
12:51 <akosiaris> depool eqiad for kubernetes upgrades. T226256 [production]
12:51 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=eqiad [production]
12:49 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=codfw [production]
12:49 <akosiaris> repool codfw after kubernetes upgrades. T226256 [production]
12:01 <akosiaris> depool codfw for kubernetes upgrades. T226256 [production]
12:01 <akosiaris@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=sessionstore|citoid|cxserver|eventgate-analytics|eventgate-main|termbox|blubberoid|mathoid|zotero,name=codfw [production]
11:36 <Urbanecm> EU SWAT done [production]
11:36 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[:gerrit:519509|Clean up wgNamespaceAliases]] (T226765) (duration: 00m 49s) [production]
11:27 <apergos> urbanecm@deploy1001 Synchronized php-1.34.0-wmf.11/includes/: SWAT: [[:gerrit:519953|Join slot and content tables when dumping XML]] (T220493) (duration: 01m 14s) [production]
11:24 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.11/includes/: SWAT: [[:gerrit:519953|Join slot and content tables when dumping XML]] (T220493) (duration: 01m 14s) [production]
11:12 <jbond42> rolling upgrade of facter3 [production]
11:12 <jbond42> upload facter_3.11.0-2~debu9u2+wmf1 to stretch-wikimedia component/facter3 [production]
11:10 <urbanecm@deploy1001> Synchronized wmf-config/abusefilter.php: [[:gerrit:519767|Add abusefilter-view-private to checkusers on arwiki]] (T226899) (duration: 00m 49s) [production]
11:06 <urbanecm@deploy1001> Synchronized dblists/: [[:gerrit:518715|Close wikimania2018.wikimedia.org]] (T201188) (duration: 00m 49s) [production]
10:04 <elukey> remove burrow-analytics.service from kafkamon1001 (the analytics cluster has been decommed) [production]
09:55 <elukey> reboot kafkamon1001 with 4g of dedicated ram (was 8g) - T224988 [production]
09:54 <elukey> reboot kafkamon2001 with 4g of dedicated ram (was 8g) - T224988 [production]
09:54 <godog> swift eqiad-prod eqiad-prod: put back ms-be1033 - T223518 [production]
09:33 <_joe_> removing python-conftool from all hosts where it's still installed [production]
09:16 <_joe_> update python3-etcd, python3-conftool to their latest versions T226965 [production]
09:13 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:514038|Noop: Do not load InitialiseSettings-labs.php multiple times (T224899)]] (duration: 00m 51s) [production]
08:39 <elukey> restart hadoop-yarn-nodemanager on all hadoop workers to pick up new jvm settings - T225296 [production]
07:04 <ema> pool cp2014 w/ ATS backend T226637 [production]
06:16 <ema> depool cp2014 and reimage as upload_ats T226637 [production]
04:53 <marostegui> Keep compressing tables on labsdb1011 - T222978 [production]
04:50 <marostegui> Reload haproxy on dbproxy1010 and dbproxy1011 to depool labsdb1011 - T222978 [production]
04:49 <marostegui> Change pt-kill value on labsdb1009 temporarily, from 300 to 14400 T222978 [production]
2019-06-30 §
23:27 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 45s) [production]
07:05 <Urbanecm> Remove 2FA from User:SQL (T226918) [production]
2019-06-28 §
21:19 <otto@deploy1001> Finished deploy [eventstreams/deploy@2af2719]: Manually blacklisting IP - T226808 (duration: 03m 07s) [production]
21:16 <otto@deploy1001> Started deploy [eventstreams/deploy@2af2719]: Manually blacklisting IP - T226808 [production]
20:09 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/Wikibase/repo/RepoHooks.php: Make it possible for File pages to be moved on Commons again T224303 T226672 (duration: 00m 50s) [production]
19:49 <jforrester@deploy1001> Synchronized wmf-config/mobile.php: T221196 VE mobile A/B test part 2 (duration: 00m 49s) [production]
19:48 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T221196 VE mobile A/B test part 1 (duration: 00m 50s) [production]
19:05 <joal@deploy1001> Finished deploy [analytics/refinery@de8eb99]: Missing bit of regular analytics deploy (duration: 02m 08s) [production]
19:03 <joal@deploy1001> Started deploy [analytics/refinery@de8eb99]: Missing bit of regular analytics deploy [production]
18:51 <joal@deploy1001> Finished deploy [analytics/refinery@de8eb99]: Missing bit of regular analytics deploy (duration: 17m 47s) [production]
18:33 <joal@deploy1001> Started deploy [analytics/refinery@de8eb99]: Missing bit of regular analytics deploy [production]
18:14 <joal@deploy1001> Finished deploy [analytics/refinery@8d6fa30]: Late regular analytics weekly deploy - notebook1004 only (duration: 01m 03s) [production]
18:13 <joal@deploy1001> Started deploy [analytics/refinery@8d6fa30]: Late regular analytics weekly deploy - notebook1004 only [production]
18:12 <elukey> systemctl reset-failed kafka* units on kafka2001 (in decom phase) [production]
18:12 <joal@deploy1001> Finished deploy [analytics/refinery@8d6fa30]: Late regular analytics weekly deploy - notebook1003 only again (duration: 00m 26s) [production]