2301-2350 of 10000 results (52ms)
2018-08-07 ยง
19:45 <herron> upload prometheus-logstash-exporter_0.1.2-1 to apt.wikimedia.org/jessie-wikimedia/main [production]
19:45 <herron> upload prometheus-logstash-exporter_0.1.2-1 to apt.wikimedia.org/stretch-wikimedia/main [production]
19:36 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.32.0-wmf.16 refs T191062 [production]
19:30 <andrewbogott> shutting down labnodepool1002 in advance of a rename. T201439 [production]
19:09 <otto@deploy1001> Finished deploy [eventstreams/deploy@07033d4]: Deploying eventstreams with timestamp in Last-Event-ID (all nodes) (duration: 01m 51s) [production]
19:07 <otto@deploy1001> Started deploy [eventstreams/deploy@07033d4]: Deploying eventstreams with timestamp in Last-Event-ID (all nodes) [production]
19:07 <otto@deploy1001> Finished deploy [eventstreams/deploy@07033d4]: Deploying eventstreams with timestamp in Last-Event-ID (scb2001 only) (duration: 00m 20s) [production]
19:06 <otto@deploy1001> Started deploy [eventstreams/deploy@07033d4]: Deploying eventstreams with timestamp in Last-Event-ID (scb2001 only) [production]
19:03 <twentyafterfour> Branching 1.32.0-wmf.16 [production]
18:24 <mutante> netbox - restored database from dump file - backed up and back-up (T190184) [production]
18:13 <mutante> netbox - temp dropped databae to test restoring from dump [production]
18:02 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1063.eqiad.wmnet [production]
18:02 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1076.eqiad.wmnet [production]
16:51 <hoo> Deployed patch for T201418 [production]
16:50 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@22a50af]: bump to master, prep for deploy to cirrus servers, take two (duration: 01m 51s) [production]
16:48 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@22a50af]: bump to master, prep for deploy to cirrus servers, take two [production]
16:47 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1052.eqiad.wmnet [production]
16:47 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1075.eqiad.wmnet [production]
16:44 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@65e6bb9]: bump to master, prep for deploy to cirrus servers (duration: 02m 54s) [production]
16:41 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@65e6bb9]: bump to master, prep for deploy to cirrus servers [production]
15:55 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1019, db1122 and db1081 with full weight (duration: 00m 51s) [production]
15:26 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1053.eqiad.wmnet [production]
15:26 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1077.eqiad.wmnet [production]
14:58 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1054.eqiad.wmnet [production]
14:57 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1079.eqiad.wmnet [production]
14:57 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1064.eqiad.wmnet [production]
14:57 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1078.eqiad.wmnet [production]
14:26 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1081 with low load (duration: 00m 47s) [production]
14:18 <herron> double again logstash jvm heap size to 1g and rolling restart logstash instances [production]
14:18 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool es1019 and db1102 with low load after maintenance (duration: 00m 52s) [production]
14:11 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1055.eqiad.wmnet,service=varnish-be [production]
14:11 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1081.eqiad.wmnet,service=varnish-be [production]
14:11 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1071.eqiad.wmnet,service=varnish-be [production]
14:11 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1082.eqiad.wmnet,service=varnish-be [production]
13:42 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1055.eqiad.wmnet,service=varnish-fe [production]
13:42 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1081.eqiad.wmnet,service=varnish-fe [production]
13:41 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1071.eqiad.wmnet,service=varnish-fe [production]
13:41 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1082.eqiad.wmnet,service=varnish-fe [production]
13:39 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1072.eqiad.wmnet [production]
13:39 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1084.eqiad.wmnet [production]
13:39 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1065.eqiad.wmnet [production]
13:39 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1083.eqiad.wmnet [production]
13:37 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1055.eqiad.wmnet,service=nginx [production]
13:37 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1081.eqiad.wmnet,service=nginx [production]
13:36 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp1071.eqiad.wmnet,service=nginx [production]
13:36 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp1082.eqiad.wmnet,service=nginx [production]
13:10 <otto@deploy1001> Started restart [analytics/aqs/deploy@6fafc63]: Bouncing AQS for mediawiki_history index update [production]
12:58 <vgutierrez@puppetmaster1001> conftool action : set/pooled=no; selector: name=hydrogen.wikimedia.org [production]
12:58 <vgutierrez@puppetmaster1001> conftool action : set/pooled=no; selector: name=chromium.wikimedia.org [production]
12:52 <bblack> rebooting authdns1001 [production]