451-500 of 10000 results (44ms)
2019-05-09 ยง
15:20 <marostegui> Stop mysql on db2112 for onsite work [production]
15:16 <otto@deploy1001> scap-helm eventgate-main finished [production]
15:16 <otto@deploy1001> scap-helm eventgate-main cluster eqiad completed [production]
15:16 <otto@deploy1001> scap-helm eventgate-main install -n main -f main/eqiad-values.yaml stable/eventgate [namespace: eventgate-main, clusters: eqiad] [production]
15:13 <otto@deploy1001> scap-helm eventgate-main finished [production]
15:13 <otto@deploy1001> scap-helm eventgate-main cluster codfw completed [production]
15:13 <otto@deploy1001> scap-helm eventgate-main install -n main -f main/codfw-values.yaml stable/eventgate [namespace: eventgate-main, clusters: codfw] [production]
15:12 <papaul> shurtting down db2114 for main board replacement [production]
14:53 <otto@deploy1001> scap-helm eventgate-main finished [production]
14:52 <otto@deploy1001> scap-helm eventgate-main cluster staging completed [production]
14:52 <otto@deploy1001> scap-helm eventgate-main upgrade main -f main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] [production]
14:48 <moritzm> removing unused uwsgi packages from scb* hosts [production]
14:13 <otto@deploy1001> scap-helm eventgate-main finished [production]
14:13 <otto@deploy1001> scap-helm eventgate-main cluster staging completed [production]
14:13 <otto@deploy1001> scap-helm eventgate-main upgrade main -f main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] [production]
13:34 <bblack> recdns: wiping dyna.wikimedia.org from pdns-recursors [production]
13:13 <fsero> running authdns-update for new docker-registry T221101 [production]
12:49 <fsero> switching traffic from old-registry to new registries registry[12]00[12] - T221101 [production]
12:01 <_joe_> reenabling puppet across the fleet [production]
11:57 <jbond42> all puppetmasters and puppetdbs should be restored' [production]
11:55 <jbond42> clean up old source files sudo cumin A:puppetmaster 'rm /etc/apt/sources.list.d/component-facter3.list /etc/apt/sources.list.d/component-puppet5.list' [production]
11:49 <volans> updated netbox statues for decommissioning and spare hosts according to T222352 [production]
11:23 <jbond42> running sudo apt-get install puppet-master=4.8.2-5~bpo8+1 puppet-master-passenger=4.8.2-5~bpo8+1 on labtestpuppetmaster2001 [production]
11:19 <jbond42> running sudo apt-get install facter=2.4.6-1 puppet=4.8.2-5 puppet-master puppet-master-passenger on labpuppetmaster1001 [production]
11:18 <jbond42> starting puppetdb on puppetdb2001 [production]
11:15 <jbond42> run sudo apt-get install puppetdb on puppetdb2001 [production]
11:14 <jbond42> ran the folloowing on puppetdb2001 sudo apt-get install facter=2.4.6-1 puppet=4.8.2-5 [production]
11:14 <jbond42> ran the folloowing on puppetmaster200{1,2} sudo apt-get install facter=2.4.6-1 puppet=4.8.2-5 puppet-master puppet-master-passenger [production]
11:04 <_joe_> disabling puppet across the fleet [production]
11:02 <volans> stopped ircecho to avoid spam [production]
10:43 <marostegui> Stop MySQL on db1081 [production]
10:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 57s) [production]
10:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Give API traffic to db1129 (new host on s2) (duration: 00m 57s) [production]
10:15 <_joe_> restarting low-traffic pybals in codfw, eqiad [production]
10:05 <akosiaris> restart proton on proton1001. Host Out of memory T214975 [production]
09:57 <ariel@deploy1001> Finished deploy [dumps/dumps@ab56fdd]: reduce sleep time between dumps of adds-changes wikis still more (retry) (duration: 00m 06s) [production]
09:57 <ariel@deploy1001> Started deploy [dumps/dumps@ab56fdd]: reduce sleep time between dumps of adds-changes wikis still more (retry) [production]
09:54 <ariel@deploy1001> Finished deploy [dumps/dumps@ab56fdd]: reduce sleep time between dumps of adds-changes wikis still more (duration: 00m 06s) [production]
09:54 <ariel@deploy1001> Started deploy [dumps/dumps@ab56fdd]: reduce sleep time between dumps of adds-changes wikis still more [production]
09:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1129 (new host on s2) (duration: 00m 57s) [production]
09:29 <fsero@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=docker-registry,name=codfw [production]
09:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1076 and db1129 (new host on s2) (duration: 00m 56s) [production]
09:12 <godog> bounce rsyslog on lithium [production]
09:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1076 and db1129 (new host on s2) (duration: 00m 56s) [production]
08:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1076 and db1129 (new host on s2) (duration: 00m 56s) [production]
08:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1076 and db1129 (new host on s2) (duration: 00m 57s) [production]
08:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1076 (duration: 00m 55s) [production]
08:23 <elukey> upload uwsgi 2.0.14+20161117-3+deb9u2+wmf1 packages to stretch-wikimedia - T212697 [production]
08:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Pool db1129 with low weight on s2 - T222682 (duration: 00m 56s) [production]
08:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 (duration: 00m 56s) [production]