1501-1550 of 10000 results (61ms)
2019-06-20 ยง
14:56 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: name=kubernetes2005.* [production]
14:54 <jeh> T101631 updating replica views on labsdb1010 [production]
14:47 <jeh> T101631 updating replica views on labsdb1011 [production]
14:41 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: dc=codfw,cluster=kubernetes,service=eventgate-main,name=kubernetes2001.codfw.wmnet [production]
14:36 <jeh> T101631 updating replica views on labsdb1012 [production]
14:28 <Amir1> end of ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=testwikidatawiki --batch-size=100 --sleep=3 (T225052) [production]
14:22 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:517669|Set EntityUsageTable addUsage batch size to 150 (T225500)]] (duration: 00m 56s) [production]
14:18 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
14:18 <Amir1> start of ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=testwikidatawiki --batch-size=100 --sleep=3 (T225052) [production]
14:16 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: dc=codfw,cluster=kubernetes,service=eventgate-analytics,name=kubernetes2001.codfw.wmnet [production]
14:16 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: name=kubernetes2001.* [production]
14:14 <ladsgroup@deploy1001> Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:518028|Switch property terms migration to WRITE_BOTH on test wikidata (T225051)]] (duration: 00m 56s) [production]
14:14 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: dc=codfw,cluster=kubernetes,service=eventgate-main,name=kubernetes2001.codfw.wmnet [production]
14:14 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
14:13 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=kubernetes,service=eventgate-analytics,name=kubernetes2001.codfw.wmnet [production]
14:12 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=kubernetes,service=eventgate-main,name=kubernetes2001.codfw.wmnet [production]
14:11 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
14:10 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: name=kubernetes2001.* [production]
14:09 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:518028|Switch property terms migration to WRITE_BOTH on test wikidata (T225051)]] (duration: 00m 56s) [production]
14:06 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
14:04 <ema@cumin1001> END (FAIL) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=99) [production]
13:58 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:56 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:50 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:38 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:35 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:31 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:28 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:23 <marostegui> Stop replication on labsdb1011 to defragment tables T222978 [production]
13:22 <ema@cumin1001> END (FAIL) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=99) [production]
13:21 <jijiki> depool mw1311 [production]
13:20 <marostegui> Reload haproxy on dbproxy1010 and dbproxy1011 to depool labsdb1011 - T222978 [production]
13:16 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
13:11 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
13:04 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
12:59 <jijiki> Disable puppet on jobrunners to merge 518023 and 518018 [production]
12:56 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
12:50 <ema> powercycle cp2017, stuck rebooting [production]
12:44 <hashar> Upgrading packages on contint1001 [production]
12:44 <ema@cumin1001> END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) [production]
12:40 <hashar> Upgrading java/jenkins on releases* hosts # T226159 [production]
12:37 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
12:36 <ema@cumin1001> START - Cookbook sre.hosts.upgrade-and-reboot [production]
12:36 <moritzm> updated jenkins package on apt.wikimedia.org to 2.176.1 for jessie and stretch (T226159) [production]
11:54 <Amir1> EU SWAT is done [production]
11:49 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:517820|Switch property terms migration to WRITE_BOTH on test wikidata (T225051)]] (duration: 00m 58s) [production]
11:42 <ladsgroup@deploy1001> Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:517819|Introduce config variables for new terms store in mediawiki-config (T226086)]], Part II (duration: 00m 57s) [production]
11:39 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:517819|Introduce config variables for new terms store in mediawiki-config (T226086)]] (duration: 00m 57s) [production]
11:20 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:504261|Remove ExternalGuidanceEnableContentDetection]] (T219819) (duration: 01m 00s) [production]
11:14 <moritzm> rebooting mw2235, mw2255, mw2271 for MDS kernel update [production]