701-750 of 10000 results (18ms)
2020-10-01 §
13:49 <klausman@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:43 <vgutierrez> use synthetic warning for 2% of ECDHE-ECDSA-AES128-SHA pageviews - T258405 [production]
13:29 <moritzm> restarting mw canaries to pick up curl update [production]
13:22 <moritzm> installing curl security updates on stretch [production]
12:57 <kormat@cumin1001> dbctl commit (dc=all): 'db2136 depooling: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12883 and previous config saved to /var/cache/conftool/dbconfig/20201001-125707-kormat.json [production]
12:56 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:56 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:39 <kormat@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 100%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12882 and previous config saved to /var/cache/conftool/dbconfig/20201001-123925-kormat.json [production]
12:24 <kormat@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 75%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12881 and previous config saved to /var/cache/conftool/dbconfig/20201001-122422-kormat.json [production]
12:15 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.11/extensions/GrowthExperiments/includes/NewcomerTasks/TemplateFilter.php: 500d0c70c84936bcdecdd0927bcbb9ff7265afa9: Prevent returning the full templatelinks table in TemplateFilter (T264029) (duration: 00m 59s) [production]
12:12 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.10/extensions/GrowthExperiments/includes/NewcomerTasks/TemplateFilter.php: 500d0c70c84936bcdecdd0927bcbb9ff7265afa9: Prevent returning the full templatelinks table in TemplateFilter (T264029) (duration: 01m 00s) [production]
12:09 <kormat@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 50%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12880 and previous config saved to /var/cache/conftool/dbconfig/20201001-120919-kormat.json [production]
11:54 <kormat@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 25%: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12879 and previous config saved to /var/cache/conftool/dbconfig/20201001-115415-kormat.json [production]
11:14 <arturo> pulling packages into reprepro for buster-wikimedia/thirdpardy/kubeadm-k8s-1-17 (T263284) [production]
11:09 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript namespaceDupes.php --wiki=kuwiktionary --fix # T262046 [production]
11:08 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 58a8c8271d75ff477ce0507ac5021edcfc2f6453: kuwiktionary: Create Jinûvesazî namespace (T262046) (duration: 01m 01s) [production]
10:47 <kormat@cumin1001> dbctl commit (dc=all): 'db2119 depooling: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12878 and previous config saved to /var/cache/conftool/dbconfig/20201001-104716-kormat.json [production]
10:47 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:47 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:55 <hnowlan> adding buster host restbase1028-b to cassandra [production]
08:53 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:38 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:37 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
08:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2109', diff saved to https://phabricator.wikimedia.org/P12877 and previous config saved to /var/cache/conftool/dbconfig/20201001-083321-marostegui.json [production]
08:28 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:27 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
08:25 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:25 <akosiaris@cumin1001> END (ERROR) - Cookbook sre.hosts.decommission (exit_code=97) [production]
08:25 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:25 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
08:25 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:25 <akosiaris@cumin1001> END (ERROR) - Cookbook sre.hosts.decommission (exit_code=97) [production]
08:22 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:22 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
08:16 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
08:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2109 ', diff saved to https://phabricator.wikimedia.org/P12875 and previous config saved to /var/cache/conftool/dbconfig/20201001-081308-marostegui.json [production]
07:53 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2091', diff saved to https://phabricator.wikimedia.org/P12874 and previous config saved to /var/cache/conftool/dbconfig/20201001-071442-marostegui.json [production]
07:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2091 ', diff saved to https://phabricator.wikimedia.org/P12873 and previous config saved to /var/cache/conftool/dbconfig/20201001-071413-marostegui.json [production]
07:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2086:3318', diff saved to https://phabricator.wikimedia.org/P12872 and previous config saved to /var/cache/conftool/dbconfig/20201001-071347-marostegui.json [production]
07:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2086:3318', diff saved to https://phabricator.wikimedia.org/P12871 and previous config saved to /var/cache/conftool/dbconfig/20201001-071321-marostegui.json [production]
07:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2083', diff saved to https://phabricator.wikimedia.org/P12870 and previous config saved to /var/cache/conftool/dbconfig/20201001-071241-marostegui.json [production]
07:12 <elukey> restart hdfs namenodes on an-worker100[1,2] to pick up new hadoop workers settings [production]
07:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2083', diff saved to https://phabricator.wikimedia.org/P12869 and previous config saved to /var/cache/conftool/dbconfig/20201001-071155-marostegui.json [production]
06:42 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=0) [production]
06:40 <elukey@cumin1001> START - Cookbook sre.hadoop.init-hadoop-workers [production]
06:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Make es2033 master of es2 T261717', diff saved to https://phabricator.wikimedia.org/P12867 and previous config saved to /var/cache/conftool/dbconfig/20201001-063104-marostegui.json [production]
06:18 <jayme> imported envoyproxy 1.15.1 to buster-wikimedia, stretch-wikimedia - T264157 [production]
05:45 <marostegui> Stop MySQL on es2011 T264261 [production]