301-350 of 10000 results (46ms)
2022-09-08 ยง
14:20 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
14:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 100%: Will do maint later', diff saved to https://phabricator.wikimedia.org/P34312 and previous config saved to /var/cache/conftool/dbconfig/20220908-142029-ladsgroup.json [production]
14:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 100%: Maint over long time ago', diff saved to https://phabricator.wikimedia.org/P34311 and previous config saved to /var/cache/conftool/dbconfig/20220908-141600-ladsgroup.json [production]
14:07 <cgoubert@cumin1001> START - Cookbook sre.hosts.decommission for hosts wtp[1038-1042].eqiad.wmnet [production]
14:06 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wtp1037.eqiad.wmnet [production]
14:06 <cgoubert@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:05 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 75%: Will do maint later', diff saved to https://phabricator.wikimedia.org/P34310 and previous config saved to /var/cache/conftool/dbconfig/20220908-140524-ladsgroup.json [production]
14:04 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
14:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 75%: Maint over long time ago', diff saved to https://phabricator.wikimedia.org/P34309 and previous config saved to /var/cache/conftool/dbconfig/20220908-140055-ladsgroup.json [production]
14:00 <papaul> on going maintenance on mr1-codfw [production]
13:57 <cgoubert@cumin1001> START - Cookbook sre.hosts.decommission for hosts wtp1037.eqiad.wmnet [production]
13:55 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wtp1036.eqiad.wmnet [production]
13:55 <cgoubert@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:53 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
13:51 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
13:50 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 25%: Will do maint later', diff saved to https://phabricator.wikimedia.org/P34307 and previous config saved to /var/cache/conftool/dbconfig/20220908-135019-ladsgroup.json [production]
13:47 <cgoubert@cumin1001> START - Cookbook sre.hosts.decommission for hosts wtp1036.eqiad.wmnet [production]
13:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 25%: Maint over long time ago', diff saved to https://phabricator.wikimedia.org/P34305 and previous config saved to /var/cache/conftool/dbconfig/20220908-134550-ladsgroup.json [production]
13:43 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wtp1035.eqiad.wmnet [production]
13:43 <cgoubert@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:43 <vgutierrez> rolling upgrade to ats 9 in cp drmrs - T309651 [production]
13:41 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
13:39 <vgutierrez> disable puppet on A:cp-drmrs during the update to ATS 9.1.3 - T309651 [production]
13:36 <cgoubert@cumin1001> START - Cookbook sre.hosts.decommission for hosts wtp1035.eqiad.wmnet [production]
13:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 10%: Will do maint later', diff saved to https://phabricator.wikimedia.org/P34304 and previous config saved to /var/cache/conftool/dbconfig/20220908-133514-ladsgroup.json [production]
13:31 <cgoubert@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts wtp1034.eqiad.wmnet [production]
13:31 <cgoubert@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:30 <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 10%: Maint over long time ago', diff saved to https://phabricator.wikimedia.org/P34303 and previous config saved to /var/cache/conftool/dbconfig/20220908-133045-ladsgroup.json [production]
13:30 <marostegui@cumin1001> dbctl commit (dc=all): 'es1031 (re)pooling @ 100%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34302 and previous config saved to /var/cache/conftool/dbconfig/20220908-133036-root.json [production]
13:30 <marostegui@cumin1001> dbctl commit (dc=all): 'es1030 (re)pooling @ 100%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34301 and previous config saved to /var/cache/conftool/dbconfig/20220908-133031-root.json [production]
13:30 <marostegui@cumin1001> dbctl commit (dc=all): 'es1029 (re)pooling @ 100%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34300 and previous config saved to /var/cache/conftool/dbconfig/20220908-133024-root.json [production]
13:29 <moritzm> installing apache2 security updates on Bullseye [production]
13:28 <cgoubert@cumin1001> START - Cookbook sre.dns.netbox [production]
13:23 <cgoubert@cumin1001> START - Cookbook sre.hosts.decommission for hosts wtp1034.eqiad.wmnet [production]
13:15 <marostegui@cumin1001> dbctl commit (dc=all): 'es1031 (re)pooling @ 75%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34299 and previous config saved to /var/cache/conftool/dbconfig/20220908-131531-root.json [production]
13:15 <marostegui@cumin1001> dbctl commit (dc=all): 'es1030 (re)pooling @ 75%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34298 and previous config saved to /var/cache/conftool/dbconfig/20220908-131526-root.json [production]
13:15 <marostegui@cumin1001> dbctl commit (dc=all): 'es1029 (re)pooling @ 75%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34297 and previous config saved to /var/cache/conftool/dbconfig/20220908-131519-root.json [production]
13:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1031 (re)pooling @ 50%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34296 and previous config saved to /var/cache/conftool/dbconfig/20220908-130026-root.json [production]
13:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1030 (re)pooling @ 50%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34295 and previous config saved to /var/cache/conftool/dbconfig/20220908-130021-root.json [production]
13:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1029 (re)pooling @ 50%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34294 and previous config saved to /var/cache/conftool/dbconfig/20220908-130014-root.json [production]
12:56 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@9e4ed94]: (no justification provided) (duration: 00m 09s) [production]
12:56 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@9e4ed94]: (no justification provided) [production]
12:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1031 (re)pooling @ 25%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34293 and previous config saved to /var/cache/conftool/dbconfig/20220908-124521-root.json [production]
12:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1030 (re)pooling @ 25%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34292 and previous config saved to /var/cache/conftool/dbconfig/20220908-124516-root.json [production]
12:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1029 (re)pooling @ 25%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34291 and previous config saved to /var/cache/conftool/dbconfig/20220908-124509-root.json [production]
12:42 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@9e4ed94]: (no justification provided) (duration: 00m 09s) [production]
12:42 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@9e4ed94]: (no justification provided) [production]
12:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Promote es1027 to es1 eqiad master, promote es1026 to es2 eqiad master, promote es1028 to es3 eqiad master', diff saved to https://phabricator.wikimedia.org/P34290 and previous config saved to /var/cache/conftool/dbconfig/20220908-123955-marostegui.json [production]
12:30 <marostegui@cumin1001> dbctl commit (dc=all): 'es1031 (re)pooling @ 10%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34289 and previous config saved to /var/cache/conftool/dbconfig/20220908-123016-root.json [production]
12:30 <marostegui@cumin1001> dbctl commit (dc=all): 'es1030 (re)pooling @ 10%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34288 and previous config saved to /var/cache/conftool/dbconfig/20220908-123011-root.json [production]