1401-1450 of 10000 results (80ms)
2023-04-13 §
08:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 75%: Pooling', diff saved to https://phabricator.wikimedia.org/P46652 and previous config saved to /var/cache/conftool/dbconfig/20230413-082532-root.json [production]
08:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 75%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46651 and previous config saved to /var/cache/conftool/dbconfig/20230413-081952-root.json [production]
08:12 <marostegui@cumin1001> dbctl commit (dc=all): 'db1223 (re)pooling @ 2%: Pooling db1223 T326669', diff saved to https://phabricator.wikimedia.org/P46650 and previous config saved to /var/cache/conftool/dbconfig/20230413-081227-root.json [production]
08:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 50%: Pooling', diff saved to https://phabricator.wikimedia.org/P46649 and previous config saved to /var/cache/conftool/dbconfig/20230413-081027-root.json [production]
08:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 50%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46647 and previous config saved to /var/cache/conftool/dbconfig/20230413-080447-root.json [production]
08:00 <moritzm> imported perccli 007.1910.0000.000 to bookworm-wikimedia-private T330495 [production]
07:57 <marostegui@cumin1001> dbctl commit (dc=all): 'db1223 (re)pooling @ 1%: Pooling db1223 T326669', diff saved to https://phabricator.wikimedia.org/P46646 and previous config saved to /var/cache/conftool/dbconfig/20230413-075722-root.json [production]
07:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 25%: Pooling', diff saved to https://phabricator.wikimedia.org/P46645 and previous config saved to /var/cache/conftool/dbconfig/20230413-075522-root.json [production]
07:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1223 to dbctl T326669', diff saved to https://phabricator.wikimedia.org/P46644 and previous config saved to /var/cache/conftool/dbconfig/20230413-075513-marostegui.json [production]
07:49 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 25%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46643 and previous config saved to /var/cache/conftool/dbconfig/20230413-074942-root.json [production]
07:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 10%: Pooling', diff saved to https://phabricator.wikimedia.org/P46642 and previous config saved to /var/cache/conftool/dbconfig/20230413-074010-root.json [production]
07:34 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 10%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46641 and previous config saved to /var/cache/conftool/dbconfig/20230413-073437-root.json [production]
07:27 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 10 hosts with reason: Cloning db1117 [production]
07:27 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on 10 hosts with reason: Cloning db1117 [production]
07:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 5%: Pooling', diff saved to https://phabricator.wikimedia.org/P46639 and previous config saved to /var/cache/conftool/dbconfig/20230413-072505-root.json [production]
07:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 5%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46638 and previous config saved to /var/cache/conftool/dbconfig/20230413-071932-root.json [production]
07:14 <jelto@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host gitlab2003.wikimedia.org with OS bullseye [production]
07:14 <slyngs> Puppet: move htcacheclean to httpd class https://gerrit.wikimedia.org/r/c/operations/puppet/+/904102 [production]
07:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P46637 and previous config saved to /var/cache/conftool/dbconfig/20230413-071000-root.json [production]
07:09 <moritzm> update bookworm installer to rc1 T330495 [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 4%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46636 and previous config saved to /var/cache/conftool/dbconfig/20230413-070428-root.json [production]
06:59 <jelto@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gitlab2003.wikimedia.org with reason: host reimage [production]
06:56 <jelto@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on gitlab2003.wikimedia.org with reason: host reimage [production]
06:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 3%: Pooling', diff saved to https://phabricator.wikimedia.org/P46635 and previous config saved to /var/cache/conftool/dbconfig/20230413-065456-root.json [production]
06:49 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 3%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46634 and previous config saved to /var/cache/conftool/dbconfig/20230413-064922-root.json [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1114 to clone db1214 T326669', diff saved to https://phabricator.wikimedia.org/P46632 and previous config saved to /var/cache/conftool/dbconfig/20230413-064452-marostegui.json [production]
06:43 <jelto@cumin2002> START - Cookbook sre.hosts.reimage for host gitlab2003.wikimedia.org with OS bullseye [production]
06:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 2%: Pooling', diff saved to https://phabricator.wikimedia.org/P46631 and previous config saved to /var/cache/conftool/dbconfig/20230413-063951-root.json [production]
06:34 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 2%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46630 and previous config saved to /var/cache/conftool/dbconfig/20230413-063417-root.json [production]
06:24 <marostegui@cumin1001> dbctl commit (dc=all): 'db1221 (re)pooling @ 1%: Pooling', diff saved to https://phabricator.wikimedia.org/P46629 and previous config saved to /var/cache/conftool/dbconfig/20230413-062446-root.json [production]
06:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1221 to dbctl T326669', diff saved to https://phabricator.wikimedia.org/P46628 and previous config saved to /var/cache/conftool/dbconfig/20230413-062231-marostegui.json [production]
06:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db1210 (re)pooling @ 1%: Pooling T326669', diff saved to https://phabricator.wikimedia.org/P46627 and previous config saved to /var/cache/conftool/dbconfig/20230413-061913-root.json [production]
06:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1210 to dbctl T326669', diff saved to https://phabricator.wikimedia.org/P46626 and previous config saved to /var/cache/conftool/dbconfig/20230413-061716-marostegui.json [production]
02:08 <fab@deploy2002> Finished deploy [airflow-dags/research@f8dad05]: (no justification provided) (duration: 00m 10s) [production]
02:07 <fab@deploy2002> Started deploy [airflow-dags/research@f8dad05]: (no justification provided) [production]
02:01 <fab@deploy2002> Finished deploy [airflow-dags/research@f8dad05]: (no justification provided) (duration: 00m 11s) [production]
02:01 <fab@deploy2002> Started deploy [airflow-dags/research@f8dad05]: (no justification provided) [production]
02:00 <ejegg> civicrm upgraded from 0f37f981 to 2d5ede8d [production]
01:41 <fab@deploy2002> Finished deploy [airflow-dags/research@f8dad05]: (no justification provided) (duration: 00m 10s) [production]
01:41 <fab@deploy2002> Started deploy [airflow-dags/research@f8dad05]: (no justification provided) [production]
01:23 <fab@deploy2002> Finished deploy [airflow-dags/research@f8dad05]: (no justification provided) (duration: 00m 10s) [production]
01:23 <fab@deploy2002> Started deploy [airflow-dags/research@f8dad05]: (no justification provided) [production]
00:22 <krinkle@deploy2002> Finished deploy [integration/docroot@f68055d]: (no justification provided) (duration: 00m 28s) [production]
00:21 <krinkle@deploy2002> Started deploy [integration/docroot@f68055d]: (no justification provided) [production]
2023-04-12 §
23:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T333332)', diff saved to https://phabricator.wikimedia.org/P46625 and previous config saved to /var/cache/conftool/dbconfig/20230412-230933-ladsgroup.json [production]
22:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P46624 and previous config saved to /var/cache/conftool/dbconfig/20230412-225427-ladsgroup.json [production]
22:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P46623 and previous config saved to /var/cache/conftool/dbconfig/20230412-223921-ladsgroup.json [production]
22:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T333332)', diff saved to https://phabricator.wikimedia.org/P46622 and previous config saved to /var/cache/conftool/dbconfig/20230412-222414-ladsgroup.json [production]
22:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2182 (T333332)', diff saved to https://phabricator.wikimedia.org/P46621 and previous config saved to /var/cache/conftool/dbconfig/20230412-222141-ladsgroup.json [production]
22:21 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2182.codfw.wmnet with reason: Maintenance [production]