2101-2150 of 10000 results (51ms)
2022-03-07 §
06:08 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1164.eqiad.wmnet with reason: Maintenance [production]
06:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T300992)', diff saved to https://phabricator.wikimedia.org/P21863 and previous config saved to /var/cache/conftool/dbconfig/20220307-060811-ladsgroup.json [production]
05:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P21862 and previous config saved to /var/cache/conftool/dbconfig/20220307-055307-ladsgroup.json [production]
05:51 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1147.eqiad.wmnet with OS bullseye [production]
05:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169', diff saved to https://phabricator.wikimedia.org/P21861 and previous config saved to /var/cache/conftool/dbconfig/20220307-053802-ladsgroup.json [production]
05:36 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1147.eqiad.wmnet with reason: host reimage [production]
05:33 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1147.eqiad.wmnet with reason: host reimage [production]
05:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1169 (T300992)', diff saved to https://phabricator.wikimedia.org/P21860 and previous config saved to /var/cache/conftool/dbconfig/20220307-052257-ladsgroup.json [production]
05:22 <ladsgroup@cumin1001> START - Cookbook sre.hosts.reimage for host db1147.eqiad.wmnet with OS bullseye [production]
05:18 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1169 (T300992)', diff saved to https://phabricator.wikimedia.org/P21859 and previous config saved to /var/cache/conftool/dbconfig/20220307-051807-ladsgroup.json [production]
05:18 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
05:18 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
05:15 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1147 (T302950)', diff saved to https://phabricator.wikimedia.org/P21858 and previous config saved to /var/cache/conftool/dbconfig/20220307-051537-ladsgroup.json [production]
05:15 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
05:15 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1147.eqiad.wmnet with reason: Maintenance [production]
05:14 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
05:14 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
2022-03-04 §
17:59 <btullis@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:57 <btullis@cumin1001> START - Cookbook sre.dns.netbox [production]
17:57 <btullis@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:48 <btullis@cumin1001> START - Cookbook sre.dns.netbox [production]
17:46 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@19520c1]: (no justification provided) (duration: 00m 07s) [production]
17:46 <mforns@deploy1002> Started deploy [airflow-dags/analytics@19520c1]: (no justification provided) [production]
17:39 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@19520c1]: (no justification provided) (duration: 00m 08s) [production]
17:39 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@19520c1]: (no justification provided) [production]
17:09 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) (duration: 00m 08s) [production]
17:09 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) [production]
16:35 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) (duration: 00m 07s) [production]
16:35 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) [production]
16:13 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) (duration: 00m 10s) [production]
16:13 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) [production]
16:06 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1116.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1116.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1005.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1005.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3318 (T300992)', diff saved to https://phabricator.wikimedia.org/P21856 and previous config saved to /var/cache/conftool/dbconfig/20220304-160629-ladsgroup.json [production]
16:03 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) (duration: 00m 03s) [production]
16:03 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) [production]
15:59 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1086.eqiad.wmnet with OS buster [production]
15:58 <vgutierrez> pool cp1086 with HAProxy as TLS termination layer - T290005 [production]
15:56 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2038.codfw.wmnet with OS buster [production]
15:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3318', diff saved to https://phabricator.wikimedia.org/P21854 and previous config saved to /var/cache/conftool/dbconfig/20220304-155124-ladsgroup.json [production]
15:51 <vgutierrez> pool cp2038 with HAProxy as TLS termination layer - T290005 [production]
15:49 <mforns@deploy1002> Finished deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) (duration: 00m 07s) [production]
15:49 <mforns@deploy1002> Started deploy [airflow-dags/analytics_test@1388c61]: (no justification provided) [production]
15:41 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1086.eqiad.wmnet with reason: host reimage [production]
15:38 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1086.eqiad.wmnet with reason: host reimage [production]
15:37 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2038.codfw.wmnet with reason: host reimage [production]
15:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1099:3318', diff saved to https://phabricator.wikimedia.org/P21852 and previous config saved to /var/cache/conftool/dbconfig/20220304-153619-ladsgroup.json [production]
15:34 <XioNoX> blackhole IPs - T303055 [production]