51-100 of 10000 results (26ms)
2021-12-22 §
17:01 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
17:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
16:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
16:53 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
16:50 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
16:50 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
16:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
15:37 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@f1522be]: (no justification provided) (duration: 00m 06s) [production]
15:37 <mforns@deploy1002> Started deploy [airflow-dags/analytics@f1522be]: (no justification provided) [production]
15:24 <mforns@deploy1002> Finished deploy [analytics/refinery@fcf104e] (hadoop-test): Adhoc train for anomaly detection queries TEST [analytics/refinery@fcf104e] (duration: 06m 44s) [production]
15:17 <mforns@deploy1002> Started deploy [analytics/refinery@fcf104e] (hadoop-test): Adhoc train for anomaly detection queries TEST [analytics/refinery@fcf104e] [production]
15:17 <mforns@deploy1002> Finished deploy [analytics/refinery@fcf104e] (thin): Adhoc train for anomaly detection queries THIN [analytics/refinery@fcf104e] (duration: 00m 07s) [production]
15:17 <mforns@deploy1002> Started deploy [analytics/refinery@fcf104e] (thin): Adhoc train for anomaly detection queries THIN [analytics/refinery@fcf104e] [production]
15:15 <mforns@deploy1002> Finished deploy [analytics/refinery@fcf104e]: Adhoc train for anomaly detection queries [analytics/refinery@fcf104e] (duration: 21m 25s) [production]
14:54 <mforns@deploy1002> Started deploy [analytics/refinery@fcf104e]: Adhoc train for anomaly detection queries [analytics/refinery@fcf104e] [production]
12:31 <mutante> LDAP added uid=zabe to group nda (T297323) [production]
02:38 <legoktm> restarted zuul on contint2001, was totally stuck. (T298177) [production]
2021-12-21 §
22:53 <eileen> civicrm rev:aa90dd3a conf:449c8de8 [production]
21:42 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1028.eqiad.wmnet with OS buster [production]
21:39 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1026.eqiad.wmnet with OS buster [production]
21:37 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1027.eqiad.wmnet with OS buster [production]
21:17 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1028.eqiad.wmnet with OS buster [production]
21:14 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1026.eqiad.wmnet with OS buster [production]
21:13 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1027.eqiad.wmnet with OS buster [production]
21:10 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti1026.eqiad.wmnet with OS buster [production]
21:00 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti1028.eqiad.wmnet with OS buster [production]
20:59 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti1027.eqiad.wmnet with OS buster [production]
20:54 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1025.eqiad.wmnet with OS buster [production]
20:32 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@053bfc0]: (no justification provided) (duration: 00m 06s) [production]
20:32 <mforns@deploy1002> Started deploy [airflow-dags/analytics@053bfc0]: (no justification provided) [production]
20:30 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1028.eqiad.wmnet with OS buster [production]
20:30 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ganeti1028.eqiad.wmnet with OS buster [production]
20:30 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1026.eqiad.wmnet with OS buster [production]
20:30 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ganeti1026.eqiad.wmnet with OS buster [production]
20:29 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1025.eqiad.wmnet with OS buster [production]
20:29 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ganeti1025.eqiad.wmnet with OS buster [production]
20:29 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1027.eqiad.wmnet with OS buster [production]
20:29 <cmjohnson@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ganeti1027.eqiad.wmnet with OS buster [production]
20:13 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1028.eqiad.wmnet with OS buster [production]
20:12 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1027.eqiad.wmnet with OS buster [production]
20:11 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1026.eqiad.wmnet with OS buster [production]
20:08 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host ganeti1025.eqiad.wmnet with OS buster [production]
19:58 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@e970bd0]: (no justification provided) (duration: 00m 06s) [production]
19:57 <mforns@deploy1002> Started deploy [airflow-dags/analytics@e970bd0]: (no justification provided) [production]
19:57 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@27a4f7a]: (no justification provided) (duration: 00m 03s) [production]
19:57 <mforns@deploy1002> Started deploy [airflow-dags/analytics@27a4f7a]: (no justification provided) [production]
19:53 <mforns@deploy1002> Finished deploy [airflow-dags/analytics@27a4f7a]: (no justification provided) (duration: 00m 03s) [production]
19:53 <mforns@deploy1002> Started deploy [airflow-dags/analytics@27a4f7a]: (no justification provided) [production]
19:26 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:40:00 on graphite1004.eqiad.wmnet with reason: update firmware [production]
19:26 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 0:40:00 on graphite1004.eqiad.wmnet with reason: update firmware [production]