2451-2500 of 10000 results (72ms)
2023-03-20 ยง
18:42 <ebernhardson@deploy2002> Finished deploy [airflow-dags/search@3aaecb7]: safely quote spark args in skein script (duration: 00m 13s) [production]
18:42 <ebernhardson@deploy2002> Started deploy [airflow-dags/search@3aaecb7]: safely quote spark args in skein script [production]
18:42 <ejegg> civicrm upgraded from 3d3606f1 to 09373b9d [production]
18:32 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:32 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:32 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:32 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:31 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:30 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:30 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:30 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:30 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:30 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:28 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:28 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:18 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:18 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: sync [production]
18:18 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: sync [production]
18:16 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop: sync [production]
18:16 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop: sync [production]
18:16 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop: sync [production]
18:15 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop: sync [production]
18:15 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop: sync [production]
18:15 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/changeprop: sync [production]
18:11 <akosiaris@deploy2002> helmfile [codfw] DONE helmfile.d/services/api-gateway: sync [production]
18:11 <akosiaris@deploy2002> helmfile [codfw] START helmfile.d/services/api-gateway: sync [production]
18:11 <akosiaris@deploy2002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: sync [production]
18:11 <akosiaris@deploy2002> helmfile [eqiad] START helmfile.d/services/api-gateway: sync [production]
18:11 <akosiaris@deploy2002> helmfile [staging] DONE helmfile.d/services/api-gateway: sync [production]
18:11 <akosiaris@deploy2002> helmfile [staging] START helmfile.d/services/api-gateway: sync [production]
18:05 <mutante> miscweb1003 - syntax error in httpd config due to "Unknown Authn provider: ldap" - comes from static-rt vhost (T331896) [production]
18:04 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs1019.eqiad.wmnet [production]
18:04 <sukhe@cumin2002> START - Cookbook sre.hosts.remove-downtime for lvs1019.eqiad.wmnet [production]
17:59 <mutante> when applying apache role for the first time on new hosts we still have the same old conflict: miscweb1003 - manual "a2dismod mpm_event" to be able to let puppet enable mod PHP (T196968) [production]
17:57 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on miscweb1003.eqiad.wmnet with reason: maintenance [production]
17:57 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on miscweb1003.eqiad.wmnet with reason: maintenance [production]
17:55 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:40:00 on lvs1019.eqiad.wmnet with reason: reboot for kernel update [production]
17:55 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:40:00 on lvs1019.eqiad.wmnet with reason: reboot for kernel update [production]
17:26 <akosiaris> disable puppet on rdb*, netbox*, ores*, registry* [production]
17:14 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:40:00 on lvs3006.esams.wmnet with reason: reboot for kernel update [production]
17:14 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:40:00 on lvs3006.esams.wmnet with reason: reboot for kernel update [production]
17:14 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:40:00 on lvs2009.codfw.wmnet,lvs1019.eqiad.wmnet with reason: reboot for kernel update [production]
17:14 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:40:00 on lvs2009.codfw.wmnet,lvs1019.eqiad.wmnet with reason: reboot for kernel update [production]
16:43 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
16:43 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
16:36 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
16:36 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
16:32 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
16:22 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
16:21 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]