51-100 of 10000 results (85ms)
2024-08-13 ยง
16:50 <ebernhardson@deploy1003> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
16:23 <cmooney@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 7 hosts with reason: prep for replacement of cloudsw1-d5-eqiad [production]
16:22 <cmooney@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on 7 hosts with reason: prep for replacement of cloudsw1-d5-eqiad [production]
15:39 <mutante> gerrit - starting to drop packets from abusive sources (T365259) [production]
15:38 <elukey@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host kafka-main2006.codfw.wmnet with OS bookworm [production]
14:56 <elukey@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main2006.codfw.wmnet with OS bookworm [production]
14:25 <jayme@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kafka-main2009.codfw.wmnet with OS bullseye [production]
14:24 <btullis@deploy1003> Finished deploy [airflow-dags/wmde@109c99e]: (no justification provided) (duration: 00m 08s) [production]
14:24 <btullis@deploy1003> Started deploy [airflow-dags/wmde@109c99e]: (no justification provided) [production]
14:24 <btullis@deploy1003> Finished deploy [airflow-dags/analytics_product@109c99e]: (no justification provided) (duration: 00m 09s) [production]
14:23 <btullis@deploy1003> Started deploy [airflow-dags/analytics_product@109c99e]: (no justification provided) [production]
14:23 <btullis@deploy1003> Finished deploy [airflow-dags/platform_eng@109c99e]: (no justification provided) (duration: 00m 24s) [production]
14:23 <btullis@deploy1003> Started deploy [airflow-dags/platform_eng@109c99e]: (no justification provided) [production]
14:22 <btullis@deploy1003> Finished deploy [airflow-dags/research@109c99e]: (no justification provided) (duration: 00m 11s) [production]
14:22 <btullis@deploy1003> Started deploy [airflow-dags/research@109c99e]: (no justification provided) [production]
14:22 <btullis@deploy1003> Finished deploy [airflow-dags/search@109c99e]: (no justification provided) (duration: 00m 19s) [production]
14:21 <btullis@deploy1003> Started deploy [airflow-dags/search@109c99e]: (no justification provided) [production]
14:21 <btullis@deploy1003> Finished deploy [airflow-dags/analytics_test@109c99e]: (no justification provided) (duration: 00m 09s) [production]
14:21 <btullis@deploy1003> Started deploy [airflow-dags/analytics_test@109c99e]: (no justification provided) [production]
14:18 <ebernhardson@deploy1003> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:18 <ebernhardson@deploy1003> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:17 <btullis@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-db1001.eqiad.wmnet [production]
13:57 <Lucas_WMDE> UTC backport+config window done (since ~13:10, really) [production]
13:49 <xcollazo@deploy1003> Finished deploy [airflow-dags/analytics@109c99e]: Airflow upgrade to v 2.9.3 for analytics instance. T365449. (duration: 00m 40s) [production]
13:48 <xcollazo@deploy1003> Started deploy [airflow-dags/analytics@109c99e]: Airflow upgrade to v 2.9.3 for analytics instance. T365449. [production]
13:46 <ayounsi@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update wheels - ayounsi@cumin1002 [production]
13:41 <ayounsi@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update wheels - ayounsi@cumin1002 [production]
13:40 <XioNoX> update homer wheels - T371890 [production]
13:36 <jayme@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main2009.codfw.wmnet with OS bullseye [production]
13:35 <jayme@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host kafka-main2009.codfw.wmnet with OS bullseye [production]
13:26 <jayme@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main2009.codfw.wmnet with OS bullseye [production]
13:25 <jayme@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kafka-main2009.codfw.wmnet with OS bullseye [production]
13:05 <elukey> `apt-get install python3-conftool python3-conftool-requestctl` on all puppetserver nodes - upgrade to 3.2.2 [production]
13:04 <Lucas_WMDE> FINISHED lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/cleanupTitles.php --wiki=hewikisource --prefix=T314733 2>&1 | tee ~/T314733.log [production]
13:01 <Lucas_WMDE> START lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/cleanupTitles.php --wiki=hewikisource --prefix=T314733 2>&1 | tee ~/T314733.log [production]
12:47 <filippo@deploy1003> Finished scap: new statsd-exporter limits (duration: 03m 52s) [production]
12:43 <filippo@deploy1003> Started scap sync-world: new statsd-exporter limits [production]
12:37 <jayme@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main2009.codfw.wmnet with OS bullseye [production]
12:18 <jayme@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host kafka-main2010.codfw.wmnet with OS bullseye [production]
11:35 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-launcher1002.eqiad.wmnet [production]
11:29 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-launcher1002.eqiad.wmnet [production]
11:28 <jayme@cumin1002> START - Cookbook sre.hosts.reimage for host kafka-main2010.codfw.wmnet with OS bullseye [production]
11:17 <XioNoX> deploy pfw policy update 1723510554 - T372367 [production]
11:11 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1005.eqiad.wmnet [production]
11:07 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-airflow1005.eqiad.wmnet [production]
11:01 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1006.eqiad.wmnet [production]
10:57 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-airflow1006.eqiad.wmnet [production]
10:53 <stevemunene@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1004.eqiad.wmnet [production]
10:49 <stevemunene@cumin1002> START - Cookbook sre.hosts.reboot-single for host an-airflow1004.eqiad.wmnet [production]
10:38 <dcaro@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]