5201-5250 of 10000 results (69ms)
2022-03-23 ยง
17:50 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1034.eqiad.wmnet with OS bullseye [production]
17:48 <brennen> trainsperiment (T300203): starting prep for 1.39.0-wmf.4 [production]
17:38 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1033.eqiad.wmnet with OS bullseye [production]
17:32 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1028.eqiad.wmnet with OS bullseye [production]
17:25 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1034.eqiad.wmnet with reason: host reimage [production]
17:22 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1034.eqiad.wmnet with reason: host reimage [production]
17:17 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1033.eqiad.wmnet with reason: host reimage [production]
17:14 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1033.eqiad.wmnet with reason: host reimage [production]
17:13 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1028.eqiad.wmnet with reason: host reimage [production]
17:10 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1028.eqiad.wmnet with reason: host reimage [production]
17:07 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1034.eqiad.wmnet with OS bullseye [production]
16:59 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1033.eqiad.wmnet with OS bullseye [production]
16:58 <andrew@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudvirt1047.eqiad.wmnet with OS bullseye [production]
16:58 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1028.eqiad.wmnet with OS bullseye [production]
16:48 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1047.eqiad.wmnet with OS bullseye [production]
16:40 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kubernetes1011.eqiad.wmnet with OS bullseye [production]
16:31 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1032.eqiad.wmnet with OS bullseye [production]
16:29 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubernetes1011.eqiad.wmnet with reason: host reimage [production]
16:25 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on kubernetes1011.eqiad.wmnet with reason: host reimage [production]
16:10 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1011.eqiad.wmnet with OS bullseye [production]
16:07 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1032.eqiad.wmnet with reason: host reimage [production]
16:04 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1032.eqiad.wmnet with reason: host reimage [production]
15:50 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1032.eqiad.wmnet with OS bullseye [production]
15:39 <urbanecm> foreachwikiindblist wikipedia extensions/WikimediaMaintenance/createExtensionTables.php growthexperiments # T304052 [production]
15:38 <urbanecm> Created shnwikivoyage and guwwiki [production]
15:31 <mmandere> pool cp1080 with HAProxy as TLS termination layer - T290005 [production]
15:28 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1080.eqiad.wmnet with OS buster [production]
15:27 <urbanecm@deploy1002> Synchronized langlist: Creating guwwiki (T303727) (duration: 01m 04s) [production]
15:26 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Creating guwwiki (T303727) (duration: 01m 07s) [production]
15:25 <urbanecm@deploy1002> Synchronized wmf-config/logos.php: Creating guwwiki (T303727) (duration: 01m 05s) [production]
15:25 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1031.eqiad.wmnet with OS bullseye [production]
15:24 <urbanecm@deploy1002> Synchronized static/images/project-logos/: Creating guwwiki (T303727) (duration: 01m 06s) [production]
15:23 <urbanecm@deploy1002> rebuilt and synchronized wikiversions files: Creating guwwiki (T303727) [production]
15:22 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
15:21 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
15:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
15:21 <urbanecm@deploy1002> Synchronized dblists: Creating guwwiki (T303727) (duration: 01m 10s) [production]
15:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:19 <urbanecm@deploy1002> Synchronized wmf-config/db-production.php: Creating guwwiki (T303727) (duration: 01m 05s) [production]
15:15 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:14 <urbanecm@deploy1002> Synchronized wmf-config/logos.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:13 <urbanecm@deploy1002> Synchronized static/images/project-logos/: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:12 <urbanecm@deploy1002> rebuilt and synchronized wikiversions files: Creating shnwikivoyage (T302797) [production]
15:10 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
15:09 <urbanecm@deploy1002> Synchronized dblists: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:09 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
15:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
15:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:08 <urbanecm@deploy1002> Synchronized wmf-config/db-production.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:05 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1080.eqiad.wmnet with reason: host reimage [production]