1251-1300 of 10000 results (46ms)
2022-03-23 ยง
16:31 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1032.eqiad.wmnet with OS bullseye [production]
16:29 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kubernetes1011.eqiad.wmnet with reason: host reimage [production]
16:25 <elukey@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on kubernetes1011.eqiad.wmnet with reason: host reimage [production]
16:10 <elukey@cumin1001> START - Cookbook sre.hosts.reimage for host kubernetes1011.eqiad.wmnet with OS bullseye [production]
16:07 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1032.eqiad.wmnet with reason: host reimage [production]
16:04 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1032.eqiad.wmnet with reason: host reimage [production]
15:50 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1032.eqiad.wmnet with OS bullseye [production]
15:39 <urbanecm> foreachwikiindblist wikipedia extensions/WikimediaMaintenance/createExtensionTables.php growthexperiments # T304052 [production]
15:38 <urbanecm> Created shnwikivoyage and guwwiki [production]
15:31 <mmandere> pool cp1080 with HAProxy as TLS termination layer - T290005 [production]
15:28 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp1080.eqiad.wmnet with OS buster [production]
15:27 <urbanecm@deploy1002> Synchronized langlist: Creating guwwiki (T303727) (duration: 01m 04s) [production]
15:26 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Creating guwwiki (T303727) (duration: 01m 07s) [production]
15:25 <urbanecm@deploy1002> Synchronized wmf-config/logos.php: Creating guwwiki (T303727) (duration: 01m 05s) [production]
15:25 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1031.eqiad.wmnet with OS bullseye [production]
15:24 <urbanecm@deploy1002> Synchronized static/images/project-logos/: Creating guwwiki (T303727) (duration: 01m 06s) [production]
15:23 <urbanecm@deploy1002> rebuilt and synchronized wikiversions files: Creating guwwiki (T303727) [production]
15:22 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
15:21 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
15:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
15:21 <urbanecm@deploy1002> Synchronized dblists: Creating guwwiki (T303727) (duration: 01m 10s) [production]
15:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:19 <urbanecm@deploy1002> Synchronized wmf-config/db-production.php: Creating guwwiki (T303727) (duration: 01m 05s) [production]
15:15 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:14 <urbanecm@deploy1002> Synchronized wmf-config/logos.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:13 <urbanecm@deploy1002> Synchronized static/images/project-logos/: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:12 <urbanecm@deploy1002> rebuilt and synchronized wikiversions files: Creating shnwikivoyage (T302797) [production]
15:10 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
15:09 <urbanecm@deploy1002> Synchronized dblists: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:09 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
15:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
15:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
15:08 <urbanecm@deploy1002> Synchronized wmf-config/db-production.php: Creating shnwikivoyage (T302797) (duration: 01m 05s) [production]
15:05 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp1080.eqiad.wmnet with reason: host reimage [production]
15:02 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1031.eqiad.wmnet with reason: host reimage [production]
15:01 <mmandere@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp1080.eqiad.wmnet with reason: host reimage [production]
15:00 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1030.eqiad.wmnet with OS bullseye [production]
14:59 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1031.eqiad.wmnet with reason: host reimage [production]
14:50 <bking@cumin1001> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
14:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
14:47 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
14:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
14:46 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
14:45 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1031.eqiad.wmnet with OS bullseye [production]
14:44 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudvirt1030.eqiad.wmnet with reason: host reimage [production]
14:44 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1030.eqiad.wmnet with reason: host reimage [production]
14:44 <mmandere@cumin1001> START - Cookbook sre.hosts.reimage for host cp1080.eqiad.wmnet with OS buster [production]
14:41 <urbanecm@deploy1002> Synchronized php-1.39.0-wmf.3/extensions/WikimediaMaintenance/addWiki.php: 9a0aed0: addWiki: Create GrowthExperiment tables for all new Wikipedias (T304052) (duration: 01m 06s) [production]
14:38 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp1085.eqiad.wmnet [production]
14:37 <mmandere> depool cp1080 for reimage - T290005 [production]