5801-5850 of 10000 results (100ms)
2023-11-06 ยง
19:41 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
19:41 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
18:49 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
18:49 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
18:49 <ladsgroup@deploy2002> Finished scap: Backport for [[gerrit:972004|Add pc4 to the list of ParserCache clusters (T350367)]] (duration: 09m 32s) [production]
18:48 <bking@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
18:47 <bking@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
18:47 <bking@deploy2002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
18:47 <bking@deploy2002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
18:43 <ladsgroup@deploy2002> ladsgroup: Continuing with sync [production]
18:41 <ladsgroup@deploy2002> ladsgroup: Backport for [[gerrit:972004|Add pc4 to the list of ParserCache clusters (T350367)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:40 <ladsgroup@deploy2002> Started scap: Backport for [[gerrit:972004|Add pc4 to the list of ParserCache clusters (T350367)]] [production]
18:39 <milimetric@deploy2002> Finished deploy [airflow-dags/analytics@048362b]: (no justification provided) (duration: 00m 29s) [production]
18:39 <milimetric@deploy2002> Started deploy [airflow-dags/analytics@048362b]: (no justification provided) [production]
18:19 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudrabbit1003.wikimedia.org with OS bookworm [production]
18:18 <andrew@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=93) for host cloudrabbit1003.wikimedia.org with OS bookworm [production]
18:11 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudrabbit1003'] [production]
18:10 <milimetric@deploy2002> Finished deploy [analytics/refinery@0239c23] (thin): Publishing refinery-source jars at 0.2.24 (duration: 00m 07s) [production]
18:09 <milimetric@deploy2002> Started deploy [analytics/refinery@0239c23] (thin): Publishing refinery-source jars at 0.2.24 [production]
18:04 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
18:03 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
18:03 <milimetric@deploy2002> Finished deploy [analytics/refinery@0239c23]: Publishing refinery-source jars at 0.2.24 (duration: 07m 39s) [production]
18:02 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
18:02 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
18:01 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:58 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudrabbit1003'] [production]
17:56 <jclark@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cloudrabbit1003'] [production]
17:55 <milimetric@deploy2002> Started deploy [analytics/refinery@0239c23]: Publishing refinery-source jars at 0.2.24 [production]
17:52 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
17:52 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
17:52 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
17:50 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
17:48 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply [production]
17:48 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:48 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
17:46 <bking@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
17:46 <bking@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
17:46 <jclark@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudrabbit1003'] [production]
17:41 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:41 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
17:35 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudrabbit1002.wikimedia.org with OS bookworm [production]
17:24 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host backup2011.codfw.wmnet with OS bookworm [production]
17:19 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudrabbit1002.wikimedia.org with reason: host reimage [production]
17:15 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudrabbit1002.wikimedia.org with reason: host reimage [production]
17:07 <jynus@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on backup2011.codfw.wmnet with reason: host reimage [production]
17:05 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:03 <jynus@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on backup2011.codfw.wmnet with reason: host reimage [production]
17:03 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudrabbit1002.wikimedia.org with OS bookworm [production]
17:03 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudrabbit1003.wikimedia.org with OS bookworm [production]
17:01 <sukhe@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4052.ulsfo.wmnet with OS bookworm [production]