201-250 of 10000 results (84ms)
2023-11-13 ยง
17:33 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventstreams-internal: apply [production]
17:33 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventstreams-internal: apply [production]
17:32 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventstreams-internal: apply [production]
17:32 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventstreams-internal: apply [production]
17:32 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2128 (T348183)', diff saved to https://phabricator.wikimedia.org/P53353 and previous config saved to /var/cache/conftool/dbconfig/20231113-173209-arnaudb.json [production]
17:31 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventstreams-internal: apply [production]
17:31 <otto@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-main: apply [production]
17:31 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-main: apply [production]
17:28 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-main: apply [production]
17:27 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2128 (T348183)', diff saved to https://phabricator.wikimedia.org/P53352 and previous config saved to /var/cache/conftool/dbconfig/20231113-172748-arnaudb.json [production]
17:27 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-main: apply [production]
17:27 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
17:27 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
17:27 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2128.codfw.wmnet with reason: Maintenance [production]
17:27 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2128.codfw.wmnet with reason: Maintenance [production]
17:27 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2123 (T348183)', diff saved to https://phabricator.wikimedia.org/P53351 and previous config saved to /var/cache/conftool/dbconfig/20231113-172712-arnaudb.json [production]
17:27 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-main: apply [production]
17:26 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-main: apply [production]
17:21 <otto@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
17:21 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply [production]
17:20 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
17:17 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply [production]
17:17 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
17:16 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply [production]
17:15 <otto@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:14 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply [production]
17:13 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:12 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2123', diff saved to https://phabricator.wikimedia.org/P53350 and previous config saved to /var/cache/conftool/dbconfig/20231113-171205-arnaudb.json [production]
17:10 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply [production]
17:09 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply [production]
17:09 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-analytics: apply [production]
17:09 <otto@deploy2002> helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply [production]
17:08 <otto@deploy2002> helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply [production]
17:06 <otto@deploy2002> helmfile [eqiad] DONE helmfile.d/services/eventgate-logging-external: apply [production]
17:06 <otto@deploy2002> helmfile [eqiad] START helmfile.d/services/eventgate-logging-external: apply [production]
17:05 <otto@deploy2002> helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply [production]
17:05 <ottomata> deploying eventgates to pick up change to use mw-api-int-async-ro with retries - T326002 [production]
17:04 <otto@deploy2002> helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply [production]
17:04 <otto@deploy2002> Finished deploy [analytics/refinery@25ef91f]: deploying refinery with refinery-source 0.2.25 jars for T321854 [analytics/refinery@25ef91f2] (duration: 06m 36s) [production]
16:57 <otto@deploy2002> Started deploy [analytics/refinery@25ef91f]: deploying refinery with refinery-source 0.2.25 jars for T321854 [analytics/refinery@25ef91f2] [production]
16:56 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2123', diff saved to https://phabricator.wikimedia.org/P53349 and previous config saved to /var/cache/conftool/dbconfig/20231113-165659-arnaudb.json [production]
16:51 <jdrewniak@deploy2002> Synchronized portals: Wikimedia Portals Update: [[gerrit:973830| Bumping portals to master (T128546)]] (duration: 05m 42s) [production]
16:46 <jdrewniak@deploy2002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:973830| Bumping portals to master (T128546)]] (duration: 06m 14s) [production]
16:43 <oblivian@deploy2002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
16:43 <oblivian@deploy2002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
16:43 <oblivian@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
16:42 <oblivian@deploy2002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
16:41 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2123 (T348183)', diff saved to https://phabricator.wikimedia.org/P53348 and previous config saved to /var/cache/conftool/dbconfig/20231113-164152-arnaudb.json [production]
16:40 <fnegri@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1031.eqiad.wmnet with OS bookworm [production]
16:39 <ayounsi@cumin1001> END (FAIL) - Cookbook sre.hosts.dhcp (exit_code=99) for host sretest1004.eqiad.wmnet [production]