2451-2500 of 10000 results (91ms)
2024-05-23 ยง
16:17 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply [production]
16:16 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/editor-analytics: apply [production]
16:15 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply [production]
16:15 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/edit-analytics: apply [production]
16:14 <swfrench@deploy1002> helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply [production]
16:13 <swfrench@deploy1002> helmfile [eqiad] START helmfile.d/services/device-analytics: apply [production]
16:13 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/device-analytics: apply [production]
16:12 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/device-analytics: apply [production]
16:09 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1235 (re)pooling @ 10%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63012 and previous config saved to /var/cache/conftool/dbconfig/20240523-160951-arnaudb.json [production]
16:09 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158', diff saved to https://phabricator.wikimedia.org/P63011 and previous config saved to /var/cache/conftool/dbconfig/20240523-160921-marostegui.json [production]
16:08 <elukey@deploy1002> helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: sync [production]
16:08 <elukey@deploy1002> helmfile [staging] START helmfile.d/services/tegola-vector-tiles: sync [production]
16:05 <topranks> enabling BFD on transit circuit to telxius in magru [production]
16:04 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/image-suggestion: apply [production]
16:04 <elukey@deploy1002> helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: sync [production]
16:04 <elukey@deploy1002> helmfile [staging] START helmfile.d/services/tegola-vector-tiles: sync [production]
16:03 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/image-suggestion: apply [production]
16:02 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
16:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2116 (re)pooling @ 75%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63010 and previous config saved to /var/cache/conftool/dbconfig/20240523-160249-arnaudb.json [production]
16:02 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/page-analytics: apply [production]
16:02 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply [production]
16:01 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/page-analytics: apply [production]
16:00 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/media-analytics: apply [production]
15:59 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/media-analytics: apply [production]
15:58 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/geo-analytics: apply [production]
15:57 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/geo-analytics: apply [production]
15:56 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply [production]
15:55 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudvirt1041.eqiad.wmnet with OS bookworm [production]
15:55 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/editor-analytics: apply [production]
15:54 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1235 (re)pooling @ 5%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63009 and previous config saved to /var/cache/conftool/dbconfig/20240523-155444-arnaudb.json [production]
15:54 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply [production]
15:54 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2158 (T364299)', diff saved to https://phabricator.wikimedia.org/P63008 and previous config saved to /var/cache/conftool/dbconfig/20240523-155413-marostegui.json [production]
15:53 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/edit-analytics: apply [production]
15:51 <swfrench@deploy1002> helmfile [codfw] DONE helmfile.d/services/device-analytics: apply [production]
15:50 <swfrench@deploy1002> helmfile [codfw] START helmfile.d/services/device-analytics: apply [production]
15:47 <rzl@deploy1002> helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
15:47 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2116 (re)pooling @ 50%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63006 and previous config saved to /var/cache/conftool/dbconfig/20240523-154743-arnaudb.json [production]
15:47 <rzl@deploy1002> helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply [production]
15:41 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/image-suggestion: apply [production]
15:41 <rzl@deploy1002> helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply [production]
15:40 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/image-suggestion: apply [production]
15:40 <rzl@deploy1002> helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply [production]
15:39 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1235 (re)pooling @ 2%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63004 and previous config saved to /var/cache/conftool/dbconfig/20240523-153937-arnaudb.json [production]
15:37 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/page-analytics: apply [production]
15:36 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/page-analytics: apply [production]
15:34 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/media-analytics: apply [production]
15:34 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/media-analytics: apply [production]
15:32 <swfrench@deploy1002> helmfile [staging] DONE helmfile.d/services/geo-analytics: apply [production]
15:32 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2116 (re)pooling @ 25%: post reimage repool', diff saved to https://phabricator.wikimedia.org/P63003 and previous config saved to /var/cache/conftool/dbconfig/20240523-153237-arnaudb.json [production]
15:32 <swfrench@deploy1002> helmfile [staging] START helmfile.d/services/geo-analytics: apply [production]