5101-5150 of 10000 results (104ms)
2023-11-09 ยง
14:17 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 90%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53187 and previous config saved to /var/cache/conftool/dbconfig/20231109-141749-arnaudb.json [production]
14:10 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: analytics_cluster::turnilo [production]
14:06 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: karapace [production]
14:02 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 75%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53185 and previous config saved to /var/cache/conftool/dbconfig/20231109-140245-arnaudb.json [production]
13:55 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: karapace [production]
13:49 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host stat1009.eqiad.wmnet [production]
13:47 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 60%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53184 and previous config saved to /var/cache/conftool/dbconfig/20231109-134740-arnaudb.json [production]
13:41 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host stat1009.eqiad.wmnet [production]
13:32 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 45%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53183 and previous config saved to /var/cache/conftool/dbconfig/20231109-133235-arnaudb.json [production]
13:17 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 30%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53180 and previous config saved to /var/cache/conftool/dbconfig/20231109-131730-arnaudb.json [production]
13:02 <arnaudb@cumin1001> dbctl commit (dc=all): 'db1165 (re)pooling @ 15%: Host warmup', diff saved to https://phabricator.wikimedia.org/P53179 and previous config saved to /var/cache/conftool/dbconfig/20231109-130225-arnaudb.json [production]
12:44 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:44 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1165 (T348183)', diff saved to https://phabricator.wikimedia.org/P53178 and previous config saved to /var/cache/conftool/dbconfig/20231109-124404-arnaudb.json [production]
12:43 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
12:43 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
12:43 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
12:43 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:43 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
12:42 <kamila@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
12:42 <kamila@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
12:38 <moritzm> installing qemu security updates [production]
12:33 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: dumps::generation::server::misccrons [production]
12:23 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/editor-analytics: apply [production]
12:23 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/editor-analytics: apply [production]
12:21 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: dumps::generation::server::misccrons [production]
12:16 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: dumps::generation::server::xmldumps [production]
12:09 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: dumps::generation::server::xmldumps [production]
12:08 <moritzm> installing python-reportlab security updates [production]
11:54 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: dumps::generation::server::xmlfallback [production]
11:43 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: dumps::generation::server::xmlfallback [production]
11:38 <_joe_> disabled requestctl cache-text/wikifeeds_featured T350645 T346657 [production]
11:26 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-role (exit_code=0) for role: url_downloader [production]
11:20 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: url_downloader [production]
11:14 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host urldownloader2003.wikimedia.org [production]
11:09 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply [production]
11:09 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/edit-analytics: apply [production]
11:09 <hnowlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply [production]
11:08 <hnowlan@deploy2002> helmfile [eqiad] START helmfile.d/services/edit-analytics: apply [production]
11:08 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/edit-analytics: apply [production]
11:08 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/edit-analytics: apply [production]
11:07 <mvolz@deploy2002> helmfile [eqiad] DONE helmfile.d/services/zotero: apply [production]
11:06 <mvolz@deploy2002> helmfile [eqiad] START helmfile.d/services/zotero: apply [production]
11:06 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply [production]
11:06 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/editor-analytics: apply [production]
11:06 <hnowlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply [production]
11:05 <hnowlan@deploy2002> helmfile [eqiad] START helmfile.d/services/editor-analytics: apply [production]
11:05 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/editor-analytics: apply [production]
11:05 <mvolz@deploy2002> helmfile [codfw] DONE helmfile.d/services/zotero: apply [production]
11:05 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/editor-analytics: apply [production]
11:04 <mvolz@deploy2002> helmfile [codfw] START helmfile.d/services/zotero: apply [production]