5651-5700 of 10000 results (98ms)
2023-11-24 ยง
09:09 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2190 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53856 and previous config saved to /var/cache/conftool/dbconfig/20231124-090951-arnaudb.json [production]
09:09 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 35%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53855 and previous config saved to /var/cache/conftool/dbconfig/20231124-090908-arnaudb.json [production]
09:07 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2189 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53854 and previous config saved to /var/cache/conftool/dbconfig/20231124-090723-arnaudb.json [production]
09:06 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2188 (re)pooling @ 40%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53853 and previous config saved to /var/cache/conftool/dbconfig/20231124-090630-arnaudb.json [production]
09:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2195 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53852 and previous config saved to /var/cache/conftool/dbconfig/20231124-090157-arnaudb.json [production]
09:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2193 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53851 and previous config saved to /var/cache/conftool/dbconfig/20231124-090134-arnaudb.json [production]
09:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53850 and previous config saved to /var/cache/conftool/dbconfig/20231124-090116-arnaudb.json [production]
09:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2131 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53849 and previous config saved to /var/cache/conftool/dbconfig/20231124-090059-arnaudb.json [production]
09:00 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2181 (re)pooling @ 80%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53848 and previous config saved to /var/cache/conftool/dbconfig/20231124-090056-arnaudb.json [production]
08:54 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2190 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53847 and previous config saved to /var/cache/conftool/dbconfig/20231124-085446-arnaudb.json [production]
08:54 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53846 and previous config saved to /var/cache/conftool/dbconfig/20231124-085403-arnaudb.json [production]
08:52 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2189 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53845 and previous config saved to /var/cache/conftool/dbconfig/20231124-085218-arnaudb.json [production]
08:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2188 (re)pooling @ 30%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53844 and previous config saved to /var/cache/conftool/dbconfig/20231124-085125-arnaudb.json [production]
08:46 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2195 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53843 and previous config saved to /var/cache/conftool/dbconfig/20231124-084652-arnaudb.json [production]
08:46 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2193 (re)pooling @ 60%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53842 and previous config saved to /var/cache/conftool/dbconfig/20231124-084629-arnaudb.json [production]
08:46 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 60%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53841 and previous config saved to /var/cache/conftool/dbconfig/20231124-084611-arnaudb.json [production]
08:45 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2131 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53840 and previous config saved to /var/cache/conftool/dbconfig/20231124-084554-arnaudb.json [production]
08:45 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2181 (re)pooling @ 60%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53839 and previous config saved to /var/cache/conftool/dbconfig/20231124-084551-arnaudb.json [production]
08:39 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2190 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53838 and previous config saved to /var/cache/conftool/dbconfig/20231124-083941-arnaudb.json [production]
08:38 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 25%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53837 and previous config saved to /var/cache/conftool/dbconfig/20231124-083858-arnaudb.json [production]
08:37 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2189 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53836 and previous config saved to /var/cache/conftool/dbconfig/20231124-083713-arnaudb.json [production]
08:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2188 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53835 and previous config saved to /var/cache/conftool/dbconfig/20231124-083620-arnaudb.json [production]
08:31 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2195 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53834 and previous config saved to /var/cache/conftool/dbconfig/20231124-083147-arnaudb.json [production]
08:31 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2193 (re)pooling @ 40%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53833 and previous config saved to /var/cache/conftool/dbconfig/20231124-083124-arnaudb.json [production]
08:31 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 40%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53832 and previous config saved to /var/cache/conftool/dbconfig/20231124-083106-arnaudb.json [production]
08:30 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2131 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53831 and previous config saved to /var/cache/conftool/dbconfig/20231124-083049-arnaudb.json [production]
08:30 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2181 (re)pooling @ 40%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53830 and previous config saved to /var/cache/conftool/dbconfig/20231124-083046-arnaudb.json [production]
08:24 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2190 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53829 and previous config saved to /var/cache/conftool/dbconfig/20231124-082436-arnaudb.json [production]
08:23 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 20%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53828 and previous config saved to /var/cache/conftool/dbconfig/20231124-082353-arnaudb.json [production]
08:22 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2189 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53827 and previous config saved to /var/cache/conftool/dbconfig/20231124-082208-arnaudb.json [production]
08:21 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2188 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53826 and previous config saved to /var/cache/conftool/dbconfig/20231124-082115-arnaudb.json [production]
08:16 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2193 (re)pooling @ 20%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53825 and previous config saved to /var/cache/conftool/dbconfig/20231124-081619-arnaudb.json [production]
08:16 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2180 (re)pooling @ 20%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53824 and previous config saved to /var/cache/conftool/dbconfig/20231124-081601-arnaudb.json [production]
08:15 <arnaudb@cumin1001> dbctl commit (dc=all): 'db2181 (re)pooling @ 20%: Post reconfig repooling', diff saved to https://phabricator.wikimedia.org/P53823 and previous config saved to /var/cache/conftool/dbconfig/20231124-081541-arnaudb.json [production]
08:14 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2180 and db2193 to fix their config, will repool them asap', diff saved to https://phabricator.wikimedia.org/P53822 and previous config saved to /var/cache/conftool/dbconfig/20231124-081422-arnaudb.json [production]
08:13 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db2181 and db2193 to fix their config, will repool them asap', diff saved to https://phabricator.wikimedia.org/P53821 and previous config saved to /var/cache/conftool/dbconfig/20231124-081304-arnaudb.json [production]
08:11 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2001.codfw.wmnet with OS bookworm [production]
08:08 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 15%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53820 and previous config saved to /var/cache/conftool/dbconfig/20231124-080848-arnaudb.json [production]
07:53 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 10%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53819 and previous config saved to /var/cache/conftool/dbconfig/20231124-075343-arnaudb.json [production]
07:51 <arnaudb@cumin1001> dbctl commit (dc=all): 'repool API on db2181', diff saved to https://phabricator.wikimedia.org/P53818 and previous config saved to /var/cache/conftool/dbconfig/20231124-075137-arnaudb.json [production]
07:50 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy2001.codfw.wmnet with reason: host reimage [production]
07:48 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy2001.codfw.wmnet with reason: host reimage [production]
07:38 <arnaudb@cumin1001> dbctl commit (dc=all): 'es2032 (re)pooling @ 5%: Post warmup repooling', diff saved to https://phabricator.wikimedia.org/P53817 and previous config saved to /var/cache/conftool/dbconfig/20231124-073838-arnaudb.json [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1132 (re)pooling @ 100%: Upgrade to 10.6.16', diff saved to https://phabricator.wikimedia.org/P53816 and previous config saved to /var/cache/conftool/dbconfig/20231124-073743-root.json [production]
07:35 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2002.codfw.wmnet with OS bookworm [production]
07:35 <arnaudb@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1 day, 0:00:00 on es2032.codfw.wmnet with reason: reboot [production]
07:35 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on es2032.codfw.wmnet with reason: reboot [production]
07:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db2122 (re)pooling @ 100%: Upgrade to 10.6.16', diff saved to https://phabricator.wikimedia.org/P53815 and previous config saved to /var/cache/conftool/dbconfig/20231124-073510-root.json [production]
07:35 <arnaudb@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1 day, 0:00:00 on es2032.codfw.wmnet with reason: reboot [production]
07:34 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on es2032.codfw.wmnet with reason: reboot [production]