1-50 of 10000 results (20ms)
2026-02-27 ยง
13:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P89131 and previous config saved to /var/cache/conftool/dbconfig/20260227-133943-marostegui.json [production]
13:33 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P89130 and previous config saved to /var/cache/conftool/dbconfig/20260227-133323-marostegui.json [production]
13:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149', diff saved to https://phabricator.wikimedia.org/P89129 and previous config saved to /var/cache/conftool/dbconfig/20260227-132434-marostegui.json [production]
13:18 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P89128 and previous config saved to /var/cache/conftool/dbconfig/20260227-131815-marostegui.json [production]
13:15 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
13:13 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
13:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2149 (T418465)', diff saved to https://phabricator.wikimedia.org/P89127 and previous config saved to /var/cache/conftool/dbconfig/20260227-130926-marostegui.json [production]
13:06 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gitlab1004.wikimedia.org [production]
13:03 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1157 (T418465)', diff saved to https://phabricator.wikimedia.org/P89126 and previous config saved to /var/cache/conftool/dbconfig/20260227-130306-marostegui.json [production]
13:00 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host gitlab1004.wikimedia.org [production]
12:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1157 (T418465)', diff saved to https://phabricator.wikimedia.org/P89125 and previous config saved to /var/cache/conftool/dbconfig/20260227-125654-marostegui.json [production]
12:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1157.eqiad.wmnet with reason: Maintenance [production]
12:47 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1150.eqiad.wmnet with reason: Maintenance [production]
12:47 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2149 (T418465)', diff saved to https://phabricator.wikimedia.org/P89124 and previous config saved to /var/cache/conftool/dbconfig/20260227-124711-marostegui.json [production]
12:47 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2149.codfw.wmnet with reason: Maintenance [production]
12:47 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1149.eqiad.wmnet [production]
12:43 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2229.codfw.wmnet with reason: Maintenance [production]
12:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2224 (T418465)', diff saved to https://phabricator.wikimedia.org/P89123 and previous config saved to /var/cache/conftool/dbconfig/20260227-124029-marostegui.json [production]
12:35 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1149.eqiad.wmnet [production]
12:35 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1148.eqiad.wmnet [production]
12:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P89122 and previous config saved to /var/cache/conftool/dbconfig/20260227-122521-marostegui.json [production]
12:24 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1148.eqiad.wmnet [production]
12:24 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1147.eqiad.wmnet [production]
12:24 <jgleeson> payments-wiki upgraded from f4fd71ff to a8a9ce78 [fundraising]
12:15 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1147.eqiad.wmnet [production]
12:15 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1146.eqiad.wmnet [production]
12:10 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P89121 and previous config saved to /var/cache/conftool/dbconfig/20260227-121012-marostegui.json [production]
12:06 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1146.eqiad.wmnet [production]
12:06 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1145.eqiad.wmnet [production]
11:55 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1145.eqiad.wmnet [production]
11:55 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1144.eqiad.wmnet [production]
11:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2224 (T418465)', diff saved to https://phabricator.wikimedia.org/P89120 and previous config saved to /var/cache/conftool/dbconfig/20260227-115504-marostegui.json [production]
11:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2224 (T418465)', diff saved to https://phabricator.wikimedia.org/P89119 and previous config saved to /var/cache/conftool/dbconfig/20260227-115026-marostegui.json [production]
11:50 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2224.codfw.wmnet with reason: Maintenance [production]
11:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T418465)', diff saved to https://phabricator.wikimedia.org/P89118 and previous config saved to /var/cache/conftool/dbconfig/20260227-115012-marostegui.json [production]
11:43 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1144.eqiad.wmnet [production]
11:43 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1143.eqiad.wmnet [production]
11:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P89117 and previous config saved to /var/cache/conftool/dbconfig/20260227-113504-marostegui.json [production]
11:34 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1143.eqiad.wmnet [production]
11:34 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1142.eqiad.wmnet [production]
11:25 <jgleeson> payments-wiki upgraded from 974af222 to f4fd71ff [fundraising]
11:25 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1142.eqiad.wmnet [production]
11:19 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P89116 and previous config saved to /var/cache/conftool/dbconfig/20260227-111956-marostegui.json [production]
11:04 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2217 (T418465)', diff saved to https://phabricator.wikimedia.org/P89115 and previous config saved to /var/cache/conftool/dbconfig/20260227-110447-marostegui.json [production]
11:02 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
11:01 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . [production]
11:00 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . [production]
11:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2217 (T418465)', diff saved to https://phabricator.wikimedia.org/P89114 and previous config saved to /var/cache/conftool/dbconfig/20260227-110011-marostegui.json [production]
11:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2217.codfw.wmnet with reason: Maintenance [production]
10:59 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2214 (T418465)', diff saved to https://phabricator.wikimedia.org/P89113 and previous config saved to /var/cache/conftool/dbconfig/20260227-105947-marostegui.json [production]