101-150 of 10000 results (16ms)
2026-01-30 ยง
17:15 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1172 (T415786)', diff saved to https://phabricator.wikimedia.org/P88293 and previous config saved to /var/cache/conftool/dbconfig/20260130-171539-marostegui.json [production]
17:05 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1172 (T415786)', diff saved to https://phabricator.wikimedia.org/P88292 and previous config saved to /var/cache/conftool/dbconfig/20260130-170525-marostegui.json [production]
17:05 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1172.eqiad.wmnet with reason: Maintenance [production]
17:02 <larssandergreen> civicrm upgraded from 79e4424e to 611d18de [fundraising]
17:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P88291 and previous config saved to /var/cache/conftool/dbconfig/20260130-170125-marostegui.json [production]
16:56 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1171.eqiad.wmnet with reason: Maintenance [production]
16:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T415786)', diff saved to https://phabricator.wikimedia.org/P88289 and previous config saved to /var/cache/conftool/dbconfig/20260130-165637-marostegui.json [production]
16:46 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P88288 and previous config saved to /var/cache/conftool/dbconfig/20260130-164617-marostegui.json [production]
16:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P88287 and previous config saved to /var/cache/conftool/dbconfig/20260130-164129-marostegui.json [production]
16:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T415786)', diff saved to https://phabricator.wikimedia.org/P88286 and previous config saved to /var/cache/conftool/dbconfig/20260130-163108-marostegui.json [production]
16:26 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P88285 and previous config saved to /var/cache/conftool/dbconfig/20260130-162620-marostegui.json [production]
16:21 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2166 (T415786)', diff saved to https://phabricator.wikimedia.org/P88284 and previous config saved to /var/cache/conftool/dbconfig/20260130-162103-marostegui.json [production]
16:20 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2166.codfw.wmnet with reason: Maintenance [production]
16:20 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T415786)', diff saved to https://phabricator.wikimedia.org/P88283 and previous config saved to /var/cache/conftool/dbconfig/20260130-162038-marostegui.json [production]
16:11 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T415786)', diff saved to https://phabricator.wikimedia.org/P88282 and previous config saved to /var/cache/conftool/dbconfig/20260130-161112-marostegui.json [production]
16:05 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20260130-160525-marostegui.json [production]
16:01 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1167 (T415786)', diff saved to https://phabricator.wikimedia.org/P88280 and previous config saved to /var/cache/conftool/dbconfig/20260130-160101-marostegui.json [production]
16:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
16:00 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1167.eqiad.wmnet with reason: Maintenance [production]
15:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P88279 and previous config saved to /var/cache/conftool/dbconfig/20260130-155017-marostegui.json [production]
15:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T415786)', diff saved to https://phabricator.wikimedia.org/P88278 and previous config saved to /var/cache/conftool/dbconfig/20260130-153508-marostegui.json [production]
15:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2165 (T415786)', diff saved to https://phabricator.wikimedia.org/P88277 and previous config saved to /var/cache/conftool/dbconfig/20260130-152507-marostegui.json [production]
15:24 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
15:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T415786)', diff saved to https://phabricator.wikimedia.org/P88276 and previous config saved to /var/cache/conftool/dbconfig/20260130-152438-marostegui.json [production]
15:09 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P88275 and previous config saved to /var/cache/conftool/dbconfig/20260130-150929-marostegui.json [production]
14:54 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P88274 and previous config saved to /var/cache/conftool/dbconfig/20260130-145421-marostegui.json [production]
14:39 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T415786)', diff saved to https://phabricator.wikimedia.org/P88273 and previous config saved to /var/cache/conftool/dbconfig/20260130-143913-marostegui.json [production]
14:27 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2164 (T415786)', diff saved to https://phabricator.wikimedia.org/P88272 and previous config saved to /var/cache/conftool/dbconfig/20260130-142714-marostegui.json [production]
14:27 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2164.codfw.wmnet with reason: Maintenance [production]
14:26 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88271 and previous config saved to /var/cache/conftool/dbconfig/20260130-142648-marostegui.json [production]
14:11 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P88270 and previous config saved to /var/cache/conftool/dbconfig/20260130-141139-marostegui.json [production]
14:11 <tappof> puppet enabled and services repooled on titan2001 T410152 [production]
14:10 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
14:10 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259 (T415786)', diff saved to https://phabricator.wikimedia.org/P88269 and previous config saved to /var/cache/conftool/dbconfig/20260130-141026-marostegui.json [production]
13:56 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P88268 and previous config saved to /var/cache/conftool/dbconfig/20260130-135627-marostegui.json [production]
13:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20260130-135513-marostegui.json [production]
13:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88266 and previous config saved to /var/cache/conftool/dbconfig/20260130-134117-marostegui.json [production]
13:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259', diff saved to https://phabricator.wikimedia.org/P88265 and previous config saved to /var/cache/conftool/dbconfig/20260130-134001-marostegui.json [production]
13:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2163 (T415786)', diff saved to https://phabricator.wikimedia.org/P88264 and previous config saved to /var/cache/conftool/dbconfig/20260130-133111-marostegui.json [production]
13:31 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2163.codfw.wmnet with reason: Maintenance [production]
13:30 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T415786)', diff saved to https://phabricator.wikimedia.org/P88263 and previous config saved to /var/cache/conftool/dbconfig/20260130-133045-marostegui.json [production]
13:24 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1259 (T415786)', diff saved to https://phabricator.wikimedia.org/P88262 and previous config saved to /var/cache/conftool/dbconfig/20260130-132452-marostegui.json [production]
13:15 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P88261 and previous config saved to /var/cache/conftool/dbconfig/20260130-131533-marostegui.json [production]
13:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P88260 and previous config saved to /var/cache/conftool/dbconfig/20260130-130024-marostegui.json [production]
12:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2154 (T415786)', diff saved to https://phabricator.wikimedia.org/P88259 and previous config saved to /var/cache/conftool/dbconfig/20260130-124515-marostegui.json [production]
12:35 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2154 (T415786)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20260130-123510-marostegui.json [production]
12:35 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2154.codfw.wmnet with reason: Maintenance [production]
12:34 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2152 (T415786)', diff saved to https://phabricator.wikimedia.org/P88257 and previous config saved to /var/cache/conftool/dbconfig/20260130-123442-marostegui.json [production]
12:19 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2152', diff saved to https://phabricator.wikimedia.org/P88256 and previous config saved to /var/cache/conftool/dbconfig/20260130-121934-marostegui.json [production]
12:18 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.newpool (exit_code=0) pool db1209: After schema change [production]