|
2025-07-29
ยง
|
| 14:40 |
<fceratto@cumin1002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance |
[production] |
| 14:40 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.69 |
[production] |
| 14:40 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.68 |
[production] |
| 14:40 |
<fceratto@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db1259 (T399728)', diff saved to https://phabricator.wikimedia.org/P80265 and previous config saved to /var/cache/conftool/dbconfig/20250729-144008-fceratto.json |
[production] |
| 14:40 |
<marostegui@cumin1002> |
dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P80264 and previous config saved to /var/cache/conftool/dbconfig/20250729-144000-marostegui.json |
[production] |
| 14:39 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.68 |
[production] |
| 14:39 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.67 |
[production] |
| 14:39 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.67 |
[production] |
| 14:38 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.66 |
[production] |
| 14:38 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.66 |
[production] |
| 14:38 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.65 |
[production] |
| 14:37 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.65 |
[production] |
| 14:37 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.64 |
[production] |
| 14:37 |
<zabe@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1169769|Stop writing to cl_to and cl_collation on testwiki (T399579)]] (duration: 11m 12s) |
[production] |
| 14:37 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.64 |
[production] |
| 14:37 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.63 |
[production] |
| 14:36 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.63 |
[production] |
| 14:36 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.62 |
[production] |
| 14:35 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.62 |
[production] |
| 14:35 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.61 |
[production] |
| 14:35 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.61 |
[production] |
| 14:35 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.60 |
[production] |
| 14:34 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.60 |
[production] |
| 14:34 |
<fabfur> |
applying https://gerrit.wikimedia.org/r/c/operations/puppet/+/1173950 and upgrading haproxykafka to 0.3.12 on A:cp (T400199) |
[production] |
| 14:34 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5f |
[production] |
| 14:34 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5f |
[production] |
| 14:34 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5e |
[production] |
| 14:33 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5e |
[production] |
| 14:33 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5d |
[production] |
| 14:33 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5d |
[production] |
| 14:32 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5c |
[production] |
| 14:32 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5c |
[production] |
| 14:32 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5b |
[production] |
| 14:31 |
<zabe@deploy1003> |
zabe: Continuing with sync |
[production] |
| 14:31 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5b |
[production] |
| 14:31 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.5a |
[production] |
| 14:31 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.5a |
[production] |
| 14:31 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.59 |
[production] |
| 14:30 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.59 |
[production] |
| 14:30 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.58 |
[production] |
| 14:29 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.58 |
[production] |
| 14:29 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.57 |
[production] |
| 14:29 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.57 |
[production] |
| 14:29 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.56 |
[production] |
| 14:28 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.56 |
[production] |
| 14:28 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.55 |
[production] |
| 14:28 |
<zabe@deploy1003> |
zabe: Backport for [[gerrit:1169769|Stop writing to cl_to and cl_collation on testwiki (T399579)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 14:28 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.55 |
[production] |
| 14:28 |
<mvernon@cumin2002> |
END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-public.54 |
[production] |
| 14:27 |
<mvernon@cumin2002> |
START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-public.54 |
[production] |