|
2026-02-16
§
|
| 10:01 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.sync-instances sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 10:00 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.localbackup (exit_code=0) Prepare local backup on: gerrit1003.wikimedia.org |
[production] |
| 10:00 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.localbackup Prepare local backup on: gerrit1003.wikimedia.org |
[production] |
| 09:59 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.read-only-toggle (exit_code=0) from gerrit2003.wikimedia.org |
[production] |
| 09:59 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.read-only-toggle from gerrit2003.wikimedia.org |
[production] |
| 09:59 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.read-only-toggle (exit_code=0) from gerrit1003.wikimedia.org |
[production] |
| 09:54 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.read-only-toggle from gerrit1003.wikimedia.org |
[production] |
| 09:50 |
<arnaudb@dns1004> |
START - running authdns-update |
[production] |
| 09:50 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.failover from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 09:50 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.topology-check (exit_code=0) Validate Gerrit topology (source=gerrit1003, replica=gerrit2003) |
[production] |
| 09:50 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.topology-check Validate Gerrit topology (source=gerrit1003, replica=gerrit2003) |
[production] |
| 09:35 |
<hashar@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1239403|Add "Learn more" link below Baby Globe on Minerva (T417077)]], [[gerrit:1239404|Update Qids to initial public version]], [[gerrit:1239419|Escape the unescaped i18n messages (T410091)]], [[gerrit:1239418|Do not show companion when visual editor is active (T417078)]], [[gerrit:1239400|Setting $wgWp25EasterEggsEnable to true for Wikipedias. (T4171 |
[production] |
| 09:22 |
<hashar@deploy2002> |
jdrewniak, jhsoby, hashar, stang: Continuing with sync |
[production] |
| 09:16 |
<hashar@deploy2002> |
jdrewniak, jhsoby, hashar, stang: Backport for [[gerrit:1239403|Add "Learn more" link below Baby Globe on Minerva (T417077)]], [[gerrit:1239404|Update Qids to initial public version]], [[gerrit:1239419|Escape the unescaped i18n messages (T410091)]], [[gerrit:1239418|Do not show companion when visual editor is active (T417078)]], [[gerrit:1239400|Setting $wgWp25EasterEggsEnable to true for Wikipedias |
[production] |
| 08:52 |
<hashar@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1239403|Add "Learn more" link below Baby Globe on Minerva (T417077)]], [[gerrit:1239404|Update Qids to initial public version]], [[gerrit:1239419|Escape the unescaped i18n messages (T410091)]], [[gerrit:1239418|Do not show companion when visual editor is active (T417078)]], [[gerrit:1239400|Setting $wgWp25EasterEggsEnable to true for Wikipedias. (T41711 |
[production] |
| 08:39 |
<mszwarc@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1239337|Add infobox case handling for Special:IPContributions (T417250)]] (duration: 36m 38s) |
[production] |
| 08:26 |
<mszwarc@deploy2002> |
mszwarc, kharlan: Continuing with sync |
[production] |
| 08:26 |
<mszwarc@deploy2002> |
mszwarc, kharlan: Backport for [[gerrit:1239337|Add infobox case handling for Special:IPContributions (T417250)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 08:24 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.sync-instances (exit_code=0) sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 08:21 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.sync-instances sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 08:03 |
<mszwarc@deploy2002> |
Started scap sync-world: Backport for [[gerrit:1239337|Add infobox case handling for Special:IPContributions (T417250)]] |
[production] |
| 07:31 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy1022.eqiad.wmnet with OS trixie |
[production] |
| 07:16 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.sync-instances (exit_code=0) sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 07:13 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.sync-instances sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 07:12 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.sync-instances (exit_code=0) sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 07:08 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.sync-instances sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 07:07 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbproxy1022.eqiad.wmnet with reason: host reimage |
[production] |
| 07:07 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.sync-instances (exit_code=0) sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 07:01 |
<marostegui@cumin1003> |
START - Cookbook sre.hosts.downtime for 2:00:00 on dbproxy1022.eqiad.wmnet with reason: host reimage |
[production] |
| 06:59 |
<arnaudb@cumin1003> |
END (PASS) - Cookbook sre.gerrit.localbackup (exit_code=0) Prepare local backup on: gerrit1003.wikimedia.org |
[production] |
| 06:55 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.sync-instances sync Gerrit data from gerrit1003.wikimedia.org to gerrit2003.wikimedia.org |
[production] |
| 06:55 |
<arnaudb@cumin1003> |
START - Cookbook sre.gerrit.localbackup Prepare local backup on: gerrit1003.wikimedia.org |
[production] |
| 06:45 |
<marostegui@cumin1003> |
START - Cookbook sre.hosts.reimage for host dbproxy1022.eqiad.wmnet with OS trixie |
[production] |
| 06:19 |
<marostegui@cumin1003> |
dbctl commit (dc=all): 'Depooling db2147 (T415786)', diff saved to https://phabricator.wikimedia.org/P88824 and previous config saved to /var/cache/conftool/dbconfig/20260216-061940-marostegui.json |
[production] |
| 06:19 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2147.codfw.wmnet with reason: Maintenance |
[production] |
| 06:18 |
<marostegui@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1150.eqiad.wmnet with reason: Maintenance |
[production] |
| 02:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 12m 46s) |
[production] |
| 02:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
|
2026-02-14
§
|
| 21:09 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance |
[production] |
| 21:09 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1226 (T410589)', diff saved to https://phabricator.wikimedia.org/P88823 and previous config saved to /var/cache/conftool/dbconfig/20260214-210906-ladsgroup.json |
[production] |
| 20:58 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P88822 and previous config saved to /var/cache/conftool/dbconfig/20260214-205858-ladsgroup.json |
[production] |
| 20:48 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P88821 and previous config saved to /var/cache/conftool/dbconfig/20260214-204849-ladsgroup.json |
[production] |
| 20:38 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1226 (T410589)', diff saved to https://phabricator.wikimedia.org/P88820 and previous config saved to /var/cache/conftool/dbconfig/20260214-203841-ladsgroup.json |
[production] |
| 17:57 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Alexandros Kosiaris out of all services on: 2447 hosts |
[production] |
| 10:02 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Depooling db1226 (T410589)', diff saved to https://phabricator.wikimedia.org/P88819 and previous config saved to /var/cache/conftool/dbconfig/20260214-100210-ladsgroup.json |
[production] |
| 10:02 |
<ladsgroup@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1226.eqiad.wmnet with reason: Maintenance |
[production] |
| 10:01 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1214 (T410589)', diff saved to https://phabricator.wikimedia.org/P88818 and previous config saved to /var/cache/conftool/dbconfig/20260214-100145-ladsgroup.json |
[production] |
| 09:51 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P88817 and previous config saved to /var/cache/conftool/dbconfig/20260214-095137-ladsgroup.json |
[production] |