|
2026-05-12
ยง
|
| 13:57 |
<vriley@cumin1003> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:57 |
<vriley@cumin1003> |
END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) |
[production] |
| 13:54 |
<vriley@cumin1003> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:54 |
<vriley@cumin1003> |
END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) |
[production] |
| 13:51 |
<vriley@cumin1003> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:51 |
<vriley@cumin1003> |
START - Cookbook sre.hosts.reimage for host db1270.eqiad.wmnet with OS bookworm |
[production] |
| 13:50 |
<otto@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/eventgate-main: sync |
[production] |
| 13:50 |
<otto@deploy1003> |
helmfile [eqiad] START helmfile.d/services/eventgate-main: sync |
[production] |
| 13:49 |
<sukhe@cumin1003> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host lvs1017.eqiad.wmnet with OS bullseye |
[production] |
| 13:49 |
<otto@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/eventgate-main: sync |
[production] |
| 13:49 |
<otto@deploy1003> |
helmfile [codfw] START helmfile.d/services/eventgate-main: sync |
[production] |
| 13:49 |
<otto@deploy1003> |
helmfile [staging] DONE helmfile.d/services/eventgate-main: sync |
[production] |
| 13:48 |
<otto@deploy1003> |
helmfile [staging] START helmfile.d/services/eventgate-main: sync |
[production] |
| 13:48 |
<ottomata> |
roll restart eventgate main to pick up mediawiki/page/change/1.4.0 schema version for T423583 |
[production] |
| 13:32 |
<sukhe@cumin1003> |
START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bullseye |
[production] |
| 13:29 |
<lucaswerkmeister-wmde@deploy1003> |
audreypenven, lucaswerkmeister-wmde, otto: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286341|page_change - add revision.revert info]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 13:27 |
<lucaswerkmeister-wmde@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286341|page_change - add revision.revert info]] |
[production] |
| 13:20 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2233.codfw.wmnet with reason: Reboot |
[production] |
| 13:17 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on dbproxy2006.codfw.wmnet with reason: Reboot |
[production] |
| 13:14 |
<sbisson@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] (duration: 07m 13s) |
[production] |
| 13:09 |
<sbisson@deploy1003> |
sbisson: Continuing with deployment |
[production] |
| 13:08 |
<sbisson@deploy1003> |
sbisson: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 13:06 |
<sbisson@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] |
[production] |
| 12:40 |
<jiji@deploy1003> |
helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply |
[production] |
| 12:38 |
<jiji@deploy1003> |
helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply |
[production] |
| 12:26 |
<jiji@deploy1003> |
helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply |
[production] |
| 12:26 |
<jiji@deploy1003> |
helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply |
[production] |
| 12:25 |
<dreamyjazz@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T42 |
[production] |
| 12:20 |
<dreamyjazz@deploy1003> |
dreamyjazz: Continuing with deployment |
[production] |
| 12:17 |
<dreamyjazz@deploy1003> |
dreamyjazz: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T425940)]] synced |
[production] |
| 12:15 |
<dreamyjazz@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T425 |
[production] |
| 12:10 |
<kharlan@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] (duration: 07m 45s) |
[production] |
| 12:06 |
<kharlan@deploy1003> |
kharlan: Continuing with deployment |
[production] |
| 12:04 |
<kharlan@deploy1003> |
kharlan: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 12:02 |
<kharlan@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] |
[production] |
| 10:31 |
<cmooney@cumin1003> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "add new networks ibgp peering - cmooney@cumin1003" |
[production] |
| 10:31 |
<cmooney@cumin1003> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "add new networks ibgp peering - cmooney@cumin1003" |
[production] |
| 09:56 |
<kharlan@deploy1003> |
Finished scap sync-world: Backport for [[gerrit:1286295|Update UserEntitySerializer callers (T426026)]] (duration: 07m 43s) |
[production] |
| 09:51 |
<kharlan@deploy1003> |
kharlan: Continuing with deployment |
[production] |
| 09:50 |
<kharlan@deploy1003> |
kharlan: Backport for [[gerrit:1286295|Update UserEntitySerializer callers (T426026)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. |
[production] |
| 09:48 |
<kharlan@deploy1003> |
Started scap sync-world: Backport for [[gerrit:1286295|Update UserEntitySerializer callers (T426026)]] |
[production] |
| 09:20 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance es1036 (T419961)', diff saved to https://phabricator.wikimedia.org/P92480 and previous config saved to /var/cache/conftool/dbconfig/20260512-092034-fceratto.json |
[production] |
| 09:10 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance es1036', diff saved to https://phabricator.wikimedia.org/P92479 and previous config saved to /var/cache/conftool/dbconfig/20260512-091025-fceratto.json |
[production] |
| 09:00 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance es1036', diff saved to https://phabricator.wikimedia.org/P92478 and previous config saved to /var/cache/conftool/dbconfig/20260512-090017-fceratto.json |
[production] |
| 08:50 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance es1036 (T419961)', diff saved to https://phabricator.wikimedia.org/P92477 and previous config saved to /var/cache/conftool/dbconfig/20260512-085009-fceratto.json |
[production] |
| 08:35 |
<fceratto@cumin1003> |
dbctl commit (dc=all): 'Depooling es1036 (T419961)', diff saved to https://phabricator.wikimedia.org/P92476 and previous config saved to /var/cache/conftool/dbconfig/20260512-083526-fceratto.json |
[production] |
| 08:35 |
<fceratto@cumin1003> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on es1036.eqiad.wmnet with reason: Maintenance |
[production] |
| 08:21 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2150: after reimage to trixie |
[production] |
| 08:17 |
<aklapper@deploy1003> |
rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.2 refs T423911 |
[production] |
| 08:14 |
<marostegui@cumin1003> |
END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1231: after reimage to trixie |
[production] |