|
2023-10-18
§
|
| 09:00 |
<aqu@deploy2002> |
Started deploy [airflow-dags/analytics@c17c91c]: Fix following yesterday weekly train deploy [airflow-dags@c17c91ce] |
[production] |
| 08:54 |
<fnegri@cumin1001> |
START - Cookbook sre.hosts.reimage for host cloudbackup1002-dev.eqiad.wmnet with OS bookworm |
[production] |
| 08:51 |
<jayme@deploy1002> |
helmfile [staging] DONE helmfile.d/services/wikifunctions: apply |
[production] |
| 08:40 |
<jayme@deploy1002> |
helmfile [staging] START helmfile.d/services/wikifunctions: apply |
[production] |
| 08:18 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1001.eqiad.wmnet |
[production] |
| 08:14 |
<volans@cumin2002> |
START - Cookbook sre.hosts.dhcp for host sretest1001.eqiad.wmnet |
[production] |
| 08:08 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1001.eqiad.wmnet |
[production] |
| 08:06 |
<volans@cumin2002> |
START - Cookbook sre.hosts.dhcp for host sretest1001.eqiad.wmnet |
[production] |
| 08:03 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 08:03 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add A/PTR for lsw1-e8/ssw links - ayounsi@cumin1001" |
[production] |
| 08:02 |
<ayounsi@cumin1001> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add A/PTR for lsw1-e8/ssw links - ayounsi@cumin1001" |
[production] |
| 07:54 |
<kevinbazira@deploy2002> |
helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . |
[production] |
| 07:47 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 07:46 |
<marostegui@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db2132.codfw.wmnet with OS bookworm |
[production] |
| 07:40 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2132.codfw.wmnet with reason: host reimage |
[production] |
| 07:37 |
<volans> |
temporarily disabled puppet on the A:cumin hosts to deploy and test spicerack v8.0.0 |
[production] |
| 07:37 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db2132.codfw.wmnet with reason: host reimage |
[production] |
| 07:28 |
<filippo@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:28 |
<filippo@deploy2002> |
helmfile [codfw] START helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:28 |
<filippo@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:28 |
<filippo@deploy2002> |
helmfile [eqiad] START helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:27 |
<filippo@deploy2002> |
helmfile [staging] DONE helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:27 |
<filippo@deploy2002> |
helmfile [staging] START helmfile.d/services/opentelemetry-collector: apply |
[production] |
| 07:20 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.reimage for host db2132.codfw.wmnet with OS bookworm |
[production] |
| 07:06 |
<aqu@deploy2002> |
Finished deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train (run 2) [airflow-dags@5dcce3bd] (duration: 00m 07s) |
[production] |
| 07:05 |
<aqu@deploy2002> |
Started deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train (run 2) [airflow-dags@5dcce3bd] |
[production] |
| 07:05 |
<aqu@deploy2002> |
Finished deploy [airflow-dags/analytics_test@be05071]: (no justification provided) (duration: 00m 06s) |
[production] |
| 07:05 |
<aqu@deploy2002> |
Started deploy [airflow-dags/analytics_test@be05071]: (no justification provided) |
[production] |
| 07:04 |
<aqu@deploy2002> |
deploy aborted: Add missing MR in yesterday weekly train [airflow-dags@5dcce3bd] (duration: 03m 52s) |
[production] |
| 07:00 |
<aqu@deploy2002> |
Started deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train [airflow-dags@5dcce3bd] |
[production] |
| 07:00 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2160.codfw.wmnet with OS bookworm |
[production] |
| 06:39 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2160.codfw.wmnet with reason: host reimage |
[production] |
| 06:38 |
<XioNoX> |
push pfw policies - T349101 |
[production] |
| 06:36 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db2160.codfw.wmnet with reason: host reimage |
[production] |
| 06:16 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.reimage for host db2160.codfw.wmnet with OS bookworm |
[production] |
| 06:08 |
<marostegui@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host db2160.codfw.wmnet with OS bookworm |
[production] |
| 05:57 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.reimage for host db2160.codfw.wmnet with OS bookworm |
[production] |
| 01:22 |
<eileen> |
civicrm upgraded from da11d010 to d8fe92e3 |
[production] |
|
2023-10-17
§
|
| 22:03 |
<herron> |
pyrra.wm.o upgraded to 0.7.1 T302995 |
[production] |
| 21:32 |
<catrope@deploy2002> |
backport Cancelled |
[production] |
| 21:10 |
<inflatador> |
bking@cumin1001 repool wdqs eqiad after rdf-streaming-updater fix |
[production] |
| 21:05 |
<catrope@deploy2002> |
Finished scap: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] (duration: 13m 03s) |
[production] |
| 21:00 |
<catrope@deploy2002> |
catrope and jdrewniak: Continuing with sync |
[production] |
| 20:53 |
<catrope@deploy2002> |
catrope and jdrewniak: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 20:52 |
<inflatador> |
bking@cumin1001 depool wdqs eqiad due to rdf-streaming-updater failure |
[production] |
| 20:52 |
<catrope@deploy2002> |
Started scap: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] |
[production] |
| 20:36 |
<volans> |
uploaded spicerack_8.0.0 to apt.wikimedia.org bullseye-wikimedia |
[production] |
| 20:36 |
<eevans@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/sessionstore: apply |
[production] |
| 20:36 |
<eevans@deploy2002> |
helmfile [codfw] START helmfile.d/services/sessionstore: apply |
[production] |
| 20:34 |
<eevans@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/sessionstore: apply |
[production] |