3651-3700 of 10000 results (87ms)
2023-10-18 §
07:37 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2132.codfw.wmnet with reason: host reimage [production]
07:28 <filippo@deploy2002> helmfile [codfw] DONE helmfile.d/services/opentelemetry-collector: apply [production]
07:28 <filippo@deploy2002> helmfile [codfw] START helmfile.d/services/opentelemetry-collector: apply [production]
07:28 <filippo@deploy2002> helmfile [eqiad] DONE helmfile.d/services/opentelemetry-collector: apply [production]
07:28 <filippo@deploy2002> helmfile [eqiad] START helmfile.d/services/opentelemetry-collector: apply [production]
07:27 <filippo@deploy2002> helmfile [staging] DONE helmfile.d/services/opentelemetry-collector: apply [production]
07:27 <filippo@deploy2002> helmfile [staging] START helmfile.d/services/opentelemetry-collector: apply [production]
07:20 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db2132.codfw.wmnet with OS bookworm [production]
07:06 <aqu@deploy2002> Finished deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train (run 2) [airflow-dags@5dcce3bd] (duration: 00m 07s) [production]
07:05 <aqu@deploy2002> Started deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train (run 2) [airflow-dags@5dcce3bd] [production]
07:05 <aqu@deploy2002> Finished deploy [airflow-dags/analytics_test@be05071]: (no justification provided) (duration: 00m 06s) [production]
07:05 <aqu@deploy2002> Started deploy [airflow-dags/analytics_test@be05071]: (no justification provided) [production]
07:04 <aqu@deploy2002> deploy aborted: Add missing MR in yesterday weekly train [airflow-dags@5dcce3bd] (duration: 03m 52s) [production]
07:00 <aqu@deploy2002> Started deploy [airflow-dags/analytics@5dcce3b]: Add missing MR in yesterday weekly train [airflow-dags@5dcce3bd] [production]
07:00 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2160.codfw.wmnet with OS bookworm [production]
06:39 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2160.codfw.wmnet with reason: host reimage [production]
06:38 <XioNoX> push pfw policies - T349101 [production]
06:36 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2160.codfw.wmnet with reason: host reimage [production]
06:16 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db2160.codfw.wmnet with OS bookworm [production]
06:08 <marostegui@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host db2160.codfw.wmnet with OS bookworm [production]
05:57 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db2160.codfw.wmnet with OS bookworm [production]
01:22 <eileen> civicrm upgraded from da11d010 to d8fe92e3 [production]
2023-10-17 §
22:03 <herron> pyrra.wm.o upgraded to 0.7.1 T302995 [production]
21:32 <catrope@deploy2002> backport Cancelled [production]
21:10 <inflatador> bking@cumin1001 repool wdqs eqiad after rdf-streaming-updater fix [production]
21:05 <catrope@deploy2002> Finished scap: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] (duration: 13m 03s) [production]
21:00 <catrope@deploy2002> catrope and jdrewniak: Continuing with sync [production]
20:53 <catrope@deploy2002> catrope and jdrewniak: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:52 <inflatador> bking@cumin1001 depool wdqs eqiad due to rdf-streaming-updater failure [production]
20:52 <catrope@deploy2002> Started scap: Backport for [[gerrit:966607|Add language prefix to Readability survey (T347208)]] [production]
20:36 <volans> uploaded spicerack_8.0.0 to apt.wikimedia.org bullseye-wikimedia [production]
20:36 <eevans@deploy2002> helmfile [codfw] DONE helmfile.d/services/sessionstore: apply [production]
20:36 <eevans@deploy2002> helmfile [codfw] START helmfile.d/services/sessionstore: apply [production]
20:34 <eevans@deploy2002> helmfile [eqiad] DONE helmfile.d/services/sessionstore: apply [production]
20:34 <eevans@deploy2002> helmfile [eqiad] START helmfile.d/services/sessionstore: apply [production]
20:31 <eevans@deploy2002> helmfile [staging] DONE helmfile.d/services/sessionstore: apply [production]
20:31 <eevans@deploy2002> helmfile [staging] START helmfile.d/services/sessionstore: apply [production]
20:29 <catrope@deploy2002> Finished scap: Backport for [[gerrit:966636|Fixes incorrect Hebrew logo and applies gotwiki (T341253 T341251)]] (duration: 09m 59s) [production]
20:27 <eevans@deploy2002> helmfile [codfw] DONE helmfile.d/services/echostore: apply [production]
20:26 <eevans@deploy2002> helmfile [codfw] START helmfile.d/services/echostore: apply [production]
20:24 <eevans@deploy2002> helmfile [eqiad] DONE helmfile.d/services/echostore: apply [production]
20:24 <eevans@deploy2002> helmfile [eqiad] START helmfile.d/services/echostore: apply [production]
20:24 <catrope@deploy2002> jdlrobson and catrope: Continuing with sync [production]
20:21 <eevans@deploy2002> helmfile [staging] DONE helmfile.d/services/echostore: apply [production]
20:21 <eevans@deploy2002> helmfile [staging] START helmfile.d/services/echostore: apply [production]
20:20 <catrope@deploy2002> jdlrobson and catrope: Backport for [[gerrit:966636|Fixes incorrect Hebrew logo and applies gotwiki (T341253 T341251)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:19 <catrope@deploy2002> Started scap: Backport for [[gerrit:966636|Fixes incorrect Hebrew logo and applies gotwiki (T341253 T341251)]] [production]
20:16 <catrope@deploy2002> Finished scap: Backport for [[gerrit:966314|Wordmark for blk wiktionary and got wikipedia (T341253 T341257)]] (duration: 11m 17s) [production]
20:11 <catrope@deploy2002> catrope and jdlrobson: Continuing with sync [production]
20:06 <catrope@deploy2002> catrope and jdlrobson: Backport for [[gerrit:966314|Wordmark for blk wiktionary and got wikipedia (T341253 T341257)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]