2401-2450 of 10000 results (115ms)
2024-11-13 §
05:17 <eileen> civicrm upgraded from ad008134 to 23e08fc2 [production]
02:56 <tchin@deploy2002> Finished deploy [airflow-dags/analytics@58d7b82]: (no justification provided) (duration: 00m 10s) [production]
02:56 <tchin@deploy2002> Started deploy [airflow-dags/analytics@58d7b82]: (no justification provided) [production]
02:55 <tchin@deploy2002> deploy aborted: failedpythonlol (duration: 00m 05s) [production]
02:55 <tchin@deploy2002> Started deploy [airflow-dags/analytics@58d7b82]: failedpythonlol [production]
00:54 <tchin@deploy2002> Started deploy [airflow-dags/analytics@58d7b82]: (no justification provided) [production]
00:35 <ejegg> payments-wiki upgraded from 7d24a942 to 459f259b [production]
2024-11-12 §
23:28 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bullseye [production]
23:11 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage [production]
23:08 <jhathaway@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage [production]
22:35 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye [production]
22:11 <jhathaway@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2082.codfw.wmnet with OS bullseye [production]
21:55 <jhathaway@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage [production]
21:55 <jhathaway@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2082.codfw.wmnet with reason: host reimage [production]
21:28 <ebysans@deploy2002> Finished deploy [airflow-dags/analytics@58d7b82]: (no justification provided) (duration: 03m 50s) [production]
21:27 <SandraEbele_> deploying airflow as part of weekly deployment train [production]
21:27 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] (duration: 16m 11s) [production]
21:25 <ebysans@deploy2002> Started deploy [airflow-dags/analytics@58d7b82]: (no justification provided) [production]
21:23 <SandraEbele_> Deployed refinery using scap, then deployed onto hdfs [production]
21:22 <urbanecm@deploy2002> urbanecm, tgr: Continuing with sync [production]
21:22 <jhathaway@cumin2002> START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye [production]
21:13 <urbanecm@deploy2002> urbanecm, tgr: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:11 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] [production]
21:09 <urbanecm@deploy2002> Finished scap sync-world: Backport for [[gerrit:1090550|Revert^2 "[CirrusSearch] testwiki: enable offloading weighted tags via EventBus" (T378983)]] (duration: 07m 18s) [production]
21:04 <ebysans@deploy2002> Finished deploy [analytics/refinery@113ea5a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@113ea5ac] (duration: 04m 09s) [production]
21:02 <urbanecm@deploy2002> Started scap sync-world: Backport for [[gerrit:1090550|Revert^2 "[CirrusSearch] testwiki: enable offloading weighted tags via EventBus" (T378983)]] [production]
20:59 <ebysans@deploy2002> Started deploy [analytics/refinery@113ea5a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@113ea5ac] [production]
20:59 <ebysans@deploy2002> Finished deploy [analytics/refinery@113ea5a] (thin): Regular analytics weekly train THIN [analytics/refinery@113ea5ac] (duration: 04m 54s) [production]
20:54 <ebysans@deploy2002> Started deploy [analytics/refinery@113ea5a] (thin): Regular analytics weekly train THIN [analytics/refinery@113ea5ac] [production]
20:53 <ebysans@deploy2002> Finished deploy [analytics/refinery@113ea5a]: Regular analytics weekly train [analytics/refinery@113ea5ac] (duration: 07m 37s) [production]
20:49 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
20:46 <ebysans@deploy2002> Started deploy [analytics/refinery@113ea5a]: Regular analytics weekly train [analytics/refinery@113ea5ac] [production]
19:42 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-ctrl1001.eqiad.wmnet [production]
19:42 <jayme@cumin2002> START - Cookbook sre.hosts.remove-downtime for wikikube-ctrl1001.eqiad.wmnet [production]
19:42 <jayme@cumin2002> conftool action : set/pooled=yes; selector: name=wikikube-ctrl1001.* [production]
19:40 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm [production]
19:16 <jayme@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl1001.eqiad.wmnet with reason: host reimage [production]
19:14 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.3 refs T375662 [production]
19:13 <jayme@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl1001.eqiad.wmnet with reason: host reimage [production]
19:06 <brennen> 1.44.0-wmf.3 train status (T375662): no current blockers, rolling to group0. [production]
18:55 <moritzm> installing libarchive security updates [production]
18:55 <jayme@cumin2002> START - Cookbook sre.hosts.reimage for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm [production]
18:31 <swfrench@deploy2002> Finished scap sync-world: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] (duration: 18m 48s) [production]
18:25 <swfrench@deploy2002> swfrench: Continuing with sync [production]
18:24 <swfrench-wmf> verified consistent 7.4-like title-case behavior in 7.4- and 8.1-based images, verified expected treatment of eszett in mwdebug - T372603 [production]
18:19 <swfrench@deploy2002> swfrench: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
18:12 <swfrench@deploy2002> Started scap sync-world: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] [production]
18:08 <jayme@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm [production]
18:01 <moritzm> remove ganeti1012 from active ganeti nodes T378921 [production]
17:59 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]