1301-1350 of 10000 results (31ms)
2025-10-15 §
15:03 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db2206 gradually with 4 steps - Pool db2206.codfw.wmnet in after cloning [production]
14:35 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on es2054.codfw.wmnet with reason: Setting up new ES host [production]
13:26 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1260 gradually with 4 steps - Pool db1260.eqiad.wmnet in after cloning [production]
09:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2206 gradually with 4 steps - Pool db2206.codfw.wmnet in after cloning [production]
09:20 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1260 gradually with 4 steps - Pool db1260.eqiad.wmnet in after cloning [production]
08:47 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db2206 gradually with 4 steps - Pool db2206.codfw.wmnet in after cloning [production]
08:19 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.45.0-wmf.23 refs T405679 [production]
08:13 <fceratto@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es2032 gradually with 4 steps - Pool es2032.codfw.wmnet in after cloning [production]
07:28 <fceratto@cumin1002> START - Cookbook sre.mysql.pool es2032 gradually with 4 steps - Pool es2032.codfw.wmnet in after cloning [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1032 gradually with 4 steps - Pool es1032.eqiad.wmnet in after cloning [production]
06:13 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1031 gradually with 4 steps - Pool es1031.eqiad.wmnet in after cloning [production]
05:27 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1032 gradually with 4 steps - Pool es1032.eqiad.wmnet in after cloning [production]
05:27 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1031 gradually with 4 steps - Pool es1031.eqiad.wmnet in after cloning [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 06s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-14 §
15:46 <swfrench-wmf> rolling run-puppet-agent on A:cp hosts - T405955 [production]
15:33 <swfrench-wmf> disable-puppet on A:cp hosts - T405955 [production]
12:30 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db1247 gradually with 4 steps - Pool db1247.eqiad.wmnet in after cloning [production]
11:45 <marostegui@cumin1003> START - Cookbook sre.mysql.pool db1247 gradually with 4 steps - Pool db1247.eqiad.wmnet in after cloning [production]
10:34 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on es2053.codfw.wmnet with reason: Setting up new ES host [production]
08:37 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.45.0-wmf.23 refs T405679 [production]
05:26 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1033 gradually with 4 steps - Pool es1033.eqiad.wmnet in after cloning [production]
04:41 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1033 gradually with 4 steps - Pool es1033.eqiad.wmnet in after cloning [production]
04:02 <mwpresync@deploy2002> Pruned MediaWiki: 1.45.0-wmf.20 (duration: 02m 42s) [production]
03:48 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.45.0-wmf.23 refs T405679 (duration: 45m 02s) [production]
03:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.45.0-wmf.23 refs T405679 [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 20s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-13 §
19:44 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1027 gradually with 4 steps - Pool es1027.eqiad.wmnet in after cloning [production]
18:59 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1027 gradually with 4 steps - Pool es1027.eqiad.wmnet in after cloning [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 25s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-12 §
01:01 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 01m 09s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-11 §
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 25s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-10 §
06:10 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1029 gradually with 4 steps - Pool es1029.eqiad.wmnet in after cloning [production]
06:10 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1034 gradually with 4 steps - Pool es1034.eqiad.wmnet in after cloning [production]
05:25 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1029 gradually with 4 steps - Pool es1029.eqiad.wmnet in after cloning [production]
05:25 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1034 gradually with 4 steps - Pool es1034.eqiad.wmnet in after cloning [production]
01:14 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 32s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
2025-10-09 §
17:30 <cmooney@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs1020.eqiad.wmnet with reason: downtime lvs1020 to supress alerts about enp94s0f0np0 going down and losing backend connectivity [production]
13:06 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on es2053.codfw.wmnet with reason: Setting up new ES host [production]
08:22 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.22 refs T405678 [production]
06:22 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1027 gradually with 4 steps - Pool es1027.eqiad.wmnet in after cloning [production]
06:01 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es1030 gradually with 4 steps - Pool es1030.eqiad.wmnet in after cloning [production]
05:36 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1027 gradually with 4 steps - Pool es1027.eqiad.wmnet in after cloning [production]
05:16 <marostegui@cumin1003> START - Cookbook sre.mysql.pool es1030 gradually with 4 steps - Pool es1030.eqiad.wmnet in after cloning [production]
01:15 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 14m 20s) [production]