4251-4300 of 10000 results (75ms)
2022-10-05 ยง
18:23 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.40.0-wmf.4 refs T314193 [production]
18:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
18:18 <brennen> train 1.40.0-wmf.4 (T314193) no current blockers, rolling train to group1 [production]
18:05 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns4003.wikimedia.org with reason: host reimage [production]
18:01 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on dns4003.wikimedia.org with reason: host reimage [production]
17:54 <ejegg> payments-wiki upgraded from aeee9676 to 4e1f308b [production]
17:43 <sukhe@cumin2002> START - Cookbook sre.hosts.reimage for host dns4003.wikimedia.org with OS buster [production]
17:20 <mforns@deploy1002> Finished deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] (duration: 00m 14s) [production]
17:20 <mforns@deploy1002> Started deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] [production]
17:18 <mforns@deploy1002> Finished deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] (duration: 00m 18s) [production]
17:18 <mforns@deploy1002> Started deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] [production]
17:17 <mforns@deploy1002> Finished deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] (duration: 04m 24s) [production]
17:12 <mforns@deploy1002> Started deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] [production]
16:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
16:55 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
16:55 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
16:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
16:53 <cjming> deployed labs-only config [production]
15:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on ganeti1012.eqiad.wmnet with reason: Downtime for removal from Ganeti cluster and eventual bullseye reimage [production]
15:39 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on ganeti1012.eqiad.wmnet with reason: Downtime for removal from Ganeti cluster and eventual bullseye reimage [production]
15:29 <moritzm> installing gdal security updates [production]
15:27 <SandraEbele> deployed refinery source [production]
14:51 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime for 15 days, 0:00:00 on cloudnet[1005-1006].eqiad.wmnet with reason: migrating [production]
14:39 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cloudnet1004.eqiad.wmnet with reason: decom [production]
14:38 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on cloudnet1004.eqiad.wmnet with reason: decom [production]
14:38 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cloudnet1003.eqiad.wmnet with reason: decom [production]
14:38 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on cloudnet1003.eqiad.wmnet with reason: decom [production]
14:36 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 8359 [production]
14:34 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 8359 [production]
14:30 <papaul> on going maintenance on msw1-eqiad [production]
14:26 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti1032.eqiad.wmnet with OS bullseye [production]
14:20 <mforns@deploy1002> Finished deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] (duration: 04m 24s) [production]
14:16 <mforns@deploy1002> Started deploy [analytics/refinery@7e16d2a] (thin): Regular analytics weekly train THIN [analytics/refinery@7e16d2a] [production]
14:16 <mforns@deploy1002> Finished deploy [analytics/refinery@7e16d2a]: Regular analytics weekly train [analytics/refinery@7e16d2a] (duration: 10m 27s) [production]
14:15 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
14:11 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti1032.eqiad.wmnet with reason: host reimage [production]
14:08 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti1032.eqiad.wmnet with reason: host reimage [production]
14:07 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
14:06 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
14:05 <mforns@deploy1002> Started deploy [analytics/refinery@7e16d2a]: Regular analytics weekly train [analytics/refinery@7e16d2a] [production]
13:55 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti1032.eqiad.wmnet with OS bullseye [production]
13:37 <ebysans@deploy1002> Finished deploy [airflow-dags/analytics@f7a68c2]: (no justification provided) (duration: 00m 12s) [production]
13:36 <ebysans@deploy1002> Started deploy [airflow-dags/analytics@f7a68c2]: (no justification provided) [production]
13:27 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
13:26 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
13:26 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
13:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
13:22 <SandraEbele> deploying fix for projectview dags on airflow [production]
13:21 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for enwiktionary/frwiki (duration: 03m 38s) [production]
13:20 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]