6551-6600 of 10000 results (47ms)
2021-05-05 §
01:39 <ryankemper> T280382 `sudo -i cookbook sre.wdqs.data-transfer --source wdqs1006.eqiad.wmnet --dest wdqs1011.eqiad.wmnet --reason "transferring fresh categories journal following reimage" --blazegraph_instance categories` on `ryankemper@cumin1001` tmux session `reimage` [production]
01:39 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
01:36 <ryankemper@cumin1001> START - Cookbook sre.elasticsearch.rolling-operation reboot without plugin upgrade (3 nodes at a time) for ElasticSearch cluster search_eqiad: eqiad reboot to apply sec updates - ryankemper@cumin1001 - T280563 [production]
00:29 <eileen> civicrm revision changed from 94e321dbe0 to e7c610fd87, config revision is 189788d452 [production]
00:15 <ejegg> updated payments-wiki from 44570561f2 to d449599540 [production]
00:08 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 3f6ea8c0e5a4dc667969f5847207902727625bbe: Growth: enwiki: Add list of mentors (T281896) (duration: 01m 10s) [production]
00:00 <urbanecm@deploy1002> Synchronized fc-list: 93970496da7678d896b7f812b3bb5f4cf0b691ad: update fc-list to current version on buster (T79424) (duration: 01m 09s) [production]
2021-05-04 §
23:41 <urbanecm@deploy1002> Synchronized wmf-config/config/enwiki.yaml: d29dbb2f435afe64f2fee15b430ee04d5d13c8d7: Enable Growth features on enwiki in the dark mode (T281896; 3/3) (duration: 01m 09s) [production]
23:40 <urbanecm@deploy1002> Synchronized dblists/growthexperiments.dblist: d29dbb2f435afe64f2fee15b430ee04d5d13c8d7: Enable Growth features on enwiki in the dark mode (T281896; 2/3) (duration: 01m 09s) [production]
23:38 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: d29dbb2f435afe64f2fee15b430ee04d5d13c8d7: Enable Growth features on enwiki in the dark mode (T281896; 1/3) (duration: 01m 09s) [production]
23:31 <urbanecm@deploy1002> Synchronized wmf-config/config/bgwiki.yaml: 5b4c516a1d0461065e27cacec5d2b1cb315a2c07: Enable Growth team features in dark mode on bgwiki (T280824; 3/3) (duration: 01m 09s) [production]
23:30 <urbanecm@deploy1002> sync-file aborted: 5b4c516a1d0461065e27cacec5d2b1cb315a2c07: Enable Growth team features in dark mode on bgwiki (T280824; 3/3) (duration: 00m 03s) [production]
23:30 <urbanecm@deploy1002> Synchronized dblists/growthexperiments.dblist: 5b4c516a1d0461065e27cacec5d2b1cb315a2c07: Enable Growth team features in dark mode on bgwiki (T280824; 2/3) (duration: 01m 09s) [production]
23:28 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 5b4c516a1d0461065e27cacec5d2b1cb315a2c07: Enable Growth team features in dark mode on bgwiki (T280824; 1/3) (duration: 01m 09s) [production]
23:26 <Urbanecm> Create tables for GrowthExperiments extension on enwiki (T281896) [production]
23:24 <Urbanecm> Create tables for GrowthExperiments extension on bgwiki (T280824) [production]
23:22 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: a3c24f322b754c9a94c260ee5df4b5ae4de27f22: Avoid using User::getGroups() and ::getEffectiveGroups() (T281823) (duration: 01m 10s) [production]
23:13 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e467d92e5e257a3d2f9b05692db9accdd86ddb00: Add extendedconfirmed on ptwiki (T281926) (duration: 01m 10s) [production]
23:06 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 012d6138741ea76c985453428111aeddfdec2271: Add extendedconfirmed on azwiki (T281860) (duration: 01m 10s) [production]
22:49 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cp5016.eqsin.wmnet with reason: REIMAGE [production]
22:47 <bblack@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cp5015.eqsin.wmnet with reason: REIMAGE [production]
22:46 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5014.eqsin.wmnet with reason: REIMAGE [production]
22:44 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5016.eqsin.wmnet with reason: REIMAGE [production]
22:44 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5013.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5015.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5014.eqsin.wmnet with reason: REIMAGE [production]
22:42 <bblack@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5013.eqsin.wmnet with reason: REIMAGE [production]
21:30 <eileen> civicrm revision changed from 33a63d5789 to 94e321dbe0, config revision is a212d6ab23 [production]
21:17 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@06a4a3e]: Bump glent to 0.2.4 (duration: 03m 55s) [production]
21:13 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@06a4a3e]: Bump glent to 0.2.4 [production]
20:13 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:10 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
20:09 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7] (hadoop-test): Regular analytics weekly train HADOOP-TEST [analytics/refinery@0dc3ae7] (duration: 05m 16s) [production]
20:04 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7] (hadoop-test): Regular analytics weekly train HADOOP-TEST [analytics/refinery@0dc3ae7] [production]
20:03 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7] (thin): Regular analytics weekly train THIN [analytics/refinery@0dc3ae7] (duration: 00m 07s) [production]
20:03 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7] (thin): Regular analytics weekly train THIN [analytics/refinery@0dc3ae7] [production]
20:03 <joal@deploy1002> Finished deploy [analytics/refinery@0dc3ae7]: Regular analytics weekly train [analytics/refinery@0dc3ae7] (duration: 17m 15s) [production]
19:46 <joal@deploy1002> Started deploy [analytics/refinery@0dc3ae7]: Regular analytics weekly train [analytics/refinery@0dc3ae7] [production]
19:38 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.4 [production]
17:58 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.4 (duration: 42m 33s) [production]
17:26 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@0c4538f]: Increase convert_to_esbulk memory overhead (duration: 01m 46s) [production]
17:24 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@0c4538f]: Increase convert_to_esbulk memory overhead [production]
17:16 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.4 [production]
17:02 <brennen> 1.37.0-wmf.4 was branched at f069fd8b5a6c817f4860fa68ae2f56b71a139f4a for T281145 [production]
17:00 <volans> uploaded spicerack_0.0.51 to apt.wikimedia.org bullseye-wikimedia [production]
16:26 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@e6ae572]: Increase convert_to_esbulk memory overhead (duration: 01m 54s) [production]
16:25 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@e6ae572]: Increase convert_to_esbulk memory overhead [production]
16:16 <dzahn@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:15 <dzahn@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
16:13 <mutante> k8s: upgrading release=namespaces, helmfile apply to create miscweb namespace T281538 [production]