51-100 of 10000 results (25ms)
2021-01-28 ยง
21:23 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2287.codfw.wmnet with reason: REIMAGE [production]
21:23 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2286.codfw.wmnet with reason: REIMAGE [production]
21:19 <brennen@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.28 (duration: 01m 05s) [production]
21:17 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.28 [production]
21:15 <brennen> 1.36.0-wmf.28 train status (T271342): blockers resolved, going go group1 to be follow shortly by all wikis [production]
21:11 <brennen@deploy1001> Synchronized php-1.36.0-wmf.28/extensions/CentralAuth/includes/: Backport: [[gerrit:659362|Revert CentralAuthCreateLocalAccountJob changes in 9f79de4 (T273205)]] (duration: 01m 09s) [production]
20:49 <brennen@deploy1001> Synchronized php-1.36.0-wmf.28/tests/phpunit/includes/parser/ParserOptionsTest.php: Backport: [[gerrit:659103|Make ParserOptions::isSafeToCache more robust (T273120)]] (duration: 01m 07s) [production]
20:46 <brennen@deploy1001> Synchronized php-1.36.0-wmf.28/includes/parser/ParserOptions.php: Backport: [[gerrit:659103|Make ParserOptions::isSafeToCache more robust (T273120)]] (duration: 01m 08s) [production]
20:25 <bblack> lvs1014,lvs1016 - all back to "normal" state [production]
20:24 <bblack> lvs1014 - restart pybal [production]
20:20 <bblack> lvs1016 - restart pybal [production]
20:15 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@911731d]: write articletopic and drafttopic to hourly tables (duration: 01m 44s) [production]
20:13 <bblack> lvs1014,lvs1016 - puppet temporarily disabled for new service config deploy - T271476 [production]
20:13 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2223.codfw.wmnet [production]
20:13 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2247.codfw.wmnet [production]
20:13 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1264.eqiad.wmnet [production]
20:13 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@911731d]: write articletopic and drafttopic to hourly tables [production]
20:13 <mutante> scap pulling and repooling: mw1264, mw2223, mw2247 [production]
20:11 <bstorm@cumin1001> conftool action : set/pooled=yes; selector: name=dbproxy1019.eqiad.wmnet [production]
20:10 <bstorm@cumin1001> conftool action : set/pooled=yes; selector: name=dbproxy1018.eqiad.wmnet [production]
20:01 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2223.codfw.wmnet [production]
20:00 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2247.codfw.wmnet [production]
20:00 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1264.eqiad.wmnet [production]
19:57 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1171.eqiad.wmnet with reason: REIMAGE [production]
19:55 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1171.eqiad.wmnet with reason: REIMAGE [production]
19:53 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@ba1acd6]: airflow: start ores_predictions_daily one day earlier (duration: 01m 09s) [production]
19:52 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@ba1acd6]: airflow: start ores_predictions_daily one day earlier [production]
19:45 <Urbanecm> Run mwscript namespaceDupes.php --wiki=frwikisource --add-prefix=BROKEN --fix (T271939) [production]
19:44 <Urbanecm> Run mwscript namespaceDupes.php --wiki=frwikisource --fix (T271939) [production]
19:42 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 0ae49093893316657ffd7cf56669a470fb073352: frwikisource: Add WS as an alias to NS_PROJECT (T271939) (duration: 00m 57s) [production]
19:37 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: fd18092fd8b73414f6c320895601c83b883e29ee: Add image.laji.fi to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T270587) (duration: 01m 04s) [production]
19:36 <jynus> extending backup1001 /dev/mapper/array1-archive partition to allocate enough space for helium backups T238048 [production]
19:30 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 519350b86bd4afc8d4efc3c2f9b2631a0ced22c2: frwiktionary: Change babel category names per community request (T270186) (duration: 00m 59s) [production]
19:23 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1163.eqiad.wmnet with reason: REIMAGE [production]
19:22 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 3d0ca3a11a59063e5adfc126702032ea357e8524: Create patroller user group for thwiki (T272149) (duration: 01m 07s) [production]
19:20 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1163.eqiad.wmnet with reason: REIMAGE [production]
19:19 <mforns@deploy1001> Finished deploy [analytics/refinery@1e41f60] (thin): Regular analytics weekly train THIN [analytics/refinery@1e41f608fad96e7a9f77eb28cd1c082a0a01d562] (duration: 00m 08s) [production]
19:19 <mforns@deploy1001> Started deploy [analytics/refinery@1e41f60] (thin): Regular analytics weekly train THIN [analytics/refinery@1e41f608fad96e7a9f77eb28cd1c082a0a01d562] [production]
19:15 <mforns@deploy1001> Finished deploy [analytics/refinery@1e41f60]: Regular analytics weekly train [analytics/refinery@1e41f608fad96e7a9f77eb28cd1c082a0a01d562] (duration: 16m 53s) [production]
19:14 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: e914f1e65adfdf2f41af97363501b0ba3c40d5b8: robots: cawikimedia: Set wgDefaultRobotPolicy to noindex,nofollow (T272871) (duration: 01m 08s) [production]
19:12 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2247.codfw.wmnet with reason: REIMAGE [production]
19:10 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@0742443]: hourly partitioning for ores tables (duration: 01m 25s) [production]
19:10 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2223.codfw.wmnet with reason: REIMAGE [production]
19:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2247.codfw.wmnet with reason: REIMAGE [production]
19:09 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@0742443]: hourly partitioning for ores tables [production]
19:08 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2223.codfw.wmnet with reason: REIMAGE [production]
19:07 <cdanis> decom Zayo IP transit on cr2-codfw T272675 [production]
19:06 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable canary events for mediawiki_revision_recommendation_create (duration: 01m 12s) [production]
19:02 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1264.eqiad.wmnet with reason: REIMAGE [production]
19:00 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1264.eqiad.wmnet with reason: REIMAGE [production]