251-300 of 10000 results (30ms)
2021-09-01 ยง
22:34 <legoktm@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
22:33 <legoktm@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
22:33 <legoktm@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
22:32 <legoktm@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
22:32 <legoktm@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
22:30 <legoktm@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
22:29 <legoktm@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
20:02 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:57 <twentyafterfour@deploy1002> Synchronized php: group1 wikis to 1.37.0-wmf.21 refs T281161 (duration: 01m 06s) [production]
19:57 <twentyafterfour> twentyafterfour@deploy1002 rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.21 refs T281162 [production]
19:56 <twentyafterfour@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.21 refs T281161 [production]
18:38 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:30 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:21 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:17 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: fe1ae2e438841a069dc8dadc9a1850b91863c06a: Growth features: Deploy to 100% of newcomers on small wikis (T289786) (duration: 01m 06s) [production]
18:09 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:07 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 27e85b1f228dccb584b4692f5b1b1354b19625b4: nlwiki: Enable link recommendations for all Growth users (T285254) (duration: 01m 06s) [production]
18:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:05 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 94b1cca: Growth features: Enable for newcomers on two wikis (T285254, T287867) (duration: 01m 09s) [production]
17:31 <ejegg> updated payments-wiki from c4d56178d0 to f9cbf95a12 [production]
16:23 <mforns@deploy1002> Finished deploy [analytics/refinery@ff15071] (thin): Fix for cassandra3 loading THIN [analytics/refinery@ff15071] (duration: 00m 06s) [production]
16:23 <mforns@deploy1002> Started deploy [analytics/refinery@ff15071] (thin): Fix for cassandra3 loading THIN [analytics/refinery@ff15071] [production]
16:22 <mforns@deploy1002> Finished deploy [analytics/refinery@ff15071]: Fix for cassandra3 loading [analytics/refinery@ff15071] (duration: 26m 58s) [production]
16:06 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be1066.eqiad.wmnet with reason: REIMAGE [production]
16:04 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1065.eqiad.wmnet with reason: REIMAGE [production]
16:02 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be1064.eqiad.wmnet with reason: REIMAGE [production]
16:01 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1066.eqiad.wmnet with reason: REIMAGE [production]
16:01 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1065.eqiad.wmnet with reason: REIMAGE [production]
16:00 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1064.eqiad.wmnet with reason: REIMAGE [production]
15:55 <mforns@deploy1002> Started deploy [analytics/refinery@ff15071]: Fix for cassandra3 loading [analytics/refinery@ff15071] [production]
15:35 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:08 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
14:08 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:04 <godog> move simone-this-dot from wmf to nda ldap group - T289783 [production]
13:51 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2009.codfw.wmnet [production]
13:49 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:48 <krinkle@deploy1002> Synchronized php-1.37.0-wmf.20/includes/resourceloader: Id7c258841d7816 (duration: 01m 06s) [production]
13:46 <krinkle@deploy1002> Synchronized php-1.37.0-wmf.21/includes/resourceloader: Id7c258841d7816 (duration: 01m 49s) [production]
13:45 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host rdb2009.codfw.wmnet [production]
13:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:38 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:16 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
13:05 <mutante> planet1002 - temp removing feed from ad.huikeshoven - seems to cause corrupt state file (T289984) [production]
13:01 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]