2551-2600 of 10000 results (29ms)
2021-09-01 §
13:45 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host rdb2009.codfw.wmnet [production]
13:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:38 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:16 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
13:05 <mutante> planet1002 - temp removing feed from ad.huikeshoven - seems to cause corrupt state file (T289984) [production]
13:01 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
12:48 <godog> s/webperf/navtiming/ [production]
12:47 <godog> bounce webperf on webperf2001 - T290138 [production]
12:41 <mutante> planet1002 - rm /etc/rawdog/en/feeds/39a7970f.state (corrupt) T289984 [production]
12:38 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
11:19 <Krinkle> effie restarted php-fpm on parse2007.codfw.wmnet, ref T290120. [production]
10:20 <jbond> start filtering more puppet facts G:715461 - T263578 [production]
09:23 <marostegui> Drop flaggedrevs_stats and flaggedrevs_stats2 from dewiki T289050 [production]
07:45 <ema> deploy Varnish SLO dashboard with grr apply slo_dashboards.jsonnet T289036 [production]
07:05 <XioNoX> pfw NAT and ACLs changes - T290077 [production]
06:29 <elukey@cumin1001> END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for sodium.wikimedia.org: Renew puppet certificate - elukey@cumin1001 [production]
06:28 <elukey@cumin1001> START - Cookbook sre.puppet.renew-cert for sodium.wikimedia.org: Renew puppet certificate - elukey@cumin1001 [production]
05:25 <effie> depool mw2251 mw2255 parse2001 for tests - T280497 [production]
04:41 <marostegui> Optimize idwiki.flaggedtemplates T290057 [production]
04:23 <marostegui> Optimize arwiki.flaggedtemplates T290057 [production]
04:16 <eileen> civicrm revision changed from 7da3eba4f9 to 30cd9c1d90, config revision is 5f004d94d7 [production]
00:53 <eileen> civicrm revision changed from e567b4c289 to 7da3eba4f9, config revision is 5f004d94d7 [production]
2021-08-31 §
23:41 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:38 <eileen> civicrm revision changed from 718aa9cad3 to e567b4c289, config revision is 7a24870bc7 [production]
23:33 <dpifke@deploy1002> Synchronized wmf-config/profiler.php: Revert excimer-k8s pipelines T288165 (duration: 01m 14s) [production]
23:31 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:25 <dpifke@deploy1002> scap failed: average error rate on 3/6 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
23:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:15 <mforns> failed deployment of refinery (v0.1.17) to an-test-coord1001.eqiad.wmnet (scap error) [production]
23:15 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:14 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b] (hadoop-test): Regular analytics weekly train TEST v0.1.17 [analytics/refinery@a0f039b] (duration: 13m 42s) [production]
23:08 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 1437d99c1884c0695f02b81b724ec82a2bd3362e: Enable link recommendation frontent in dewiki and nlwiki (T288420, T285254) (duration: 01m 06s) [production]
23:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:07 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 8997ae5d0b998839853aed2b246f5c88fe9d83eb: Fix wgDiscussionTools_sourcemodetoolbar settings (duration: 01m 22s) [production]
23:01 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b] (hadoop-test): Regular analytics weekly train TEST v0.1.17 [analytics/refinery@a0f039b] [production]
23:00 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b] (thin): Regular analytics weekly train THIN v0.1.17 [analytics/refinery@a0f039b] (duration: 00m 07s) [production]
23:00 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b] (thin): Regular analytics weekly train THIN v0.1.17 [analytics/refinery@a0f039b] [production]
23:00 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b]: Regular analytics weekly train v0.1.17 [analytics/refinery@a0f039b] (duration: 17m 39s) [production]
22:42 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b]: Regular analytics weekly train v0.1.17 [analytics/refinery@a0f039b] [production]
21:58 <ejegg> switched Adyen to new Checkout integration [production]
21:41 <dduvall@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
21:38 <dduvall@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
21:34 <dduvall@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:00 <twentyafterfour@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.21 refs T281161 [production]
19:20 <brennen> gitlab1001: brief downtime for testing reconfiguration of cas3.session_duration [production]
19:05 <twentyafterfour@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.21 refs T281161 (duration: 35m 53s) [production]