2901-2950 of 10000 results (34ms)
2021-09-01 §
12:47 <godog> bounce webperf on webperf2001 - T290138 [production]
12:41 <mutante> planet1002 - rm /etc/rawdog/en/feeds/39a7970f.state (corrupt) T289984 [production]
12:38 <dzahn@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'miscweb' for release 'main' . [production]
11:19 <Krinkle> effie restarted php-fpm on parse2007.codfw.wmnet, ref T290120. [production]
10:20 <jbond> start filtering more puppet facts G:715461 - T263578 [production]
09:23 <marostegui> Drop flaggedrevs_stats and flaggedrevs_stats2 from dewiki T289050 [production]
07:45 <ema> deploy Varnish SLO dashboard with grr apply slo_dashboards.jsonnet T289036 [production]
07:05 <XioNoX> pfw NAT and ACLs changes - T290077 [production]
06:29 <elukey@cumin1001> END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for sodium.wikimedia.org: Renew puppet certificate - elukey@cumin1001 [production]
06:28 <elukey@cumin1001> START - Cookbook sre.puppet.renew-cert for sodium.wikimedia.org: Renew puppet certificate - elukey@cumin1001 [production]
05:25 <effie> depool mw2251 mw2255 parse2001 for tests - T280497 [production]
04:41 <marostegui> Optimize idwiki.flaggedtemplates T290057 [production]
04:23 <marostegui> Optimize arwiki.flaggedtemplates T290057 [production]
04:16 <eileen> civicrm revision changed from 7da3eba4f9 to 30cd9c1d90, config revision is 5f004d94d7 [production]
00:53 <eileen> civicrm revision changed from e567b4c289 to 7da3eba4f9, config revision is 5f004d94d7 [production]
2021-08-31 §
23:41 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:38 <eileen> civicrm revision changed from 718aa9cad3 to e567b4c289, config revision is 7a24870bc7 [production]
23:33 <dpifke@deploy1002> Synchronized wmf-config/profiler.php: Revert excimer-k8s pipelines T288165 (duration: 01m 14s) [production]
23:31 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:25 <dpifke@deploy1002> scap failed: average error rate on 3/6 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/83629bcb5560d11e61d3085c89dd9ed6 for details) [production]
23:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:15 <mforns> failed deployment of refinery (v0.1.17) to an-test-coord1001.eqiad.wmnet (scap error) [production]
23:15 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:14 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b] (hadoop-test): Regular analytics weekly train TEST v0.1.17 [analytics/refinery@a0f039b] (duration: 13m 42s) [production]
23:08 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 1437d99c1884c0695f02b81b724ec82a2bd3362e: Enable link recommendation frontent in dewiki and nlwiki (T288420, T285254) (duration: 01m 06s) [production]
23:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:07 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 8997ae5d0b998839853aed2b246f5c88fe9d83eb: Fix wgDiscussionTools_sourcemodetoolbar settings (duration: 01m 22s) [production]
23:01 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b] (hadoop-test): Regular analytics weekly train TEST v0.1.17 [analytics/refinery@a0f039b] [production]
23:00 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b] (thin): Regular analytics weekly train THIN v0.1.17 [analytics/refinery@a0f039b] (duration: 00m 07s) [production]
23:00 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b] (thin): Regular analytics weekly train THIN v0.1.17 [analytics/refinery@a0f039b] [production]
23:00 <mforns@deploy1002> Finished deploy [analytics/refinery@a0f039b]: Regular analytics weekly train v0.1.17 [analytics/refinery@a0f039b] (duration: 17m 39s) [production]
22:42 <mforns@deploy1002> Started deploy [analytics/refinery@a0f039b]: Regular analytics weekly train v0.1.17 [analytics/refinery@a0f039b] [production]
21:58 <ejegg> switched Adyen to new Checkout integration [production]
21:41 <dduvall@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
21:38 <dduvall@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
21:34 <dduvall@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:00 <twentyafterfour@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.21 refs T281161 [production]
19:20 <brennen> gitlab1001: brief downtime for testing reconfiguration of cas3.session_duration [production]
19:05 <twentyafterfour@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.21 refs T281161 (duration: 35m 53s) [production]
19:03 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:56 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:40 <ejegg> switched Adyen back to HPP integration [production]
18:38 <ejegg> updated payments-wiki from 564daed816 to c4d56178d0, switched Adyen to Checkout integration [production]
18:30 <twentyafterfour@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.21 refs T281161 [production]
18:24 <twentyafterfour> ran `scap prep 1.37.0-wmf.21` and `scap apply-patches --train 1.37.0-wmf.21` refs T281162 [production]
18:05 <XioNoX> re-pool eqsin-codfw link [production]
16:18 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]