3051-3100 of 10000 results (40ms)
2021-08-24 ยง
22:05 <legoktm@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'shellbox' for release 'main' . [production]
22:04 <legoktm@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'shellbox-constraints' for release 'main' . [production]
21:10 <tgr> running extensions/GrowthExperiments/maintenance/revalidateLinkRecommendations.php on various wikis per T282873#7303828 [production]
20:59 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:55 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: a6fd96b15e6e3c068c2faac60208b9722d32af0f: Growth features: Promote 9 wikis out of dark mode (T287871; T287874; T287872; T287880; T287868; T287873; T287879; T287875; T287876) (duration: 01m 25s) [production]
20:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:43 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:35 <dancy@deploy1002> Pruned MediaWiki: 1.37.0-wmf.17 (duration: 01m 48s) [production]
20:33 <dancy@deploy1002> Pruned MediaWiki: 1.37.0-wmf.18 (duration: 03m 26s) [production]
20:27 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.20 [production]
20:18 <dancy@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.20 (duration: 36m 32s) [production]
20:16 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:41 <dancy@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.20 [production]
17:23 <mbsantos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:19 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:17 <mbsantos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
15:26 <dcausse@deploy1002> Finished deploy [wikimedia/discovery/analytics@e02c602]: transfer_to_es: stop adding data to article_topics (duration: 02m 17s) [production]
15:23 <dcausse@deploy1002> Started deploy [wikimedia/discovery/analytics@e02c602]: transfer_to_es: stop adding data to article_topics [production]
15:15 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:55 <jayme@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:54 <jayme@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
14:50 <jayme@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
14:49 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
14:23 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2031.codfw.wmnet with reason: REIMAGE [production]
14:19 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2031.codfw.wmnet with reason: REIMAGE [production]
13:12 <XioNoX> push pfw policies - T289353 [production]
12:45 <vgutierrez> enable puppet on P:tlsproxy::envoy hosts - merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/710507/9 [production]
12:37 <vgutierrez> disable puppet on P:tlsproxy::envoy hosts - merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/710507/9 [production]
12:33 <godog> test patched python3-eventlet on thanos-fe1003 - T283714 [production]
12:30 <marostegui> Install 10.4.21 on clouddb1015 [production]
11:27 <jiji@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mc2029.codfw.wmnet with reason: REIMAGE [production]
11:24 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2029.codfw.wmnet with reason: REIMAGE [production]
09:08 <jbond> upload new statograph version [production]
09:02 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
09:02 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:54 <Amir1> start of mwscript extensions/FlaggedRevs/maintenance/pruneRevData.php --wiki=dewiki --prune --batch-size=5 --sleep=5 (T289249) [production]
08:51 <Amir1> start of mwscript extensions/FlaggedRevs/maintenance/pruneRevData.php --wiki=arwiki --prune --batch-size=5 --sleep=5 (T289249) [production]
08:01 <godog> temp fix thanos-swift.discovery.wmnet in /etc/hosts to get swift-dispersion-stats to work - T283714 [production]
07:51 <dcausse> repool wdqs1012 T289551 [production]
07:29 <dcausse> restarting blazegraph on wdqs1012 [production]
07:17 <marostegui> Optimize huwiki.flaggedtemplates on db1127 [production]
07:15 <marostegui> Optimize huwiki.flaggedtemplates on db1098:3317 [production]
06:17 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2037.codfw.wmnet with reason: REIMAGE [production]
06:14 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2037.codfw.wmnet with reason: REIMAGE [production]
03:51 <rzl> rzl@wdqs1012:~$ sudo depool [production]
03:46 <legoktm> wdqs1012 restarted prometheus-blazegraph-exporter-wdqs-blazegraph.service and prometheus-blazegraph-exporter-wdqs-categories.service after apparent exceptions/crashes [production]
02:08 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]