3251-3300 of 10000 results (36ms)
2021-08-19 ยง
16:31 <hnowlan@cumin1001> START - Cookbook sre.hosts.decommission for hosts maps1002.eqiad.wmnet [production]
16:31 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts maps1002.eqiad.wmnet [production]
16:30 <hnowlan@cumin1001> START - Cookbook sre.hosts.decommission for hosts maps1002.eqiad.wmnet [production]
16:28 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts maps1001.eqiad.wmnet [production]
16:14 <hnowlan@cumin1001> START - Cookbook sre.hosts.decommission for hosts maps1001.eqiad.wmnet [production]
16:14 <hnowlan> starting decommission of old eqiad maps hardware [production]
16:10 <cwhite> remove rotated logstash-plain-* and logstash-json-* logs on logstash collectors [production]
16:00 <akosiaris@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
15:53 <dpifke@deploy1002> Finished deploy [performance/navtiming@f8bf39f]: Deploy CpuBenchmark processor again T281243 (duration: 00m 06s) [production]
15:52 <dpifke@deploy1002> Started deploy [performance/navtiming@f8bf39f]: Deploy CpuBenchmark processor again T281243 [production]
15:50 <Amir1> test2wiki)> delete from flaggedtemplates where ft_rev_id not in (select fp_stable from flaggedpages); (T289249) [production]
15:42 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2005.codfw.wmnet [production]
15:40 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2005.codfw.wmnet [production]
15:38 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
15:35 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2005.codfw.wmnet [production]
15:33 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2005.codfw.wmnet [production]
15:29 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
15:25 <jiji@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
15:06 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on maps[1001-1004].eqiad.wmnet with reason: Awaiting decommissioning [production]
15:06 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on maps[1001-1004].eqiad.wmnet with reason: Awaiting decommissioning [production]
15:04 <godog> clean logstash json logs off logstash hosts [production]
14:51 <jiji@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
14:49 <jiji@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
14:36 <effie> enable puppet on mediawiki and memcached servers for 713842 [production]
14:26 <effie> disable puppet on mediawiki and memcached servers for 713842 [production]
13:58 <zpapierski@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
13:49 <urbanecm> Start server-side upload for 1 video file (T288384) [production]
13:48 <urbanecm> Start server-side upload for 1 video file (T288554) [production]
13:47 <kharlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
13:47 <kharlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'internal' . [production]
13:45 <urbanecm> Start server-side upload for 1 video file (T288628) [production]
13:44 <kharlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'internal' . [production]
13:44 <kharlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
13:42 <urbanecm> Start server-side upload for 1 video file (T289203) [production]
13:40 <kharlan@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
13:34 <kormat> reconfiguring replication tree on pc3 T284825 [production]
13:30 <kormat> reconfiguring replication tree on pc2 T284825 [production]
13:24 <kormat> reconfiguring replication tree on pc1 T284825 [production]
13:18 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:10 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:09 <kormat@deploy1002> Synchronized wmf-config/ProductionServices.php: Promote new h/w to primary of eqiad pc sections T284825 (duration: 01m 08s) [production]
12:35 <zpapierski@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
12:17 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:11 <Lucas_WMDE> EU backport+config window done [production]
12:11 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.37.0-wmf.18/extensions/Wikibase/view/lib/wikibase-termbox/: Backport: [[gerrit:713523|Update termbox (T236893, T286775)]] (duration: 01m 08s) [production]
11:56 <zpapierski@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
11:49 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]