801-850 of 8386 results (21ms)
2025-07-07 §
17:07 <bking@cumin1002> conftool action : set/pooled=false; selector: dnsdisc=search-psi*,name=eqiad [production]
17:07 <bking@cumin1002> conftool action : set/pooled=false; selector: dnsdisc=search-omega*,name=eqiad [production]
17:06 <bking@cumin1002> conftool action : set/pooled=false; selector: dnsdisc=search*,name=eqiad [production]
16:16 <bking@cumin1002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 [production]
16:15 <bking@cumin1002> END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 [production]
16:00 <bking@cumin1002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 [production]
15:02 <bking@cumin1002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 [production]
14:28 <bking@cumin1002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_eqiad: activate new plugins packages - bking@cumin1002 - T397227 [production]
2025-07-02 §
16:47 <inflatador> bking@cumin1002 restarting cirrrussearch codfw T397227 [production]
14:38 <bking@cumin1002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: activate new plugins packages - bking@cumin1002 - T397227 [production]
14:38 <bking@cumin1002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: activate new plugins packages - bking@cumin1002 - T397227 [production]
14:14 <bking@cumin1002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: activate new plugins packages - bking@cumin1002 - T397227 [production]
13:53 <bking@cumin1002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster relforge: activate new plugins packages - bking@cumin1002 - T397227 [production]
13:52 <bking@cumin1002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster relforge: activate new plugins packages - bking@cumin1002 - T397227 [production]
2025-07-01 §
16:11 <inflatador> bking@prometheus1005:~$ sudo run-puppet-agent T398341 [production]
2025-06-24 §
19:05 <bking@cumin2002> conftool action : set/pooled=true; selector: dnsdisc=wdqs,name=codfw [production]
17:42 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
17:42 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
17:41 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
17:41 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
16:48 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
16:48 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
16:44 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
16:44 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
16:42 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
16:41 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/rdf-streaming-updater: apply [production]
13:33 <bking@cumin2002> conftool action : set/pooled=false; selector: dnsdisc=wdqs,name=codfw [production]
2025-06-20 §
18:36 <bking@cumin2002> conftool action : set/weight=10:pooled=no; selector: name=cirrussearch2113\.codfw\.wmnet [production]
15:49 <bking@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
15:48 <bking@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
15:48 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-page-content-change-enrich: apply [production]
15:47 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/mw-page-content-change-enrich: apply [production]
14:25 <inflatador> bking@cumin2002:~$ sudo cumin prometheus1007* 'run-puppet-agent' T357146 [production]
2025-06-18 §
14:45 <bking@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:45 <bking@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:41 <bking@deploy1003> helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:41 <bking@deploy1003> helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:24 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:24 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:21 <bking@deploy1003> helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
14:21 <bking@deploy1003> helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply [production]
2025-06-17 §
20:07 <ebernhardson@deploy1003> bking, ebernhardson: Backport for [[gerrit:1155738|cirrussearch: return traffic to all DCs (T388610)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
2025-06-16 §
18:04 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on 6 hosts with reason: begin decom/remove hosts from cluster [production]
15:17 <inflatador> bking@cumin2002:~$ sudo cumin A:lvs-low-traffic 'run-puppet-agent' T387569 [production]
2025-06-11 §
15:24 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts relforge[1003-1004].eqiad.wmnet [production]
15:24 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:24 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: relforge[1003-1004].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2002" [production]
15:24 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: relforge[1003-1004].eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2002" [production]
15:15 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
15:06 <bking@cumin2002> START - Cookbook sre.hosts.decommission for hosts relforge[1003-1004].eqiad.wmnet [production]