4001-4050 of 10000 results (39ms)
2020-10-26 ยง
17:58 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
17:48 <mutante> an-worker109* - systemctl reset-failed to clear Icinga alerts related to wmf_auto_restart changes [production]
17:45 <mutante> releases2002,netmon2001, various other hosts - systemctl reset-failed to clear Icinga alerts related to wmf_auto_restart changes [production]
17:39 <krinkle@deploy1001> Synchronized php-1.36.0-wmf.13/resources/src/mediawiki.util/: T265809, I1011f63ae61f5a6 (duration: 01m 00s) [production]
16:41 <XioNoX> bounce security log on pfw3-eqiad - T263833 [production]
16:29 <XioNoX> set security-log traceoptions on pfw3-eqiad - T263833 [production]
16:14 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:08 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
16:07 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:00 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
15:51 <rzl@cumin1001> conftool action : set/ttl=300; selector: dnsdisc=apertium|api-gateway|citoid|cxserver|echostore|eventgate-analytics|eventgate-analytics-external|eventgate-logging-external|eventgate-main|eventstreams|graphoid|kartotherian|mathoid|mobileapps|ores|parsoid|proton|push-notifications|recommendation-api|restbase|restbase-async|schema|search|sessionstore|termbox|wdqs|wdqs-internal|wikifeeds|zotero,name=eqiad [production]
15:35 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=zotero,name=eqiad [production]
15:32 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wikifeeds,name=eqiad [production]
15:29 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs-internal,name=eqiad [production]
15:26 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs,name=eqiad [production]
15:23 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=termbox,name=eqiad [production]
15:20 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore,name=eqiad [production]
15:17 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=search,name=eqiad [production]
15:14 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=schema,name=eqiad [production]
15:11 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=restbase-async,name=eqiad [production]
15:08 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=restbase,name=eqiad [production]
15:05 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=recommendation-api,name=eqiad [production]
15:02 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=push-notifications,name=eqiad [production]
14:59 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=proton,name=eqiad [production]
14:56 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=parsoid,name=eqiad [production]
14:53 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=ores,name=eqiad [production]
14:50 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=mobileapps,name=eqiad [production]
14:47 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=mathoid,name=eqiad [production]
14:46 <ppchelko@deploy1001> Finished deploy [restbase/deploy@a1a1bd7]: Add api-portal and snmwiki (duration: 16m 43s) [production]
14:44 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=kartotherian,name=eqiad [production]
14:41 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=graphoid,name=eqiad [production]
14:38 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventstreams,name=eqiad [production]
14:35 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-main,name=eqiad [production]
14:32 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-logging-external,name=eqiad [production]
14:30 <ppchelko@deploy1001> Started deploy [restbase/deploy@a1a1bd7]: Add api-portal and snmwiki [production]
14:29 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics-external,name=eqiad [production]
14:26 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=eventgate-analytics,name=eqiad [production]
14:23 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=echostore,name=eqiad [production]
14:20 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=cxserver,name=eqiad [production]
14:17 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=citoid,name=eqiad [production]
14:14 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=api-gateway,name=eqiad [production]
14:11 <rzl@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=apertium,name=eqiad [production]
14:06 <rzl@cumin1001> conftool action : set/ttl=10; selector: dnsdisc=apertium|api-gateway|citoid|cxserver|echostore|eventgate-analytics|eventgate-analytics-external|eventgate-logging-external|eventgate-main|eventstreams|graphoid|kartotherian|mathoid|mobileapps|ores|parsoid|proton|push-notifications|recommendation-api|restbase|restbase-async|schema|search|sessionstore|termbox|wdqs|wdqs-internal|wikifeeds|zotero,name=eqiad [production]
13:48 <moritzm> imported cas 6.2.4-1 to apt.wikimedia.org T265857 [production]
13:21 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:21 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:19 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:19 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:52 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: bff6b37a55fe8f260fe00cbb942c53101167fb07: Add foto.digitalarkivet.no to wgCopyUploadsDomains whitelist of Wikimedia Commons (T266390) (duration: 01m 14s) [production]
11:27 <elukey@cumin1001> END (FAIL) - Cookbook sre.hadoop.init-hadoop-workers (exit_code=99) [production]