3751-3800 of 10000 results (67ms)
2022-04-04 §
01:44 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
01:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
2022-04-02 §
11:26 <akosiaris> disable zotero paging until T291707 is resolved. [production]
11:11 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/services/zotero: sync [production]
11:11 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/services/zotero: sync [production]
2022-04-01 §
23:25 <mutante> DNS - new project language 'kcg'. 'Tyap is a regionally important dialect cluster of Plateau languages in Nigeria's Middle Belt, named after its prestige dialect. It is also known by its Hausa exonym as Katab or Kataf.' T305279 [production]
23:08 <rzl@deploy1002> helmfile [eqiad] DONE helmfile.d/services/zotero: sync [production]
23:08 <rzl@deploy1002> helmfile [eqiad] START helmfile.d/services/zotero: sync [production]
22:04 <bblack> esams re-pooled - T304089 [production]
20:22 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:19 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
19:48 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=eqiad,name=wtp102[5-6].eqiad.wmnet [production]
19:47 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=codfw,name=parse200[1-2].codfw.wmnet [production]
19:44 <mutante> rebooting parsoid canary appservers - wtp1025, wtp1026, parse2001, parse2002 [production]
19:38 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=parse200[1-2].codfw.wmnet [production]
19:38 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=parse200[1-2].eqiad.wmnet [production]
19:38 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=parse200[1-2].eqiad.wmnet [production]
19:37 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=wtp102[5-6].eqiad.wmnet [production]
19:36 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=eqiad,name=mw144[7-9].eqiad.wmnet [production]
19:36 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=eqiad,name=mw1450.eqiad.wmnet [production]
19:36 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2036.codfw.wmnet,service=varnish-fe [production]
19:35 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2036.codfw.wmnet,service=ats-tls [production]
19:35 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2036.codfw.wmnet,service=ats-be [production]
19:16 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=mw144[7-9].eqiad.wmnet [production]
19:16 <dzahn@cumin2002> conftool action : set/pooled=yes; selector: dc=eqiad,name=mw141[4-8].eqiad.wmnet [production]
19:01 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=mw141[4-8].eqiad.wmnet [production]
19:00 <sukhe@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cp2036.codfw.wmnet [production]
19:00 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=mw1414.wmnet [production]
19:00 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=eqiad,name=mw141[4-8].wmnet [production]
19:00 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=mw1414.wmnet [production]
18:58 <dzahn@cumin2002> conftool action : set/pooled=no; selector: dc=codfw,name=mw141[4-8].wmnet [production]
18:42 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host cp2036.codfw.wmnet [production]
13:05 <dcausse> reseting jvmquake flag on all wdqs hosts [production]
12:52 <dcausse> restarting blazegraph on wdqs1006 and resetting jvmquake warning flag [production]
11:31 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1001.eqiad.wmnet [production]
11:26 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host sretest1001.eqiad.wmnet [production]
11:01 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief2001.codfw.wmnet [production]
10:55 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host acmechief2001.codfw.wmnet [production]
10:54 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief1001.eqiad.wmnet [production]
10:50 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host acmechief1001.eqiad.wmnet [production]
10:47 <vgutierrez> reboot acme-chief instances to catch up on kernel upgrades [production]
10:34 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir6002.drmrs.wmnet [production]
10:29 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host ncredir6002.drmrs.wmnet [production]
10:29 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir6001.drmrs.wmnet [production]
10:21 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host ncredir6001.drmrs.wmnet [production]
10:20 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir5002.eqsin.wmnet [production]
10:14 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host ncredir5002.eqsin.wmnet [production]
10:06 <vgutierrez> vgutierrez@puppetmaster2001:~$ sudo -i rm /var/run/confd-template/.ml-staging-ctrl*.err [production]
10:04 <vgutierrez> vgutierrez@puppetmaster1001:~$ sudo -i rm /var/run/confd-template/.ml-staging-ctrl*.err [production]
10:03 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ncredir5001.eqsin.wmnet [production]