7901-7950 of 10000 results (74ms)
2022-12-05 ยง
15:25 <sukhe@puppetmaster1001> conftool action : set/weight=1; selector: name=cp5022.eqsin.wmnet,service=ats-tls [production]
15:25 <sukhe@puppetmaster1001> conftool action : set/weight=100; selector: name=cp5022.eqsin.wmnet,service=ats-be [production]
15:14 <andrewbogott> deleted wikitech-static-ord-prebuster image backup in rackspace cloud. Here concludes the wikitech-static upgrade to Buster and php7.4 [production]
15:07 <root@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
15:06 <root@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
15:06 <root@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
15:05 <root@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
14:57 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cp[5011,5013].eqsin.wmnet [production]
14:57 <sukhe@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:57 <sukhe@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[5011,5013].eqsin.wmnet decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
14:56 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cp[5011,5013].eqsin.wmnet decommissioned, removing all IPs except the asset tag one - sukhe@cumin2002" [production]
14:55 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
14:55 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
14:54 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
14:54 <sukhe@cumin2002> START - Cookbook sre.dns.netbox [production]
14:53 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
14:48 <sukhe@cumin2002> START - Cookbook sre.hosts.decommission for hosts cp[5011,5013].eqsin.wmnet [production]
14:42 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp[5011,5013].eqsin.wmnet with reason: downtimed, to be depooled [production]
14:42 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on cp[5011,5013].eqsin.wmnet with reason: downtimed, to be depooled [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5013.eqsin.wmnet,service=varnish-fe [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5013.eqsin.wmnet,service=ats-be [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5013.eqsin.wmnet,service=ats-tls [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5011.eqsin.wmnet,service=varnish-fe [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5011.eqsin.wmnet,service=ats-be [production]
14:41 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5011.eqsin.wmnet,service=ats-tls [production]
14:40 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
14:40 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
14:37 <TheresNoTime> closing UTC afternoon backport window [production]
14:36 <samtar@deploy1002> Finished scap: Backport for [[gerrit:863467|logos: icon could be not square]], [[gerrit:864766|trwiki: Add 20 years celebration logos (T324393)]] (duration: 08m 37s) [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5025.eqsin.wmnet,service=varnish-fe [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5025.eqsin.wmnet,service=ats-tls [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5025.eqsin.wmnet,service=ats-be [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=1; selector: name=cp5025.eqsin.wmnet,service=varnish-fe [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=1; selector: name=cp5025.eqsin.wmnet,service=ats-tls [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=100; selector: name=cp5025.eqsin.wmnet,service=ats-be [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5021.eqsin.wmnet,service=varnish-fe [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5021.eqsin.wmnet,service=ats-tls [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5021.eqsin.wmnet,service=ats-be [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=1; selector: name=cp5021.eqsin.wmnet,service=varnish-fe [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=1; selector: name=cp5021.eqsin.wmnet,service=ats-tls [production]
14:34 <sukhe@puppetmaster1001> conftool action : set/weight=100; selector: name=cp5021.eqsin.wmnet,service=ats-be [production]
14:29 <samtar@deploy1002> samtar and stang: Backport for [[gerrit:863467|logos: icon could be not square]], [[gerrit:864766|trwiki: Add 20 years celebration logos (T324393)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
14:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1206', diff saved to https://phabricator.wikimedia.org/P42249 and previous config saved to /var/cache/conftool/dbconfig/20221205-142752-marostegui.json [production]
14:27 <samtar@deploy1002> Started scap: Backport for [[gerrit:863467|logos: icon could be not square]], [[gerrit:864766|trwiki: Add 20 years celebration logos (T324393)]] [production]
14:25 <samtar@deploy1002> Finished scap: Backport for [[gerrit:862247|Add Property (120) to Wikidata content Namespace (T321282)]] (duration: 16m 59s) [production]
14:18 <samtar@deploy1002> samtar and gtzatchkova: Backport for [[gerrit:862247|Add Property (120) to Wikidata content Namespace (T321282)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
14:08 <samtar@deploy1002> Started scap: Backport for [[gerrit:862247|Add Property (120) to Wikidata content Namespace (T321282)]] [production]
14:08 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
14:08 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]
14:02 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance [production]