751-800 of 10000 results (23ms)
2020-10-08 ยง
14:17 <moritzm> importing icu 63.1-6+deb10u1~wmf5 to component/icu63 T264991 [production]
13:37 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
13:37 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
12:29 <kart_> Updated cxserver to 2020-10-08-053343-production (T264407, T264859) [production]
12:26 <kartik@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
12:24 <kartik@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
12:21 <kartik@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . [production]
12:10 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
12:10 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
12:08 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:07 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:07 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
12:07 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
12:05 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
12:05 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
10:54 <aborrero@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:52 <aborrero@cumin2001> START - Cookbook sre.hosts.downtime [production]
10:45 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-backend,name=restbase1030.eqiad.wmnet [production]
10:45 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-ssl,name=restbase1030.eqiad.wmnet [production]
10:45 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase,name=restbase1030.eqiad.wmnet [production]
10:37 <moritzm> installing Postgres security updates on netboxdb1001 [production]
10:34 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-backend,name=restbase1029.eqiad.wmnet [production]
10:34 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-ssl,name=restbase1029.eqiad.wmnet [production]
10:34 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase,name=restbase1029.eqiad.wmnet [production]
10:32 <moritzm> installing Postgres security updates on netboxdb2001 [production]
10:29 <mvolz@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
10:28 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-backend,name=restbase1028.eqiad.wmnet [production]
10:27 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase-ssl,name=restbase1028.eqiad.wmnet [production]
10:27 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=restbase,service=restbase,name=restbase1028.eqiad.wmnet [production]
10:26 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=restbase,service=restbase-backend,name=restbase1028.eqiad.wmnet [production]
10:26 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=restbase,service=restbase-ssl,name=restbase1028.eqiad.wmnet [production]
10:26 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=restbase,service=restbase,name=restbase1028.eqiad.wmnet [production]
10:26 <hnowlan> pooling restbase1028,restbase1029,restbase1030 [production]
10:22 <mvolz@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
10:14 <mvolz@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . [production]
09:40 <gehel@cumin1001> START - Cookbook sre.wdqs.data-reload [production]
09:10 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:09 <klausman@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:38 <godog> roll-restart swift-object-replicator on ms-be2* - T261633 [production]
08:19 <kormat> running schema change against s8 in eqiad T259831 [production]
08:19 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:19 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:06 <gehel@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:04 <gehel@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:02 <gehel> repooling wdqs2002 [production]
07:55 <marostegui> Rebuild db2125 from snapshots - T260670 [production]
07:45 <marostegui> Stop MySQL on db1077 to build it from s1 snapshot [production]
07:40 <gehel> depooled wdqs2002 to catch up on lag [production]
07:29 <jayme> updated envoyproxy to 1.15.1-2 on all codfw hosts [production]
07:23 <moritzm> installing pyzmq updates from Buster point release [production]