|
2021-06-03
ยง
|
| 18:26 |
<majavah> |
renew prometheus kubernetes certificate T280301 |
[tools] |
| 18:16 |
<ebernhardson@deploy1002> |
Finished deploy [wikimedia/discovery/analytics@659a8e4]: resolve npe in datawriter (duration: 00m 15s) |
[production] |
| 18:16 |
<ebernhardson@deploy1002> |
Started deploy [wikimedia/discovery/analytics@659a8e4]: resolve npe in datawriter |
[production] |
| 17:52 |
<wm-bot> |
<lucaswerkmeister> deployed 9a9b970c47 (support sitelinks for hyphenated language codes) |
[tools.wdvd] |
| 17:49 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on moss-be1002.eqiad.wmnet with reason: REIMAGE |
[production] |
| 17:47 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on moss-be1001.eqiad.wmnet with reason: REIMAGE |
[production] |
| 17:47 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be1002.eqiad.wmnet with reason: REIMAGE |
[production] |
| 17:45 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on moss-be1001.eqiad.wmnet with reason: REIMAGE |
[production] |
| 17:37 |
<brennen> |
gitlab1001: re-running install-gitlab-server.sh |
[production] |
| 17:16 |
<urandom> |
remove dropped Cassandra keyspace snapshots -- T258414 |
[production] |
| 17:06 |
<majavah> |
renew admission webhook certificates T280301 |
[tools] |
| 16:55 |
<ejegg> |
updated payments-wiki from 6fac77f60e to 7be0534b91 |
[production] |
| 16:55 |
<majavah> |
renew ingress-admission-controller certificates T280301 |
[toolsbeta] |
| 16:49 |
<majavah> |
renew registry-admission-webhook certificates T280301 |
[toolsbeta] |
| 16:23 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:49 |
<topranks> |
Gerrit 697993: Change BGP peer IP for doh3002 on esams CRs. |
[production] |
| 15:46 |
<ottomata> |
add airflow_2.1.0-py3.7-1_amd64.deb to apt.wm.org |
[analytics] |
| 15:27 |
<papaul> |
pdu replacement complete |
[production] |
| 15:25 |
<moritzm> |
upgrading gitlab to 13.11.5 |
[production] |
| 15:20 |
<ottomata> |
created airflow_analytics database and user on an-coord1001 analytics-meta instance - T272973 |
[analytics] |
| 15:08 |
<papaul> |
disconnect ps2-d8-codfw for replacement |
[production] |
| 14:55 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:54 |
<topranks> |
Gerrit 697970: Add Wikidough BGP peerings on esams CRs for doh3001 and doh3002. |
[production] |
| 14:23 |
<moritzm> |
installing nginx security updates on buster |
[production] |
| 14:12 |
<moritzm> |
installing postgresql-9.6 security updates |
[production] |
| 13:55 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:25 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:18 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:17 |
<oblivian@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1112 (re)pooling @ 100%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16285 and previous config saved to /var/cache/conftool/dbconfig/20210603-130059-root.json |
[production] |
| 12:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1112 (re)pooling @ 75%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16284 and previous config saved to /var/cache/conftool/dbconfig/20210603-124556-root.json |
[production] |
| 12:32 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1157 (re)pooling @ 100%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16283 and previous config saved to /var/cache/conftool/dbconfig/20210603-123243-root.json |
[production] |
| 12:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1112 (re)pooling @ 50%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16282 and previous config saved to /var/cache/conftool/dbconfig/20210603-123052-root.json |
[production] |
| 12:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1157 (re)pooling @ 75%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16281 and previous config saved to /var/cache/conftool/dbconfig/20210603-121739-root.json |
[production] |
| 12:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1112 (re)pooling @ 25%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16280 and previous config saved to /var/cache/conftool/dbconfig/20210603-121548-root.json |
[production] |
| 12:12 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1112', diff saved to https://phabricator.wikimedia.org/P16279 and previous config saved to /var/cache/conftool/dbconfig/20210603-121205-marostegui.json |
[production] |
| 12:11 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Repool db1166', diff saved to https://phabricator.wikimedia.org/P16278 and previous config saved to /var/cache/conftool/dbconfig/20210603-121133-root.json |
[production] |
| 12:06 |
<moritzm> |
restarting FPM on mw canaries to pick up lz4 update |
[production] |
| 12:03 |
<moritzm> |
installing lz4 security updates on buster |
[production] |
| 12:02 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1157 (re)pooling @ 50%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16277 and previous config saved to /var/cache/conftool/dbconfig/20210603-120235-root.json |
[production] |
| 11:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Repool db1166', diff saved to https://phabricator.wikimedia.org/P16276 and previous config saved to /var/cache/conftool/dbconfig/20210603-115628-root.json |
[production] |
| 11:53 |
<moritzm> |
installing curl security updates on stretch |
[production] |
| 11:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1157 (re)pooling @ 25%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16275 and previous config saved to /var/cache/conftool/dbconfig/20210603-114731-root.json |
[production] |
| 11:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1175 (re)pooling @ 100%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16274 and previous config saved to /var/cache/conftool/dbconfig/20210603-114503-root.json |
[production] |
| 11:43 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1157', diff saved to https://phabricator.wikimedia.org/P16273 and previous config saved to /var/cache/conftool/dbconfig/20210603-114325-marostegui.json |
[production] |
| 11:41 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 50%: Repool db1166', diff saved to https://phabricator.wikimedia.org/P16272 and previous config saved to /var/cache/conftool/dbconfig/20210603-114124-root.json |
[production] |
| 11:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1175 (re)pooling @ 75%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16271 and previous config saved to /var/cache/conftool/dbconfig/20210603-113000-root.json |
[production] |
| 11:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1166 (re)pooling @ 25%: Repool db1166', diff saved to https://phabricator.wikimedia.org/P16270 and previous config saved to /var/cache/conftool/dbconfig/20210603-112620-root.json |
[production] |
| 11:24 |
<wm-bot> |
<dcaro> Deploying latest changes |
[tools.cloud-ceph-performance-tests] |
| 11:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1166', diff saved to https://phabricator.wikimedia.org/P16269 and previous config saved to /var/cache/conftool/dbconfig/20210603-112243-marostegui.json |
[production] |