|
2021-11-17
ยง
|
| 20:11 |
<wm-bot> |
<bd808> Hard stop/start cycle to ensure proper annotations in Deployment/ReplicaSet/Pod/Container for app (T295904) |
[tools.hatjitsu] |
| 19:56 |
<chicocvenancio> |
manually create /srv/v2c/apicache-py3 to solve T295115 |
[video] |
| 19:48 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:48 |
<dancy> |
upgrading scap in beta |
[releng] |
| 19:44 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:42 |
<ladsgroup@deploy1002> |
Synchronized php-1.38.0-wmf.9/includes/export/WikiExporter.php: Backport: [[gerrit:739491|export: Ignore rev_page_id index (T285149)]] (duration: 01m 04s) |
[production] |
| 19:33 |
<majavah> |
[codfw1dev] replace proxy-01 instance with proxy-02 running bullseye |
[project-proxy] |
| 19:24 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:20 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:10 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 19:10 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 8e167a53cec3c3b216100bab686f28e09c424435: Disable local file upload on the Chinese Wikisource (T295265) (duration: 01m 05s) |
[production] |
| 19:09 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:08 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 19:05 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 7b3a1d976cb1ef931c809b3670fb8c8b3f3a56e7: Make reply tool available as opt-out on commonswiki (T295838) (duration: 01m 05s) |
[production] |
| 19:05 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 19:03 |
<chicocvenancio> |
update video2commons to latest version, fix service unit file |
[video] |
| 18:58 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2042.codfw.wmnet with OS buster |
[production] |
| 18:57 |
<ejegg> |
updated fundraising CiviCRM from 9c5f0b69 -> 8054869b |
[production] |
| 18:56 |
<vgutierrez> |
pool cp2042 (upload) running HAProxy as TLS terminator - T290005 |
[production] |
| 18:25 |
<arturo> |
updating compiler facts |
[puppet-diffs] |
| 18:05 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp2042.codfw.wmnet with OS buster |
[production] |
| 18:05 |
<bblack@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 18:01 |
<bblack@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 17:59 |
<vgutierrez> |
depool cp2042 to be reimaged as an HAProxy cache upload node - T290005 |
[production] |
| 17:41 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-test-eqiad cluster: Roll restart of jvm daemons for openjdk upgrade. |
[production] |
| 17:25 |
<cmooney@cumin2002> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host rpki2002.codfw.wmnet |
[production] |
| 17:11 |
<XioNoX> |
repool Telia eqiad-codfw transport |
[production] |
| 17:10 |
<cmooney@cumin2002> |
START - Cookbook sre.ganeti.makevm for new host rpki2002.codfw.wmnet |
[production] |
| 16:34 |
<cmooney@cumin2002> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts rpki2001.codfw.wmnet |
[production] |
| 16:32 |
<mutante> |
LDAP - added jkieserman to wmf (T295693) |
[production] |
| 16:28 |
<cmooney@cumin2002> |
START - Cookbook sre.hosts.decommission for hosts rpki2001.codfw.wmnet |
[production] |
| 16:28 |
<XioNoX> |
drain Telia eqiad-codfw link |
[production] |
| 16:27 |
<cmooney@cumin2002> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) for hosts rpki2001.codfw.wmnet |
[production] |
| 16:21 |
<XioNoX> |
move cr1-codfw<->cr2-eqdfw link to BO cable |
[production] |
| 16:19 |
<cmooney@cumin2002> |
START - Cookbook sre.hosts.decommission for hosts rpki2001.codfw.wmnet |
[production] |
| 16:06 |
<XioNoX> |
move cr1-codfw:xe-5/3/0 to BO cable |
[production] |
| 16:04 |
<XioNoX> |
re-enable Telia BGP on cr1-codfw |
[production] |
| 16:01 |
<btullis> |
roll-restarting kafka-test brokers |
[analytics] |
| 16:01 |
<btullis@cumin1001> |
START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-test-eqiad cluster: Roll restart of jvm daemons for openjdk upgrade. |
[production] |
| 16:00 |
<bd808> |
Forced puppet run on deployment-docker-wikifunctions01.deployment-prep.eqiad1.wikimedia.cloud after James_F added missing hiera bits |
[releng] |
| 15:59 |
<bblack> |
netbox: added ganeti01 and ganeti02 cluster definitions for drmrs |
[production] |
| 15:58 |
<XioNoX> |
disable Telia BGP on cr1-codfw |
[production] |
| 15:55 |
<XioNoX> |
move codfw-ulsfo link to break-out cable |
[production] |
| 15:54 |
<bd808> |
Forced puppet run on deployment-docker-wikifunctions01.deployment-prep.eqiad1.wikimedia.cloud |
[releng] |
| 15:48 |
<andrewbogott> |
upgrading mariadb packages on eqiad1 cloudcontrols |
[admin] |
| 15:46 |
<mutante> |
restarting pybal on lvs1015 |
[production] |
| 15:43 |
<_joe_> |
restarting pybal on lvs2009 |
[production] |
| 15:42 |
<mutante> |
restarting pybal on lvs1016 |
[production] |
| 15:39 |
<andrewbogott> |
sudo cumin "cloud*" 'apt-get update -y --allow-releaseinfo-change' |
[admin] |
| 15:39 |
<_joe_> |
restarting pybal on lvs2010 |
[production] |