|
2020-07-15
ยง
|
| 22:52 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 22:52 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 22:52 |
<dzahn@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 22:30 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . |
[production] |
| 22:30 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 22:29 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . |
[production] |
| 22:29 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 22:27 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 22:21 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . |
[production] |
| 22:21 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 22:10 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 21:47 |
<brennen> |
bringing integration-agent-docker-1012 back online |
[releng] |
| 21:35 |
<bstorm> |
set all of toolsbeta to mount NFS 4.2 except the bastion T257945 |
[toolsbeta] |
| 20:33 |
<brennen> |
taking integration-agent-docker-1012 offline to experiment with maintenance-disconnect-full-disks |
[releng] |
| 20:17 |
<brennen> |
deploying test version of maintenance-disconnect-full-disks (which might be wrong) |
[releng] |
| 19:48 |
<brennen> |
bringing integration-docker-1012 back online in jenkins |
[releng] |
| 19:47 |
<brennen> |
brennen@integration-agent-docker-1012:/srv/jenkins/workspace/workspace$ sudo rm -rf * |
[releng] |
| 19:43 |
<brennen> |
bringing integration-agent-docker-1010 back online in jenkins |
[releng] |
| 19:39 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/612284 |
[releng] |
| 18:41 |
<brennen> |
finished jenkins upgrade & restart on all hosts |
[releng] |
| 18:16 |
<brennen> |
restarting jenkins for upgrade |
[production] |
| 18:10 |
<brennen> |
preparing to upgrade jenkins on contint1001, contint1002 |
[releng] |
| 18:00 |
<mutante> |
DNS - new language 'avk' has been added - This language is called Kotava and is "a proposed international auxiliary language (IAL) that focuses especially on the principle of cultural neutrality". Learn more at https://en.wikipedia.org/wiki/Kotava |
[production] |
| 17:58 |
<joal> |
Backfill cassandra unique-devices for per-project-family starting 2019-07 |
[analytics] |
| 17:32 |
<mutante> |
puppetmaster - revoking cert for planet.discovery.wmnet, add planet.wikimedia.org, remove planet.svc records, remove specific and outdated hostnames (T257840) |
[production] |
| 17:03 |
<wm-bot> |
<bd808> Adding bi-directional bridge for #wikipedia-bn (T258078) |
[tools.bridgebot] |
| 16:11 |
<moritzm> |
uploaded jenkins 2.235.2 to thirdparty/ci for stretch/buster T257614 |
[production] |
| 15:54 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/612673 |
[releng] |
| 15:29 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 15:24 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 15:24 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 15:20 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 15:20 |
<moritzm> |
rebooting webperf* hosts for kernel update |
[production] |
| 14:58 |
<addshore@deploy1001> |
Synchronized php-1.35.0-wmf.41/extensions/Wikibase/repo: [[gerrit:612723]] Stop checking if WikibaseLib is loaded T258062 (already on mwmaint1002) (duration: 01m 08s) |
[production] |
| 14:51 |
<addshore> |
pulled https://gerrit.wikimedia.org/r/612723 onto mwmaint 1002 ahead of syncing everywhere (and CI finishing) |
[production] |
| 14:36 |
<ema> |
A:cp: upgrade purged to 0.17 T257573 |
[production] |
| 14:30 |
<ema> |
upload purged 0.17 to buster-wikimedia T257573 |
[production] |
| 14:28 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Add exceptional wikitech VE/Parsoid config T241961 (duration: 01m 04s) |
[production] |
| 14:26 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Add exceptional wikitech VE/Parsoid config T241961 (duration: 01m 05s) |
[production] |
| 14:25 |
<gehel> |
repooling wdqs1006 - catched up on lag |
[production] |
| 14:12 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 2% T218733 |
[production] |
| 14:10 |
<akosiaris@cumin1001> |
conftool action : set/weight=132; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 13:58 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.41/extensions/UrlShortener/includes/UrlShortenerUtils.php: T258056 Add temporary fix to ensure array is passed to array_map() (duration: 01m 08s) |
[production] |
| 13:54 |
<akosiaris> |
pool kubernetes nodes for mobileapps in codfw |
[production] |
| 13:53 |
<akosiaris@cumin1001> |
conftool action : set/pooled=yes; selector: dc=codfw,service=mobileapps,name=kubernetes.* |
[production] |
| 13:53 |
<akosiaris@cumin1001> |
conftool action : set/weight=264; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 13:51 |
<akosiaris@cumin1001> |
conftool action : set/weight=1; selector: dc=codfw,service=mobileapps,name=kubernetes.* |
[production] |
| 13:04 |
<jforrester@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.41 (duration: 01m 05s) |
[production] |
| 13:03 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.41 |
[production] |
| 11:59 |
<addshore> |
deploy window closed / done :) |
[production] |