2019-06-17
ยง
|
17:56 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
17:56 |
<otto@deploy1001> |
scap-helm eventgate-main cluster codfw completed |
[production] |
17:56 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: codfw] |
[production] |
17:54 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
17:54 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
17:54 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
17:43 |
<onimisionipe@deploy1001> |
Started deploy [wdqs/wdqs@dcf3338]: New Updater, GUI and Blazegraph build |
[production] |
17:29 |
<onimisionipe> |
pooled wdqs1003 - after rolling back failed deployment. |
[production] |
17:26 |
<onimisionipe@deploy1001> |
Finished deploy [wdqs/wdqs@d6ed70b]: New Updater, GUI and Blazegraph build (duration: 10m 19s) |
[production] |
17:23 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Revert - Produce user-blocks-change to eventgate-main. Depends on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/514560 (duration: 00m 47s) |
[production] |
17:16 |
<onimisionipe@deploy1001> |
Started deploy [wdqs/wdqs@d6ed70b]: New Updater, GUI and Blazegraph build |
[production] |
17:14 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Produce user-blocks-change to eventgate-main - T211248 (duration: 00m 48s) |
[production] |
17:10 |
<ottomata> |
mw-config change to produce user-blocks-change event to eventgate-main - T211248 |
[production] |
16:27 |
<jynus> |
starting data check on db2097+db2046, expect increase in read row rate T225378 |
[production] |
16:02 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
16:02 |
<otto@deploy1001> |
scap-helm eventgate-main cluster eqiad completed |
[production] |
16:02 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/eqiad-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: eqiad] |
[production] |
15:57 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
15:57 |
<otto@deploy1001> |
scap-helm eventgate-main cluster codfw completed |
[production] |
15:57 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: codfw] |
[production] |
15:55 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
15:55 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
15:55 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
15:42 |
<ema> |
cp4026: ats-backend-restart to apply systemd unit hardening changes |
[production] |
15:32 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
15:32 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
15:32 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
15:30 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
15:30 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
15:30 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
15:17 |
<thcipriani> |
gerrit back |
[production] |
15:16 |
<thcipriani> |
gerrit restart to pick up new config changes. |
[production] |
14:45 |
<elukey> |
stop eventlogging on eventlog1002 and reboot for kernel upgrades |
[production] |
14:32 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
14:32 |
<otto@deploy1001> |
scap-helm eventgate-main cluster codfw completed |
[production] |
14:32 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: codfw] |
[production] |
14:26 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
14:26 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
14:26 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
14:15 |
<moritzm> |
installing poppler security updates on jessie |
[production] |
14:03 |
<cdanis> |
cdanis@cobalt.wikimedia.org ~ % sudo systemctl start gerrit.service |
[production] |
13:53 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
13:49 |
<moritzm> |
installing libav security updates |
[production] |
13:45 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
13:45 |
<ema> |
reboot cp4027 for dist and Varnish upgrade T224694 |
[production] |
13:34 |
<elukey> |
reboot of an-worker* (Hadoop worker nodes) for kernel + openjdk upgrades |
[production] |
13:25 |
<ema> |
cp4027: upgrade Varnish packages to 5.1.3-1wm10 T224694 |
[production] |
12:37 |
<jbond42> |
upgrade mtail on lithium - T225604 |
[production] |
12:35 |
<jbond42> |
add mtail_3.0.0~rc24.1-1+wmf1_amd64.deb to jessie-wikimedia backports |
[production] |
12:13 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:514715|FileImporter configuration to fetch sitelinks from Wikidata (T225609 T224007)]] - finishing partial deployment (duration: 00m 47s) |
[production] |