|
2019-06-17
ยง
|
| 17:14 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Produce user-blocks-change to eventgate-main - T211248 (duration: 00m 48s) |
[production] |
| 17:10 |
<ottomata> |
mw-config change to produce user-blocks-change event to eventgate-main - T211248 |
[production] |
| 16:27 |
<jynus> |
starting data check on db2097+db2046, expect increase in read row rate T225378 |
[production] |
| 16:02 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 16:02 |
<otto@deploy1001> |
scap-helm eventgate-main cluster eqiad completed |
[production] |
| 16:02 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/eqiad-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: eqiad] |
[production] |
| 15:57 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 15:57 |
<otto@deploy1001> |
scap-helm eventgate-main cluster codfw completed |
[production] |
| 15:57 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: codfw] |
[production] |
| 15:55 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 15:55 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
| 15:55 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
| 15:52 |
<elukey> |
re-run webrequest-load-wf-upload-2019-6-17-14 and webrequest-load-wf-upload-2019-6-17-13, failed due to reboots |
[analytics] |
| 15:42 |
<ema> |
cp4026: ats-backend-restart to apply systemd unit hardening changes |
[production] |
| 15:32 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 15:32 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
| 15:32 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
| 15:30 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 15:30 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
| 15:30 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
| 15:17 |
<thcipriani> |
gerrit back |
[production] |
| 15:16 |
<thcipriani> |
gerrit restart to pick up new config changes. |
[production] |
| 14:45 |
<elukey> |
stop eventlogging on eventlog1002 and reboot for kernel upgrades |
[production] |
| 14:34 |
<elukey> |
manual run of mediawiki-history-drop-snapshot.service to test new debug log |
[analytics] |
| 14:32 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 14:32 |
<otto@deploy1001> |
scap-helm eventgate-main cluster codfw completed |
[production] |
| 14:32 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: codfw] |
[production] |
| 14:26 |
<otto@deploy1001> |
scap-helm eventgate-main finished |
[production] |
| 14:26 |
<otto@deploy1001> |
scap-helm eventgate-main cluster staging completed |
[production] |
| 14:26 |
<otto@deploy1001> |
scap-helm eventgate-main upgrade main -f /srv/scap-helm/eventgate/main/staging-values.yaml --reset-values stable/eventgate [namespace: eventgate-main, clusters: staging] |
[production] |
| 14:16 |
<elukey> |
re-run webrequest-load-wf-text-2019-6-17-12 manually, failed due to reboots |
[analytics] |
| 14:15 |
<moritzm> |
installing poppler security updates on jessie |
[production] |
| 14:07 |
<andrewbogott> |
moving tools-sgewebgrid-lighttpd-0903 to cloudvirt1015 |
[tools] |
| 14:03 |
<cdanis> |
cdanis@cobalt.wikimedia.org ~ % sudo systemctl start gerrit.service |
[production] |
| 13:59 |
<andrewbogott> |
moving tools-sgewebgrid-generic-0902 and tools-sgewebgrid-lighttpd-0902 to cloudvirt1015 (optimistic re: T220853 ) |
[tools] |
| 13:53 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 13:49 |
<moritzm> |
installing libav security updates |
[production] |
| 13:45 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 13:45 |
<elukey> |
re-run webrequest-load-wf-upload-2019-6-17-12, failed due to reboots |
[analytics] |
| 13:45 |
<ema> |
reboot cp4027 for dist and Varnish upgrade T224694 |
[production] |
| 13:34 |
<elukey> |
reboot of an-worker* (Hadoop worker nodes) for kernel + openjdk upgrades |
[production] |
| 13:25 |
<ema> |
cp4027: upgrade Varnish packages to 5.1.3-1wm10 T224694 |
[production] |
| 12:37 |
<jbond42> |
upgrade mtail on lithium - T225604 |
[production] |
| 12:35 |
<jbond42> |
add mtail_3.0.0~rc24.1-1+wmf1_amd64.deb to jessie-wikimedia backports |
[production] |
| 12:13 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:514715|FileImporter configuration to fetch sitelinks from Wikidata (T225609 T224007)]] - finishing partial deployment (duration: 00m 47s) |
[production] |
| 12:06 |
<awight> |
EU SWAT complete |
[production] |
| 12:05 |
<awight@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|517391 Enable AMC mode for Persian, Japanese, Thai and Italian wikis (T225123)]] (duration: 00m 47s) |
[production] |
| 12:02 |
<Urbanecm> |
EU SWAT is going a few minutes beyond its window |
[production] |
| 11:55 |
<awight@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|516608 Enable feature flag for breaking Wikibase API change (T223303)]] (duration: 00m 47s) |
[production] |
| 11:49 |
<awight@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|516478 Set EntityUsageTable addUsage batch size to 200 (T225500)]] (duration: 00m 47s) |
[production] |