2019-01-31
§
|
17:44 |
<jynus> |
running alter table on metawiki.revision_actor_temp, trying to fix TokuDB horrible bugs |
[production] |
15:54 |
<jynus> |
stop, upgrade and restart db1117 |
[production] |
15:03 |
<thcipriani> |
rearm keyholder on deployment-deploy01 |
[releng] |
13:34 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
13:34 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
13:34 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
13:31 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
13:31 |
<mvolz@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
13:31 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
13:19 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
13:19 |
<mvolz@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
13:19 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml --version=0.0.1 stable/zotero [namespace: zotero, clusters: staging] |
[production] |
13:18 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] |
[production] |
12:54 |
<jynus> |
stop, upgrade and restart db2044 |
[production] |
12:44 |
<arturo> |
T215012 depooling cloudvirt1015 and migrating all VMs to cloudvirt1024 |
[admin] |
12:44 |
<arturo> |
T214012 depooling cloudvirt1015 and migrating all VMs to cloudvirt1024 |
[admin] |
12:12 |
<jynus> |
apply new grants to m5-master with replication T214740 |
[production] |
12:07 |
<arturo> |
VM instances mediawiki2latex, were stopped briefly due to issue in hypervisor (T215012) |
[collection-alt-renderer] |
12:07 |
<arturo> |
VM instances ldfclient-new, were stopped briefly due to issue in hypervisor (T215012) |
[wikidata-query] |
12:07 |
<arturo> |
VM instances wikidata-misc, were stopped briefly due to issue in hypervisor (T215012). |
[wikidata-dev] |
12:06 |
<arturo> |
VM instances deployment-webperf12,ecmabot, were stopped briefly due to issue in hypervisor (T215012) |
[webperf] |
12:06 |
<arturo> |
VM instances encoding02,encoding03, were stopped briefly due to issue in hypervisor (T215012) |
[video] |
12:06 |
<arturo> |
VM instances twlight-prod,twlight-staging,twlight-tracker, were stopped briefly due to issue in hypervisor (T215012) |
[twl] |
12:06 |
<arturo> |
VM instances packaging, were stopped briefly due to issue in hypervisor (T215012) |
[thumbor] |
12:06 |
<arturo> |
VM instances canary1015-01, were stopped briefly due to issue in hypervisor (T215012) |
[testlabs] |
12:06 |
<arturo> |
VM instances hafnium,neon,oxygen, were stopped briefly due to issue in hypervisor (T215012) |
[rcm] |
12:05 |
<arturo> |
VM instances novaadminmadethis, were stopped briefly due to issue in hypervisor (T215012) |
[quotatest] |
12:05 |
<arturo> |
VM instances ores-puppetmaster-01,ores-sentinel-01, were stopped briefly due to issue in hypervisor (T215012) |
[ores] |
12:05 |
<arturo> |
VM instances drmf,drmf-beta,math-docker, were stopped briefly due to issue in hypervisor (T215012) |
[math] |
12:05 |
<arturo> |
VM instances integration-slave-docker-1044,integration-slave-docker-1046,integration-slave-docker-1047, were stopped briefly due to issue in hypervisor (T215012) |
[integration] |
12:05 |
<arturo> |
VM instances hound-app-01, were stopped briefly due to issue in hypervisor (T215012) |
[hound] |
12:05 |
<arturo> |
VM instances deployment-deploy01,deployment-deploy02,deployment-fluorine02,deployment-kafka-jumbo-2,deployment-kafka-main-1,deployment-maps04,deployment-mcs01,deployment-mediawiki-09,deployment-memc04,deployment-ms-be03,deployment-ms-fe02,deployment-parsoid09,deployment-sca04,deployment-webperf12, were stopped briefly due to issue in hypervisor (T215012) |
[releng] |
12:05 |
<arturo> |
VM instances deployment-deploy01,deployment-deploy02,deployment-fluorine02,deployment-kafka-jumbo-2,deployment-kafka-main-1,deployment-maps04,deployment-mcs01,deployment-mediawiki-09,deployment-memc04,deployment-ms-be03,deployment-ms-fe02,deployment-parsoid09,deployment-sca04,deployment-webperf12, were stopped briefly due to issue in hypervisor (T215012) |
[deployment-prep] |
12:05 |
<arturo> |
VM instances accounts-appserver5, were stopped briefly due to issue in hypervisor (T215012) |
[account-creation-assistance] |
12:04 |
<arturo> |
VM instances accounts-appserver5, were stopped briefly due to issue in hypervisor (T215012) |
[account-creation-assistance] |
11:30 |
<arturo> |
T215012 icinga downtime cloudvirt1015 for 4h while investigating issues |
[production] |
11:24 |
<arturo> |
T215012 reboot cloudvirt1015 |
[production] |
11:24 |
<jynus> |
restart eventstreams on scb1002,3,4 |
[production] |