|
2019-01-31
§
|
| 13:34 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
| 13:34 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
| 13:31 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 13:31 |
<mvolz@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
| 13:31 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
| 13:19 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
| 13:19 |
<mvolz@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
| 13:19 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml --version=0.0.1 stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 13:18 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] |
[production] |
| 12:54 |
<jynus> |
stop, upgrade and restart db2044 |
[production] |
| 12:44 |
<arturo> |
T215012 depooling cloudvirt1015 and migrating all VMs to cloudvirt1024 |
[admin] |
| 12:44 |
<arturo> |
T214012 depooling cloudvirt1015 and migrating all VMs to cloudvirt1024 |
[admin] |
| 12:12 |
<jynus> |
apply new grants to m5-master with replication T214740 |
[production] |
| 12:07 |
<arturo> |
VM instances mediawiki2latex, were stopped briefly due to issue in hypervisor (T215012) |
[collection-alt-renderer] |
| 12:07 |
<arturo> |
VM instances ldfclient-new, were stopped briefly due to issue in hypervisor (T215012) |
[wikidata-query] |
| 12:07 |
<arturo> |
VM instances wikidata-misc, were stopped briefly due to issue in hypervisor (T215012). |
[wikidata-dev] |
| 12:06 |
<arturo> |
VM instances deployment-webperf12,ecmabot, were stopped briefly due to issue in hypervisor (T215012) |
[webperf] |
| 12:06 |
<arturo> |
VM instances encoding02,encoding03, were stopped briefly due to issue in hypervisor (T215012) |
[video] |
| 12:06 |
<arturo> |
VM instances twlight-prod,twlight-staging,twlight-tracker, were stopped briefly due to issue in hypervisor (T215012) |
[twl] |
| 12:06 |
<arturo> |
VM instances packaging, were stopped briefly due to issue in hypervisor (T215012) |
[thumbor] |
| 12:06 |
<arturo> |
VM instances canary1015-01, were stopped briefly due to issue in hypervisor (T215012) |
[testlabs] |
| 12:06 |
<arturo> |
VM instances hafnium,neon,oxygen, were stopped briefly due to issue in hypervisor (T215012) |
[rcm] |
| 12:05 |
<arturo> |
VM instances novaadminmadethis, were stopped briefly due to issue in hypervisor (T215012) |
[quotatest] |
| 12:05 |
<arturo> |
VM instances ores-puppetmaster-01,ores-sentinel-01, were stopped briefly due to issue in hypervisor (T215012) |
[ores] |
| 12:05 |
<arturo> |
VM instances drmf,drmf-beta,math-docker, were stopped briefly due to issue in hypervisor (T215012) |
[math] |
| 12:05 |
<arturo> |
VM instances integration-slave-docker-1044,integration-slave-docker-1046,integration-slave-docker-1047, were stopped briefly due to issue in hypervisor (T215012) |
[integration] |
| 12:05 |
<arturo> |
VM instances hound-app-01, were stopped briefly due to issue in hypervisor (T215012) |
[hound] |
| 12:05 |
<arturo> |
VM instances deployment-deploy01,deployment-deploy02,deployment-fluorine02,deployment-kafka-jumbo-2,deployment-kafka-main-1,deployment-maps04,deployment-mcs01,deployment-mediawiki-09,deployment-memc04,deployment-ms-be03,deployment-ms-fe02,deployment-parsoid09,deployment-sca04,deployment-webperf12, were stopped briefly due to issue in hypervisor (T215012) |
[releng] |
| 12:05 |
<arturo> |
VM instances deployment-deploy01,deployment-deploy02,deployment-fluorine02,deployment-kafka-jumbo-2,deployment-kafka-main-1,deployment-maps04,deployment-mcs01,deployment-mediawiki-09,deployment-memc04,deployment-ms-be03,deployment-ms-fe02,deployment-parsoid09,deployment-sca04,deployment-webperf12, were stopped briefly due to issue in hypervisor (T215012) |
[deployment-prep] |
| 12:05 |
<arturo> |
VM instances accounts-appserver5, were stopped briefly due to issue in hypervisor (T215012) |
[account-creation-assistance] |
| 12:04 |
<arturo> |
VM instances accounts-appserver5, were stopped briefly due to issue in hypervisor (T215012) |
[account-creation-assistance] |
| 11:30 |
<arturo> |
T215012 icinga downtime cloudvirt1015 for 4h while investigating issues |
[production] |
| 11:24 |
<arturo> |
T215012 reboot cloudvirt1015 |
[production] |
| 11:24 |
<jynus> |
restart eventstreams on scb1002,3,4 |
[production] |
| 11:22 |
<jynus> |
restart eventstreams on scb1001 |
[production] |
| 10:22 |
<jynus> |
resetting to defaults innodb consistency options for db2048 T188327 |
[production] |
| 10:00 |
<jynus> |
restarting pdfrender on scb1002,3,4 |
[production] |
| 09:54 |
<jynus> |
restarting pdfrender on scb1001 |
[production] |
| 02:01 |
<gtirloni> |
T215004 restarted gerrit (using 1200% cpu, 71% mem) |
[production] |