|
2019-02-13
§
|
| 20:15 |
<marxarelli> |
integration-slave-docker-{1044,1046,1047} unresponsiveness due to cloudvirt failure. 1046 is being moved already by CS. deleting 1044 and 1047 |
[releng] |
| 20:09 |
<thcipriani@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.17 (duration: 00m 53s) |
[production] |
| 20:08 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.17 |
[production] |
| 19:57 |
<marxarelli> |
seeing jenkins agent connection failures for integration-slave-docker-{1044,1046,1047} |
[releng] |
| 19:55 |
<mforns@deploy1001> |
Finished deploy [analytics/refinery@5f1461e]: Deploying analytics refinery with refinery-source v0.0.85 jars (duration: 07m 36s) |
[production] |
| 19:48 |
<marxarelli> |
pooling replacement jenkins node integration-slave-docker-1049 |
[releng] |
| 19:48 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@5f1461e]: Deploying analytics refinery with refinery-source v0.0.85 jars |
[production] |
| 19:46 |
<mforns> |
Deploying refinery with scap |
[analytics] |
| 19:34 |
<marxarelli> |
deleting integration-slave-jessie-android jenkins node and instance |
[releng] |
| 19:33 |
<marxarelli> |
deleting integration-slave-jessie-1003 jenkins node and instance |
[releng] |
| 19:32 |
<marxarelli> |
deleting integration-slave-docker-1033 jenkins node and instance |
[releng] |
| 19:25 |
<marxarelli> |
deleting integration-slave-docker-1017 jenkins node and instance |
[releng] |
| 19:17 |
<andrewbogott> |
deleting design-lsg3 — it was shutdown and also was located on failing hardware |
[design] |
| 19:16 |
<andrewbogott> |
deleting tools-sgewebgrid-generic-0901, tools-sgewebgrid-lighttpd-0901, tools-sgebastion-06 |
[tools] |
| 19:15 |
<andrewbogott> |
deleting striker-puppet01 and striker-deploy04 |
[striker] |
| 19:14 |
<andrewbogott> |
deleting k8s-master-01, k8s-node-03, k8s-node-05, k8s-node-06 as part of the cloudvirt1018 cleanup. |
[general-k8s] |
| 19:12 |
<mforns> |
Deployed refinery-source v0.0.85 using jenkins |
[analytics] |
| 18:45 |
<Krinkle> |
integration-slave-jessie-1003 seems to be consitently unable to start jobs, marking as offline manually |
[releng] |
| 18:32 |
<thcipriani> |
bringing up new integration-castor03, re-enabling castor-save* jobs |
[releng] |
| 18:15 |
<marxarelli> |
adding new jenkins node integration-slave-docker-1048 |
[releng] |
| 18:13 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool es1014 (duration: 00m 52s) |
[production] |
| 18:06 |
<godog> |
reimage prometheus2003 - T187987 |
[production] |
| 18:02 |
<marxarelli> |
launching new integration-slave-docker-1048 instance |
[releng] |
| 18:00 |
<krinkle@deploy1001> |
Synchronized php-1.33.0-wmf.17/includes/libs/rdbms/loadbalancer/LoadBalancer.php: Id70fdfa62ef / T215611 (duration: 00m 55s) |
[production] |
| 17:59 |
<marxarelli> |
deleting integration-slave-docker-1038 node and deleting instance |
[releng] |
| 17:50 |
<marxarelli> |
bringing integration-slave-docker-1033 back online after clearing out old docker images |
[releng] |
| 17:49 |
<marostegui> |
Stop MYSQL on db1114 for onsite maintenance - T214720 |
[production] |
| 17:33 |
<thcipriani> |
rebuilding integration-castor03 |
[releng] |
| 17:25 |
<jijiki> |
Pooling mw1299 back - T215569 |
[production] |
| 17:21 |
<thcipriani> |
stopping rsync server on castor03 |
[releng] |
| 17:21 |
<twentyafterfour> |
stopped rsync on castor03 |
[releng] |
| 17:16 |
<twentyafterfour> |
disconnected castor03 from jenkins |
[releng] |
| 17:06 |
<cmjohnson1> |
db1106, troubleshooting idrac issue and updating f/w |
[production] |
| 16:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 16:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
| 16:58 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade staging stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
| 16:48 |
<thcipriani> |
reloading zuul to deploy https://gerrit.wikimedia.org/r/#/c/integration/config/+/487880/ |
[releng] |
| 16:30 |
<elukey> |
reimage stat1005 to Debian Buster (again) |
[production] |
| 16:22 |
<otto@deploy1001> |
scap-helm list finished |
[production] |
| 16:22 |
<otto@deploy1001> |
scap-helm list cluster staging completed |
[production] |
| 16:22 |
<otto@deploy1001> |
scap-helm list [namespace: list, clusters: staging] |
[production] |
| 16:13 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 16:13 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
| 16:13 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade staging stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
| 15:46 |
<marostegui> |
Stop MySQL on db1106 for onsite maintenance - this will generate lag on s1 labs - T214840 |
[production] |
| 15:28 |
<jynus> |
stop and upgrade es1014 |
[production] |
| 15:27 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
| 15:27 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
| 15:27 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade staging stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] |
[production] |
| 15:27 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade staging stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad,codfw] |
[production] |