|
2019-02-14
§
|
| 07:36 |
<marostegui> |
Stop MySQL on db1106 for reboot - T214840 |
[production] |
| 06:10 |
<marostegui> |
Deploy schema change on db1087 with replication, lag will be generated on labsdb:s8 T210713 |
[production] |
| 06:10 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1087 T210713 (duration: 00m 55s) |
[production] |
| 01:52 |
<mutante> |
scandium - removing parsoid deploy dir and letting puppet re-clone it after merging gerrit fix 484602 - replace manual clone with proper puppetization (T201366) |
[production] |
| 01:52 |
<mutante> |
scandium - removing parsoid deploy dir and letting puppet re-clone it after merging gerrit fix 484602 - replace manual hack with proper puppet |
[production] |
| 01:15 |
<mutante> |
phab1001 - phabricator mail config converted to cluster.mailers to adjust to upstream change (T212989) |
[production] |
| 00:36 |
<bd808@deploy1001> |
Finished deploy [scholarships/scholarships@1d89fe2]: Live hack PHPMailer namespace T215302 (duration: 00m 02s) |
[production] |
| 00:36 |
<bd808@deploy1001> |
Started deploy [scholarships/scholarships@1d89fe2]: Live hack PHPMailer namespace T215302 |
[production] |
| 00:32 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable ORES (damaging only) on itwiki (T211032) (duration: 00m 53s) |
[production] |
| 00:24 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable help panel search on cswiki and kowiki (T209301) (duration: 00m 55s) |
[production] |
|
2019-02-13
§
|
| 23:42 |
<niharika29@deploy1001> |
Finished deploy [scholarships/scholarships@1d89fe2]: Update scholarships app for 2019 cycle T215302 (duration: 00m 02s) |
[production] |
| 23:42 |
<niharika29@deploy1001> |
Started deploy [scholarships/scholarships@1d89fe2]: Update scholarships app for 2019 cycle T215302 |
[production] |
| 21:32 |
<marxarelli> |
dduvall@integration-slave-jessie-1001:/mnt/home/jenkins-deploy$ `rm -rf .gradle/ .m2/` due to full disk |
[releng] |
| 21:31 |
<jijiki> |
Restarting nutcracker on scb100*.eqiad.wmnet |
[production] |
| 21:21 |
<marxarelli> |
bringing integration-slave-docker-1046 and integration-slave-jessie-1001 back online |
[releng] |
| 21:20 |
<marxarelli> |
dduvall@integration-slave-jessie-1001:/srv/jenkins-workspace/workspace$ `sudo rm -rf *` due to full disk |
[releng] |
| 21:15 |
<marxarelli> |
removing old docker images on integration-slave-docker-1046 |
[releng] |
| 21:10 |
<marxarelli> |
starting migrated integration-slave-docker-1046 instance |
[releng] |
| 21:01 |
<marxarelli> |
pooling new jenkins node for integration-slave-docker-1052 |
[releng] |
| 20:54 |
<mutante> |
ruthenium - shell access for parsoid-testers revoked by puppet, please use scandium.eqiad.wmnet (T201366) |
[production] |
| 20:46 |
<marxarelli> |
pooling jenkins node for integration-slave-docker-1051 |
[releng] |
| 20:45 |
<marxarelli> |
launching replacement instance integration-slave-docker-1052 |
[releng] |
| 20:44 |
<otto@deploy1001> |
Started restart [eventstreams/deploy@07033d4]: bouncing eventstreams to apply page-links-change stream config |
[production] |
| 20:43 |
<mutante> |
ms-be2021 - powercycling |
[production] |
| 20:35 |
<marxarelli> |
launching replacement instance integration-slave-docker-1051 |
[releng] |
| 20:32 |
<marxarelli> |
pooling jenkins node for integration-slave-docker-1050 |
[releng] |
| 20:15 |
<marxarelli> |
integration-slave-docker-{1044,1046,1047} unresponsiveness due to cloudvirt failure. 1046 is being moved already by CS. deleting 1044 and 1047 |
[releng] |
| 20:09 |
<thcipriani@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.17 (duration: 00m 53s) |
[production] |
| 20:08 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.17 |
[production] |
| 19:57 |
<marxarelli> |
seeing jenkins agent connection failures for integration-slave-docker-{1044,1046,1047} |
[releng] |
| 19:55 |
<mforns@deploy1001> |
Finished deploy [analytics/refinery@5f1461e]: Deploying analytics refinery with refinery-source v0.0.85 jars (duration: 07m 36s) |
[production] |
| 19:48 |
<marxarelli> |
pooling replacement jenkins node integration-slave-docker-1049 |
[releng] |
| 19:48 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@5f1461e]: Deploying analytics refinery with refinery-source v0.0.85 jars |
[production] |
| 19:46 |
<mforns> |
Deploying refinery with scap |
[analytics] |
| 19:34 |
<marxarelli> |
deleting integration-slave-jessie-android jenkins node and instance |
[releng] |
| 19:33 |
<marxarelli> |
deleting integration-slave-jessie-1003 jenkins node and instance |
[releng] |
| 19:32 |
<marxarelli> |
deleting integration-slave-docker-1033 jenkins node and instance |
[releng] |
| 19:25 |
<marxarelli> |
deleting integration-slave-docker-1017 jenkins node and instance |
[releng] |
| 19:17 |
<andrewbogott> |
deleting design-lsg3 — it was shutdown and also was located on failing hardware |
[design] |
| 19:16 |
<andrewbogott> |
deleting tools-sgewebgrid-generic-0901, tools-sgewebgrid-lighttpd-0901, tools-sgebastion-06 |
[tools] |
| 19:15 |
<andrewbogott> |
deleting striker-puppet01 and striker-deploy04 |
[striker] |
| 19:14 |
<andrewbogott> |
deleting k8s-master-01, k8s-node-03, k8s-node-05, k8s-node-06 as part of the cloudvirt1018 cleanup. |
[general-k8s] |
| 19:12 |
<mforns> |
Deployed refinery-source v0.0.85 using jenkins |
[analytics] |
| 18:45 |
<Krinkle> |
integration-slave-jessie-1003 seems to be consitently unable to start jobs, marking as offline manually |
[releng] |
| 18:32 |
<thcipriani> |
bringing up new integration-castor03, re-enabling castor-save* jobs |
[releng] |
| 18:15 |
<marxarelli> |
adding new jenkins node integration-slave-docker-1048 |
[releng] |
| 18:13 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool es1014 (duration: 00m 52s) |
[production] |
| 18:06 |
<godog> |
reimage prometheus2003 - T187987 |
[production] |
| 18:02 |
<marxarelli> |
launching new integration-slave-docker-1048 instance |
[releng] |
| 18:00 |
<krinkle@deploy1001> |
Synchronized php-1.33.0-wmf.17/includes/libs/rdbms/loadbalancer/LoadBalancer.php: Id70fdfa62ef / T215611 (duration: 00m 55s) |
[production] |