|
2016-07-13
ยง
|
| 16:41 |
<demon@tin> |
scap aborted: wmf.10 code sync + testwiki to wmf.10 for l10n cache gen (duration: 00m 37s) |
[production] |
| 16:40 |
<demon@tin> |
Started scap: wmf.10 code sync + testwiki to wmf.10 for l10n cache gen |
[production] |
| 16:39 |
<demon@tin> |
Purged l10n cache for 1.28.0-wmf.9 |
[production] |
| 16:38 |
<demon@tin> |
Purged l10n cache for 1.28.0-wmf.7 |
[production] |
| 16:38 |
<demon@tin> |
Purged l10n cache for 1.28.0-wmf.6 |
[production] |
| 16:37 |
<demon@tin> |
Purged l10n cache for 1.28.0-wmf.5 |
[production] |
| 16:32 |
<halfak> |
terminated ores-web-05 |
[ores] |
| 16:19 |
<hashar> |
CI slightly overloaded / backloaded due to a long tail of Wikibase changes sent in Gerrit. |
[production] |
| 16:05 |
<urandom> |
Installing Cassandra 2.2.6-wmf1 on deployment-restbase0[1-2].deployment-prep.eqiad.wmflabs : T126629 |
[releng] |
| 16:03 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:298786|[Beta] Change ORES thresholds in beta]] (duration: 00m 29s) |
[production] |
| 16:01 |
<thcipriani@tin> |
Synchronized wmf-config/LabsServices.php: SWAT: [[gerrit:298782|[Beta] Parsoid: direct traffic to deployment-parsoid07]] (duration: 00m 26s) |
[production] |
| 15:58 |
<halfak> |
repooled ores-web-04 |
[ores] |
| 15:30 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:298715|Enable ORES review tool for Turkish Wikipedia (T139992)]] (duration: 00m 28s) |
[production] |
| 15:20 |
<halfak> |
deployed ores-wmflabs-deploy:e638f1b |
[ores] |
| 15:11 |
<urandom> |
Stopping Staging dumps : T139639 |
[production] |
| 15:02 |
<andrewbogott> |
deleting/recreating encoding01 |
[video] |
| 14:44 |
<urandom> |
Starting offset dump runs from {xenon,cerium,praseodymium}.eqiad.wmnet : T139639 |
[production] |
| 14:38 |
<urandom> |
Restarting Cassandra on xenon.eqiad.wmnet : T139639 |
[production] |
| 14:32 |
<urandom> |
Restarting RESTBase on xenon.eqiad.wmnet : T139639 |
[production] |
| 14:29 |
<yurik> |
deployed kartotherian https://gerrit.wikimedia.org/r/#/c/298731/ & tilerator https://gerrit.wikimedia.org/r/#/c/298732/ |
[production] |
| 14:25 |
<moritzm> |
depooling mw1298 (image scaler) for some tests |
[production] |
| 14:21 |
<godog> |
reboot ms-be1012, many mkfs.xfs stuck on broken sdh |
[production] |
| 14:17 |
<oblivian@palladium> |
conftool action : delete; selector: cluster=rcstream |
[production] |
| 14:16 |
<gehel> |
shutting down elastic1001-1016 (T139758) |
[production] |
| 14:16 |
<oblivian@palladium> |
conftool action : delete; selector: cluster=rcstream |
[production] |
| 14:13 |
<yurik> |
about to deploy updated kartotherian & tilerator for node 4.4.6 |
[production] |
| 14:09 |
<urandom> |
Dropping legacy system_auth tables in staging to complete RBAC conversion : T139639 |
[production] |
| 14:05 |
<bblack> |
rcstream cleanup done, puppet re-enabled on relevant lvs and rcs100x |
[production] |
| 13:58 |
<gehel> |
cleanup puppet / salt from old elasticsearch servers elastic1001-1016 (T139758) |
[production] |
| 13:58 |
<hashar> |
T137525 reverted Zuul back to zuul_2.1.0-95-g66c8e52-wmf1precise1_amd64.deb . It could not connect to Gerrit reliably |
[production] |
| 13:58 |
<hashar> |
T137525 reverted Zuul back to zuul_2.1.0-95-g66c8e52-wmf1precise1_amd64.deb . It could not connect to Gerrit reliably |
[releng] |
| 13:46 |
<hashar> |
T137525 Stopped zuul that ran in a terminal (with -d). Started it with the init script. |
[releng] |
| 13:45 |
<ottomata> |
restarting hadoop nodemanagers to apply log aggregation retention check interval change |
[production] |
| 13:45 |
<ottomata> |
restarting hadoop nodemanagers to apply log aggregation retention check interval change |
[analytics] |
| 13:43 |
<bblack> |
restarting pybal on primary eqiad high-traffic2 (lvs1002) |
[production] |
| 13:41 |
<moritzm> |
upgrading hhvm on remaining appservers in eqiad and codfw |
[production] |
| 13:34 |
<gehel> |
disabling puppet and stopping elasticsearch on elastic1001-1016 (T139758) |
[production] |
| 13:30 |
<bblack> |
disabling puppet on rcs100[12] for rcstream cleanup |
[production] |
| 13:29 |
<bblack> |
disabling puppet on eqiad high-traffic2 lvs for rcstream cleanup |
[production] |
| 13:20 |
<gehel> |
scheduling icinga downtime on elastic1001-1016 prior to decommissioning (T139758) |
[production] |
| 13:14 |
<elukey> |
varnishkafka upgraded from 1.0.10-1 to 1.0.11-1 manually on cp3008.esams (misc) and via apt for the whole cache maps cluster |
[analytics] |
| 13:01 |
<elukey> |
upgrading cache maps to varnishkafka 1.0.11-1 |
[production] |
| 13:00 |
<elukey> |
uploaded varnishkafka 1.0.11-1 to jessie-wikimedia experimental |
[production] |
| 12:52 |
<hashar> |
CI is processing with Zuul 2.1.0-151-g30a433b. It might stop processing events at anytime though due to T137525 |
[production] |
| 12:36 |
<hashar> |
T137525 Upgrading Zuul 2.1.0-95-g66c8e52-wmf1precise1 ... zuul_2.1.0-151-g30a433b-wmf1precise1_amd64.deb |
[releng] |
| 12:36 |
<hashar> |
T137525 Upgrading Zuul 2.1.0-95-g66c8e52-wmf1precise1 ... zuul_2.1.0-151-g30a433b-wmf1precise1_amd64.deb |
[production] |
| 11:52 |
<elukey> |
installing varnishkafka_1.0.11-1 on cp3008.esams to test it before the complete rollout |
[production] |
| 11:40 |
<yuvipanda> |
cold-migrate tools-worker-1014 off labvirt1010 to see if that improves the ksoftirqd situation |
[tools] |
| 11:38 |
<paravoid> |
cr1-ulsfo: "restart snmp" to fix SNMP hiccup after reboot |
[production] |
| 11:38 |
<paravoid> |
cr1/2-ulsfo: disabling flow monitoring |
[production] |