|
2019-05-16
§
|
| 08:47 |
<akosiaris@deploy1001> |
scap-helm mathoid upgrade -f mathoid-values.yaml [namespace: mathoid, clusters: eqiad,codfw] |
[production] |
| 08:37 |
<godog> |
bootstrap restbase1020-a - T219404 |
[production] |
| 08:32 |
<elukey> |
depool/restart-nutcracker-pool mw1293/1313 - T214275 |
[production] |
| 08:22 |
<elukey> |
depool/restart-nutcracker-pool mw1238 - T214275 |
[production] |
| 08:03 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1104 (duration: 00m 56s) |
[production] |
| 07:57 |
<moritzm> |
installing linux 4.9.168-1+deb9u2~deb8u1 kernel on jessie hosts (no reboots, just installing the new package) |
[production] |
| 07:45 |
<moritzm> |
removed intel-microcode 3.20180807a from jessie-wikimedia (superceded by newer version in security.debian.org, which doesn't get picked up by apt due to the higher apr priority of jessie-wikimedia) |
[production] |
| 07:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1104 into API (duration: 00m 56s) |
[production] |
| 07:25 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1104 (duration: 00m 57s) |
[production] |
| 06:59 |
<moritzm> |
installing intel-microcode updates |
[production] |
| 05:34 |
<elukey> |
roll restart of nutcracker on mw2* to pick up new config changes (no more memcached config) - T214275 |
[production] |
| 05:33 |
<marostegui> |
Stop MySQL on db1104 to clone db1126 |
[production] |
| 05:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1104 (duration: 00m 56s) |
[production] |
| 05:18 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Pool db2106, db2110, db2119 into s4 - T222772 (duration: 00m 56s) |
[production] |
| 05:17 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Pool db2106, db2110, db2119 into s4 - T222772 (duration: 00m 58s) |
[production] |
| 02:27 |
<onimisionipe> |
pooling elastic2038 after unbanning - T217398 |
[production] |
|
2019-05-15
§
|
| 22:16 |
<mutante> |
phab1003 - start ssh-phab service after adding service IPs |
[production] |
| 22:01 |
<eileen> |
civicrm update - lost the commit versions but 5.13.4 release |
[production] |
| 21:47 |
<mutante> |
phab1003 - ip -6 addr del 2620:0:861:ed1a::3:16/128 dev lo - remove extra service IP for phab's separate sshd, duplicated with phab1001 (T190568) |
[production] |
| 21:24 |
<jforrester@deploy1001> |
Synchronized wmf-config/MetaContactPages.php: Add movecomsignup contact page on meta T218363 (duration: 00m 56s) |
[production] |
| 21:23 |
<eileen> |
civicrm revision changed from 7d3ef1f2ae to c69c6e2e6a, config revision is a099f13a55 |
[production] |
| 21:00 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@ffa4931]: deploying analytics refinery (duration: 15m 31s) |
[production] |
| 20:45 |
<tgr@deploy1001> |
Finished deploy [proton/deploy@9373c42]: Add gistcdn.githack.com to host blacklist (T213362) (duration: 02m 41s) |
[production] |
| 20:45 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@ffa4931]: deploying analytics refinery |
[production] |
| 20:42 |
<tgr@deploy1001> |
Started deploy [proton/deploy@9373c42]: Add gistcdn.githack.com to host blacklist (T213362) |
[production] |
| 20:20 |
<robh> |
rebooting cloudvirt1015 into dell hardware tests per T220853 |
[production] |
| 20:18 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@8f28977]: Updating Parsoid to 6658cad (duration: 06m 23s) |
[production] |
| 20:12 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@8f28977]: Updating Parsoid to 6658cad |
[production] |
| 19:41 |
<hashar> |
group 1 promoted to 1.34.0-wmf.5 apparently without any issue # T220730 |
[production] |
| 19:03 |
<hashar@deploy1001> |
Synchronized php: group1 wikis to 1.34.0-wmf.5 (duration: 00m 58s) |
[production] |
| 19:02 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.5 |
[production] |
| 18:38 |
<andyrussg@deploy1001> |
Synchronized php-1.34.0-wmf.5/extensions/CentralNotice/: Revert CentralNotice (duration: 01m 00s) |
[production] |
| 17:32 |
<thcipriani> |
deploy1001:sudo -u www-data /usr/local/bin/foreachwiki extensions/WikimediaMaintenance/refreshMessageBlobs.php |
[production] |
| 17:19 |
<onimisionipe> |
unban elastic2038 from shard allocation - T217398 |
[production] |
| 17:19 |
<XenoRyet> |
updated civicrm from 4b6d569383 to 7d3ef1f2ae |
[production] |
| 17:09 |
<elukey> |
powerup elastic2038 (was down for maintenance) |
[production] |
| 17:01 |
<godog> |
bootstrap restbase1019-c - T219404 |
[production] |
| 16:58 |
<bstorm_> |
T212972 updated all views on labsdb1012 |
[production] |
| 16:50 |
<elukey> |
restart Hadoop HDFS namenodes on an-master100[1,2] to pick up new settings |
[production] |
| 16:40 |
<urandom> |
bootstrap restbase1019-c - T219404 |
[production] |
| 16:28 |
<elukey> |
restart nutcracker on mw2240 to pick up the new config (no more memcached settings) |
[production] |
| 16:26 |
<bstorm_> |
T212972 updated all views on labsdb1009 |
[production] |
| 16:17 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T223166 (duration: 00m 56s) |
[production] |
| 16:16 |
<reedy@deploy1001> |
Synchronized php-1.34.0-wmf.5/extensions/WikimediaEvents/: T219128 (duration: 01m 13s) |
[production] |
| 16:14 |
<reedy@deploy1001> |
Synchronized php-1.34.0-wmf.4/extensions/WikimediaEvents/: T219128 (duration: 01m 06s) |
[production] |
| 16:03 |
<jynus> |
disable puppet on all production databases |
[production] |
| 15:21 |
<reedy@deploy1001> |
Synchronized php-1.34.0-wmf.4/extensions/GrowthExperiments/includes/HelpPanel/QuestionPoster.php: T222980 (duration: 00m 57s) |
[production] |
| 14:28 |
<andrewbogott> |
repooling labweb1002 |
[production] |
| 14:16 |
<andrewbogott> |
depooling labweb1002 to test https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/509916/ |
[production] |
| 14:15 |
<godog> |
bootstrap restbase1019-b - T219404 |
[production] |