2017-08-13
§
|
22:45 |
<ebernhardson> |
restart elsaticsearch on elastic1017 after setting md2 readahead to 256 to match md2 on 1032-152 |
[production] |
22:45 |
<Sagan> |
CAC: vagrant git-update |
[rcm] |
20:13 |
<bd808> |
Got a clean scap3 deploy after manually deleting __pycache__ directories on deploy target |
[striker] |
19:48 |
<bd808> |
Cherry-picked 370139 fro final testing |
[striker] |
19:35 |
<godog> |
upload python-thumbor-wikimedia 1.2 - T161719 |
[production] |
19:01 |
<godog> |
bounce pdfrender on scb1001 and scb1003 - T159922 |
[production] |
18:46 |
<godog> |
bounce carbon and uwsgi on graphite1003 |
[production] |
17:53 |
<reedy@tin> |
Synchronized wmf-config/db-eqiad.php: fix comment (duration: 00m 47s) |
[production] |
17:52 |
<reedy@tin> |
Synchronized wmf-config/db-codfw.php: fix comment (duration: 00m 47s) |
[production] |
17:51 |
<reedy@tin> |
Synchronized refresh-dblist: phpcs (duration: 00m 48s) |
[production] |
15:58 |
<bd808> |
Hacked keystone admin endpoint config manually -- openstack endpoint set --url http://striker-deploy03.striker.eqiad.wmflabs:5000/v3/ 35205d049ccc4235a7e165bae9632ee0 |
[striker] |
13:26 |
<chasemp> |
webservice --backend=gridengine stop && webservice --backend=kubernetes start |
[tools.admin] |
2017-08-11
§
|
21:47 |
<legoktm@tin> |
Finished scap: (no justification provided) (duration: 07m 09s) |
[production] |
21:41 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: mw2256.codfw.wmnet |
[production] |
21:40 |
<legoktm@tin> |
Started scap: (no justification provided) |
[production] |
21:40 |
<legoktm@tin> |
scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.unknown-but-probably-mediawiki.lock"; owner is "legoktm"; reason is "Deploying Timeless (try 2) - T154371" (duration: 00m 00s) |
[production] |
21:02 |
<ebernhardson> |
unban elastic1017 from elasticsearch cluster |
[production] |
20:52 |
<bblack> |
varnish backend restart on cp1099 |
[production] |
20:46 |
<legoktm@tin> |
Started scap: Deploying Timeless (try 2) - T154371 |
[production] |
20:42 |
<legoktm@tin> |
scap aborted: Deploying Timeless - T154371 (duration: 05m 10s) |
[production] |
20:36 |
<legoktm@tin> |
Started scap: Deploying Timeless - T154371 |
[production] |
20:25 |
<addshore> |
added mediawiki::maintenance::wikidata to deployment-tin |
[releng] |
20:19 |
<bblack> |
varnish backend restart on cp1049 + cp1074 (mailbox lag) |
[production] |
19:59 |
<ebernhardson> |
ban elastic1017 from eqiad search cluster |
[production] |
18:28 |
<moritzm> |
installing subversion security updates |
[production] |
17:19 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2075 (duration: 00m 47s) |
[production] |
17:17 |
<bd808> |
Restarted webservice due to intermittent 500 errors |
[tools.phabricator-bug-status] |
17:05 |
<twentyafterfour> |
Deploying phabricator security update |
[production] |
16:21 |
<jynus_> |
stop db1069:s6 replication and dropping frwiki, jawiki, ruwiki |
[production] |
16:16 |
<paladox> |
recreating puppet-phabricator (accidentily removed the wrong cert which is for puppet) was meant to remove phab-01. |
[phabricator] |
16:15 |
<Sagan> |
Xenon: Running update.sh (again) to include the Security fix |
[rcm] |
16:09 |
<chasemp> |
qdel -f -j 7441503 |
[tools] |
15:42 |
<paladox> |
recreating phab-01 with stretch |
[phabricator] |
15:41 |
<jynus_> |
stopping db2075 to clone it to dbstore2001 |
[production] |
15:39 |
<moritzm> |
installing git security updates on trusty (jessie/stretch already fixed) |
[production] |
15:38 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2075 (duration: 00m 48s) |
[production] |
14:26 |
<paladox> |
upgrading gerrit-test3 to gerrit 2.14.3 pre |
[git] |
13:51 |
<elukey> |
moved the eventbus scap deployment dirs on kafka[12]00[123] to deploy-service:deploy-service to allow scap to depool/pool - T171506 |
[production] |
13:49 |
<mobrovac@tin> |
Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 27s) |
[production] |
13:49 |
<mobrovac@tin> |
Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) |
[production] |
13:42 |
<mobrovac@tin> |
Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 13s) |
[production] |