|
2017-01-31
§
|
| 09:38 |
<moritzm> |
rolling restart of cassandra in codfw to pick up openjdk and NSS security updates |
[production] |
| 09:00 |
<gehel> |
aligning elasticsearch low watermark to 75% disk space on all clusters (eqiad was at 70%) |
[production] |
| 08:44 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=aqs1007.eqiad.wmnet |
[production] |
| 08:40 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add a warning about a possible bad BBU on db1072 - T156226 (duration: 00m 46s) |
[production] |
| 08:26 |
<elukey> |
started Cassandra nodetool cleanup for aqs1004-a |
[production] |
| 07:54 |
<moritzm> |
installing chromium security update on osmium |
[production] |
| 07:49 |
<marostegui> |
Reboot db1072 to force BBU recharge - T156226 |
[production] |
| 07:10 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2034 - T156478 (duration: 00m 57s) |
[production] |
| 03:49 |
<andrewbogott> |
restarted nova-api on labnet1001 which actually fixed some things |
[production] |
| 03:28 |
<chasemp> |
(slightly belated) set logging level on serpens higher to see if ldap binding is an issue |
[production] |
| 02:45 |
<bd808> |
Setup temporary cron on silver as user bd808 until T156733 is fixed properly |
[production] |
| 02:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Jan 31 02:33:22 UTC 2017 (duration 5m 23s) |
[production] |
| 02:31 |
<bd808> |
Manually ran extensions/TorBlock/loadExitNodes.php on silver |
[production] |
| 02:28 |
<bd808@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable TorBlock for Wikitech (duration: 00m 41s) |
[production] |
| 02:28 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.9) (duration: 07m 09s) |
[production] |
| 02:16 |
<chasemp> |
restart uwsgi-keystone-admin and uwsgi-keystone-public on labcontrol1001 |
[production] |
| 00:25 |
<ebernhardson> |
restarting elasticsearch on elastic1029, got stuck in RemoteTransportException loop again |
[production] |
| 00:23 |
<mobrovac@tin> |
Started restart [electron-render/deploy@f1df2d3]: Service restart for firejail upgrade |
[production] |
| 00:22 |
<mobrovac@tin> |
Started restart [mobileapps/deploy@7615bf9]: Service restart for firejail upgrade |
[production] |
| 00:21 |
<mobrovac@tin> |
Started restart [mathoid/deploy@ba3217e]: Service restart for firejail upgrade |
[production] |
| 00:20 |
<mobrovac@tin> |
Started restart [graphoid/deploy@da37386]: Service restart for firejail upgrade |
[production] |
| 00:17 |
<mobrovac@tin> |
Started restart [cxserver/deploy@5ae4f8b]: Service restart for firejail upgrade |
[production] |
| 00:13 |
<mobrovac@tin> |
Started restart [citoid/deploy@95df861]: Service restart for firejail upgrade |
[production] |
| 00:10 |
<mobrovac@tin> |
Started restart [changeprop/deploy@2b980fa]: Service restart for firejail upgrade |
[production] |
|
2017-01-30
§
|
| 21:49 |
<eileen1> |
killed long running user-initiated dedupe query |
[production] |
| 21:24 |
<eileen1> |
updated civicrm from 6b6f5d68e20f268e1502b14c366cea78ff22dc96 to e17622be4b8f077ba23d7de00bb132419723963d |
[production] |
| 21:13 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@5735f00]: (no justification provided) (duration: 03m 13s) |
[production] |
| 21:10 |
<mobrovac@tin> |
Started deploy [trending-edits/deploy@5735f00]: (no justification provided) |
[production] |
| 21:09 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@5735f00]: (no justification provided) (duration: 03m 07s) |
[production] |
| 21:06 |
<mobrovac@tin> |
Started deploy [trending-edits/deploy@5735f00]: (no justification provided) |
[production] |
| 20:57 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@5735f00]: Bump memory limit and heartbeat timeout (duration: 01m 48s) |
[production] |
| 20:55 |
<mobrovac@tin> |
Started deploy [trending-edits/deploy@5735f00]: Bump memory limit and heartbeat timeout |
[production] |
| 20:50 |
<godog> |
uploaded scap 3.5.1-1 |
[production] |
| 20:50 |
<thcipriani@tin> |
Synchronized README: test scap (duration: 00m 43s) |
[production] |
| 20:47 |
<eileen1> |
updated localsettings to a346207afa927e8f2e5d78f14e078ac47e77053 |
[production] |
| 20:45 |
<mobrovac@tin> |
Finished deploy [trending-edits/deploy@9addcd0]: Bump max_age to 18h for T156411 (duration: 02m 39s) |
[production] |
| 20:43 |
<mobrovac@tin> |
Started deploy [trending-edits/deploy@9addcd0]: Bump max_age to 18h for T156411 |
[production] |
| 20:25 |
<eileen1> |
disable drupal update module on prod. T155084, this should still be on on dev sites so not using update script |
[production] |
| 20:12 |
<Pchelolo> |
update RESTBase to 501ea47edc in staging |
[production] |
| 20:09 |
<ejegg> |
updated payments-wiki config to d98b30bac746cee2619f69799ffc8bcc67362e7a |
[production] |
| 19:47 |
<gehel@tin> |
Finished deploy [wdqs/wdqs@81442a0]: (no justification provided) (duration: 01m 23s) |
[production] |
| 19:46 |
<gehel@tin> |
Started deploy [wdqs/wdqs@81442a0]: (no justification provided) |
[production] |
| 19:44 |
<gehel> |
deploying latest wdqs gui |
[production] |
| 18:56 |
<thcipriani> |
unlocking mediawiki deployments for test |
[production] |
| 18:53 |
<nuria@tin> |
Finished deploy [eventlogging/analytics@4b28b14]: (no justification provided) (duration: 00m 11s) |
[production] |
| 18:53 |
<nuria@tin> |
Started deploy [eventlogging/analytics@4b28b14]: (no justification provided) |
[production] |
| 18:50 |
<nuria> |
rollback deployment to eventlogging |
[production] |
| 18:48 |
<thcipriani> |
mediawiki deployments momentarily |
[production] |
| 18:46 |
<nuria@tin> |
Finished deploy [eventlogging/analytics@4b28b14]: (no justification provided) (duration: 00m 04s) |
[production] |
| 18:46 |
<nuria@tin> |
Started deploy [eventlogging/analytics@4b28b14]: (no justification provided) |
[production] |