|
2016-08-04
ยง
|
| 18:36 |
<cwd> |
updated payments from 3a724bfb1a3e20e17b5886dae0ba7572020abd6b to b737b60c87da82543ab812ece4611c68af01307f |
[production] |
| 18:12 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db1074 as backup rc node in case db1036 lags (duration: 00m 25s) |
[production] |
| 18:12 |
<awight> |
update paymentswiki config to 71cc55194f4465600ce4da0ea9f7dfaefdda5479 |
[production] |
| 18:09 |
<bd808> |
Restarted grrrit-wm pod |
[tools.lolrrit-wm] |
| 18:02 |
<halfak> |
rebooting ores-web-05 to address OOM |
[ores] |
| 17:56 |
<halfak> |
reduced web workers per core from 28 to 16 |
[ores] |
| 17:36 |
<elukey> |
added the analytics-deploy key to the Keyholder for the Analytics Refinery scap3 migration (also updated https://wikitech.wikimedia.org/wiki/Keyholder) |
[production] |
| 17:36 |
<elukey> |
added the analytics-deploy key to the Keyholder for the Analytics Refinery scap3 migration (also updated https://wikitech.wikimedia.org/wiki/Keyholder) |
[analytics] |
| 17:28 |
<elukey> |
deploying the refinery with scap3 for the first time on all nodes |
[analytics] |
| 17:18 |
<ostriches> |
gerrit: Restarting really quick, trying alternative mysql library. |
[production] |
| 17:17 |
<urandom> |
T140825,T140869: Restarting Cassandra, restbase1007-c.eqiad.wmnet |
[production] |
| 17:14 |
<urandom> |
T140825,T140869: Restarting Cassandra, restbase1007-b.eqiad.wmnet |
[production] |
| 17:08 |
<urandom> |
T140825,T140869: Restarting Cassandra, restbase1007-a.eqiad.wmnet |
[production] |
| 17:07 |
<elukey> |
restarting keyholder-proxy on tin to let the new analytics key to be picked up |
[production] |
| 17:03 |
<legoktm> |
jstart -N qamorebots /usr/lib/adminbot/adminlogbot.py --config ./confs/qa-logbot.py |
[releng] |
| 17:03 |
<legoktm> |
jstart -N qamorebots /usr/lib/adminbot/adminlogbot.py --config ./confs/qa-logbot.py |
[releng] |
| 16:53 |
<thcipriani> |
restart integration-puppetmaster puppetmaster service. Evidently OOM'd. |
[releng] |
| 15:08 |
<thcipriani@tin> |
Synchronized portals: SWAT: [[gerrit:302921|Bumping portals to master.]] (duration: 00m 37s) |
[production] |
| 15:07 |
<thcipriani@tin> |
Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:302921|Bumping portals to master.]] (duration: 00m 36s) |
[production] |
| 14:11 |
<godog> |
manually config s1 dbs to scrape on prometheus2001 as a test |
[production] |
| 14:03 |
<paladox> |
cherry picking https://gerrit.wikimedia.org/r/#/c/302918/ to test |
[tools.lolrrit-wm] |
| 13:51 |
<akosiaris> |
delete+accept ganeti1004 salt minion key |
[production] |
| 13:43 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1012.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 13:43 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1011.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 13:43 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1010.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 13:43 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1009.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 13:43 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1008.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 13:35 |
<paladox> |
i ran npm install and npm update |
[tools.lolrrit-wm] |
| 10:59 |
<jynus> |
applying prometheus grants to pc* hosts |
[production] |
| 10:33 |
<elukey> |
upgrading httpd on mw126[56] to 2.4.10-10+deb8u4+wmf3 (T73487) |
[production] |
| 07:31 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1012.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:31 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1011.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:31 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1010.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:31 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1009.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:31 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1008.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:30 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1009.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 07:30 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp1008.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 06:05 |
<Amir1> |
restarting uwsgi-ores and celery-ores-worker in deployment-sca03 |
[releng] |
| 06:04 |
<Amir1> |
restarting redis-instance-tcp_6379, redis-instance-tcp_6380, and redis-server services in deployment-ores-redis |
[releng] |
| 06:03 |
<Amir1> |
ran puppet agent in deployment-ores-redis |
[releng] |
| 06:01 |
<Amir1> |
ran puppet agent in deployment-sca03 |
[releng] |
| 05:54 |
<Amir1> |
deploying 616707c to ores |
[releng] |
| 02:43 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 4 02:43:16 UTC 2016 (duration 6m 23s) |
[production] |
| 02:36 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.13) (duration: 05m 52s) |
[production] |
| 02:24 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.12) (duration: 08m 39s) |
[production] |
| 00:19 |
<awight> |
revert paymentswiki config to 70b2ff90d9c8f19716f2e9c07a8dc8cfa17991ca |
[production] |
| 00:19 |
<yuvipanda> |
added Krenair as admin to help with T132225 and other issues. |
[tools] |
| 00:18 |
<yuvipanda> |
added Krenair as admin to help with T132225 and other issues |
[bastion] |
| 00:17 |
<mutante> |
gerrit is restarting for config change 301822 (set default project owners). gerrit apache is restarting for 301829 (redirect /r) 301895 (logs for 10 days) and 301824 (renaming logs) |
[production] |
| 00:16 |
<awight> |
update payments-wiki config to 793389ac8fa34cfc6a4ba1df67f2f9fac1ca02fe |
[production] |