|
2019-03-07
§
|
| 23:53 |
<XioNoX> |
set net.ipv4.ip_local_port_range="32768 60999" on dns2001 and repool server - T209989 |
[production] |
| 23:46 |
<XioNoX> |
set net.ipv4.ip_local_port_range="49152 65535" on dns2001 - T209989 |
[production] |
| 23:43 |
<ayounsi@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=dns2001.wikimedia.org,service=pdns_recursor |
[production] |
| 23:40 |
<XioNoX> |
depool dns2001 - T209989 |
[production] |
| 20:44 |
<XioNoX> |
explicitely disable sampling on non eqiad routers |
[production] |
| 20:42 |
<thcipriani> |
restarting gerrit on cobalt for 2.15.11 rollback |
[production] |
| 20:42 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) (duration: 00m 07s) |
[production] |
| 20:41 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) |
[production] |
| 20:40 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only (duration: 00m 10s) |
[production] |
| 20:40 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only |
[production] |
| 20:10 |
<thcipriani> |
restarting gerrit on cobalt for 2.15.11 upgrade |
[production] |
| 20:10 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) (duration: 00m 11s) |
[production] |
| 20:09 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) |
[production] |
| 20:07 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only (duration: 00m 12s) |
[production] |
| 20:07 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only |
[production] |
| 19:33 |
<gilles@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T216499 Enable Priority Hints origin trial on ruwiki (duration: 00m 48s) |
[production] |
| 19:22 |
<niharika29@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Grant 'reupload-shared' to mediawiki uploaders and fix T217523 (duration: 00m 49s) |
[production] |
| 19:12 |
<niharika29@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable Partial Blocks on Arabic Wikipedia T217283 (duration: 00m 50s) |
[production] |
| 19:04 |
<arlolra> |
Updated Parsoid to d4e76d5 (T202905) |
[production] |
| 18:56 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 (duration: 05m 01s) |
[production] |
| 18:51 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 |
[production] |
| 18:39 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=codfw,cluster=maps,name=maps2004.codfw.wmnet |
[production] |
| 18:32 |
<mbsantos@deploy1001> |
Finished deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 01m 25s) |
[production] |
| 18:30 |
<mbsantos@deploy1001> |
Started deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet |
[production] |
| 18:30 |
<mbsantos@deploy1001> |
Finished deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 03m 46s) |
[production] |
| 18:26 |
<mbsantos@deploy1001> |
Started deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet |
[production] |
| 18:25 |
<gehel> |
cleaning kernel-proposed-updates component on reprepro (install1002) |
[production] |
| 18:15 |
<XioNoX> |
disable asw2-c-eqiad <-> asw-c-eqiad link - T208734 |
[production] |
| 17:55 |
<gehel> |
rolling upgrade of kibana on logstash clusters completed - T216052 |
[production] |
| 17:48 |
<gehel> |
rolling upgrade of kibana on logstash clusters - T216052 |
[production] |
| 17:43 |
<gehel> |
rolling upgrade of logstash on logstash clusters completed - T216052 |
[production] |
| 17:36 |
<gehel> |
rolling upgrade of logstash on logstash clusters - T216052 |
[production] |
| 17:34 |
<gehel@deploy1001> |
Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 07s) |
[production] |
| 17:34 |
<gehel@deploy1001> |
Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 |
[production] |
| 17:34 |
<gehel@deploy1001> |
Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 08s) |
[production] |
| 17:33 |
<gehel@deploy1001> |
Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 |
[production] |
| 17:16 |
<gehel> |
rolling upgrade of elasticsearch on logstash clusters completed - T216052 |
[production] |
| 17:09 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@3e25558]: fix broken page-content job retries (duration: 00m 04s) |
[production] |
| 17:09 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@3e25558]: fix broken page-content job retries |
[production] |
| 16:54 |
<cmjohnson1> |
powering off cp1099 to move to different rack T202966 |
[production] |
| 15:26 |
<gehel> |
rolling upgrade of elasticsearch on logstash clusters - T216052 |
[production] |
| 14:54 |
<hashar> |
1.33.0-wmf.20 seems all good |
[production] |
| 14:46 |
<marostegui> |
Reload haproxy on dbproxy1011 to repool labsdb1009 |
[production] |
| 14:15 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.20 |
[production] |
| 13:47 |
<mutante> |
phab1002 - removing all php-7.2 packages and letting puppet reinstall them after component change |
[production] |
| 13:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1075 after schema change and mysql upgrade (duration: 00m 55s) |
[production] |
| 13:41 |
<marostegui> |
Stop mysql on labsdb1009 for upgrade (this will trigger an haproxy IRC alert) |
[production] |
| 13:39 |
<marostegui> |
Reload haproxy on dbproxy1010 to depool labsdb1009 |
[production] |
| 13:27 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1075 after schema change and mysql upgrade (duration: 00m 52s) |
[production] |