|
2018-07-22
§
|
| 16:15 |
<elukey> |
rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix) |
[production] |
| 14:28 |
<zhuyifei1999_> |
backed up Neha16's changes to toolsbeta-bastion-01:/usr/lib/python2.7/dist-packages/toollabs to toollabs.bak in the same dir via cp -a, and re-install webservice code on the bastion to debug T156626 |
[toolsbeta] |
| 13:12 |
<Lokal_Profil> |
Deploy latest from Git master: 6dba253, f3552bc (T176528), 0eb8a6f (T176528), 9cad025, ac7ab36 (T176528, T176722) |
[tools.heritage] |
| 12:08 |
<addshore> |
addshore@deploy1001:/home/legoktm$ mwscript /home/legoktm/resetAuthenticationThrottle.php --wiki=metawiki --signup --ip 197.101.76.159 |
[production] |
| 12:08 |
<addshore> |
addshore@deploy1001:/home/legoktm$ mwscript /home/legoktm/resetAuthenticationThrottle.php --wiki=metawiki --signup --ip 197.101.76.150 |
[production] |
| 12:08 |
<addshore> |
addshore@deploy1001:/home/legoktm$ mwscript /home/legoktm/resetAuthenticationThrottle.php --wiki=metawiki --signup --ip 197.101.68.116 |
[production] |
| 12:08 |
<addshore> |
addshore@deploy1001:/home/legoktm$ mwscript /home/legoktm/resetAuthenticationThrottle.php --wiki=metawiki --signup --ip 196.208.95.30 |
[production] |
| 12:03 |
<addshore@deploy1001> |
Synchronized wmf-config/throttle.php: T198288 More Wikimania throttle rules (duration: 01m 18s) |
[production] |
|
2018-07-20
§
|
| 22:26 |
<Lokal_Profil> |
rebuilt statistics using maintenance/_buildStats.php |
[tools.heritage] |
| 21:50 |
<bawolff> |
deployed patch T200104 |
[production] |
| 21:44 |
<Lokal_Profil> |
dropped and recreated the `statistics` and the `monuments_nl-wd_(nl)` tables |
[tools.heritage] |
| 17:16 |
<XioNoX> |
enable bgp on eqdfw-knams link (GTT) |
[production] |
| 17:16 |
<Lokal_Profil> |
Manually resolving conflicts and creating a local commit. Resolving the difference to master is tracked at https://phabricator.wikimedia.org/T200101 |
[tools.heritage] |
| 17:08 |
<XioNoX> |
enable ospf on eqdfw-knams link (GTT) |
[production] |
| 16:52 |
<Lokal_Profil> |
Deploy latest from Git master: 4031f51 (T176733), 3b0661e (T180692), 8a60fd9, 1b69a75, ccb8fb6, c54c56b, 823ce1b, c3b7734 (T175907), 9a14fef, 962fe45, b5f3bc5, 6662976, 1b5bda8, 121cbbd, cf30736, 059ff06, 3718a5e, e61bb05, ce2b43a, b73d519, a0e9888, 6567c2a, 929a49f, 12680dd, dec0d98 |
[tools.heritage] |
| 15:33 |
<elukey> |
rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix) |
[production] |
| 15:19 |
<elukey> |
powercycle ms-be1016 - RAID errors, no ssh available, I/O errors in com2 console |
[production] |
| 14:15 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki back to .12 T199983 |
[production] |
| 14:11 |
<Reedy> |
T199983 wikidata wiki abck to .12 on mwdebug1001 |
[production] |
| 13:33 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1085, db1113:3316 (duration: 00m 55s) |
[production] |
| 13:13 |
<marostegui> |
Stop replication in sync db1085 and db1113:3316 |
[production] |
| 13:13 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1098:3316, depool db1113:3316 (duration: 00m 54s) |
[production] |
| 13:06 |
<legoktm@deploy1001> |
Synchronized wmf-config/throttle.php: Update Wikimania IP address - T198288 (duration: 00m 54s) |
[production] |
| 12:53 |
<marostegui> |
Stop replication in sync db1085 and db1096:3318 |
[production] |
| 12:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316, depool db1098:3316 (duration: 00m 54s) |
[production] |
| 12:32 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1085 and db1096:3316 (duration: 00m 56s) |
[production] |
| 12:32 |
<marostegui> |
Stop replication in sync db1085 and db1096:3316 |
[production] |
| 12:31 |
<marostegui@deploy1001> |
sync-file aborted: Depool db1085 and db1096:33156 (duration: 00m 01s) |
[production] |
| 12:00 |
<mobrovac@deploy1001> |
Finished deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 (duration: 02m 11s) |
[production] |
| 11:58 |
<mobrovac@deploy1001> |
Started deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 |
[production] |
| 10:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3312, db1105:3312 (duration: 00m 53s) |
[production] |
| 10:30 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1105:3312 - T200061 |
[production] |
| 10:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1103:3312, depool db1105:3312 (duration: 00m 54s) |
[production] |
| 10:17 |
<marostegui> |
Stop replication in sync on db1090:3312 and db2035 - T200061 |
[production] |
| 10:14 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1103:3312 - T200061 |
[production] |
| 10:08 |
<sebastian-wmse> |
Deploy latest (v0.1.0) from Git master: 2a79cdd, 7522a46, c168aa7 (T194620), c201912; update MediaWiki to b8dee03 |
[wikispeech] |
| 10:06 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 and db1103:3312 (duration: 00m 55s) |
[production] |
| 09:46 |
<marostegui> |
Stop replication on db2063 to fix db2095 - T200061 |
[production] |
| 08:50 |
<marostegui> |
Stop replication on s7 codfw master to check arwiki.change_tag - T200061 |
[production] |
| 08:47 |
<Amir1> |
stopping populateChangeTagDef.php (T200061) |
[production] |
| 08:41 |
<foks> |
reset email for User:Nomden |
[production] |
| 08:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 55s) |
[production] |
| 07:46 |
<marostegui> |
Stop replicaiton on s8 codfw master - T200061 |
[production] |
| 07:43 |
<jynus> |
stopping db1095 mariadb and cloning it to db1102 |
[production] |
| 07:20 |
<legoktm> |
cleaned up giant log files on extdist-02 |
[extdist] |
| 07:14 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1099, es1019 fully (duration: 00m 54s) |
[production] |
| 07:11 |
<marostegui> |
Stop replication in sync on db1074 and db1125:3312 |
[production] |
| 06:13 |
<marostegui> |
Deploy schema change on db1074 with replication, this will generate lag on labsdb:s2 T144010 T51190 T199368 |
[production] |