|
2017-08-03
§
|
| 09:57 |
<_joe_> |
systemctl reset-failed puppetmaster.service on labpuppetmaster1002 |
[production] |
| 09:52 |
<moritzm> |
installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) |
[production] |
| 09:32 |
<gehel> |
banning elastic103[01] - T168816 |
[production] |
| 08:56 |
<ema> |
upgrading cache_upload to varnish 4.1.8-1wm1 |
[production] |
| 08:36 |
<gehel> |
banning elastic102[89] - T168816 |
[production] |
| 08:35 |
<marostegui> |
Stop MySQL on db2045 to copy its data to db2075 - T170662 |
[production] |
| 08:34 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 08:33 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 07:58 |
<marostegui> |
Add db2073 and db2074 to tendril - T170662 |
[production] |
| 06:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:01 |
<marostegui> |
Compress s7 on db1102 - T172169 |
[production] |
| 05:57 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) |
[production] |
| 05:27 |
<marostegui> |
Deploy alter table on enwiki - labsdb1010 - T166204 |
[production] |
| 05:17 |
<marostegui> |
Stop replication on labsdb1011 for maintenance - T153743 |
[production] |
| 03:09 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 3 03:09:22 UTC 2017 (duration 7m 18s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 47s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 53s) |
[production] |
| 01:40 |
<twentyafterfour> |
repositories synced for phabricator migration. |
[production] |
| 00:28 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Simply ores (duration: 00m 47s) |
[production] |
| 00:26 |
<twentyafterfour> |
scheduled downtime for phabricator migration |
[production] |
| 00:12 |
<mutante> |
phab1001 starting ferm service |
[production] |
| 00:11 |
<mutante> |
iridium restarted ferm - rsync fragment was in config but not applied, breaking data rsync to phab1001 |
[production] |
| 00:05 |
<mutante> |
rsyncing /srv/repos from iridium to phab1001 (T163938) |
[production] |
|
2017-08-02
§
|
| 23:53 |
<ebernhardson@tin> |
Finished scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages (duration: 36m 21s) |
[production] |
| 23:17 |
<ebernhardson@tin> |
Started scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages |
[production] |
| 21:48 |
<ejegg> |
updated SmashPig from f4ca53ca303a7c9cbc4f0fd15d62116f0689b81d to c501f53aa0394a8f99f4b9fd87b3c8b8294511e0 |
[production] |
| 20:24 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) (duration: 05m 38s) |
[production] |
| 20:19 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) |
[production] |
| 19:50 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.11 refs T168053 - rollback due to T172320 |
[production] |
| 19:24 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.12 refs refs T168053 |
[production] |
| 19:23 |
<twentyafterfour> |
group1 wikis to 1.30.0-wmf.12 refs T168053 |
[production] |
| 18:41 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.12/includes/specials/SpecialRecentchanges.php: SWAT: [[gerrit:369574|Follow-up 31be7d0: send tags list if experimental mode is disabled]] (duration: 00m 47s) |
[production] |
| 18:21 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: beta-only change [[gerrit:369701|Enable HTML5 sections in betalabs]] (duration: 00m 46s) |
[production] |
| 18:20 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(24|25|26|27).eqiad.wmnet |
[production] |
| 18:18 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.12/includes/specials/SpecialUndelete.php: SWAT: [[gerrit:369696|Fix Special:Undelete search - use variable and not request param]] (duration: 00m 46s) |
[production] |
| 18:18 |
<gehel> |
un-banning and repooling elastic102[4567] - T168816 |
[production] |
| 18:13 |
<thcipriani@tin> |
Synchronized wmf-config/jobqueue.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part II (duration: 00m 47s) |
[production] |
| 18:11 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part I (duration: 00m 47s) |
[production] |
| 17:56 |
<ottomata> |
restart kafka1012 broker with listeners=PLAINTEXT://:9092 to verify https://gerrit.wikimedia.org/r/#/c/356232/ before merge. This should be a functional no-op |
[production] |
| 17:44 |
<mobrovac@tin> |
Finished deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963, take #2 (duration: 00m 16s) |
[production] |
| 17:44 |
<mobrovac@tin> |
Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963, take #2 |
[production] |
| 17:44 |
<mobrovac@tin> |
Finished deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 (duration: 00m 29s) |
[production] |
| 17:43 |
<mobrovac@tin> |
Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 |
[production] |
| 17:26 |
<mobrovac@tin> |
Finished deploy [recommendation-api/deploy@8dfae34]: (no justification provided) (duration: 01m 36s) |
[production] |
| 17:25 |
<mobrovac@tin> |
Started deploy [recommendation-api/deploy@8dfae34]: (no justification provided) |
[production] |
| 17:18 |
<herron> |
installed libmail-spf-perl and restarted spamassassin service on mx[1,2]001 - T172299 |
[production] |
| 16:45 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(24|25|26|27).eqiad.wmnet |
[production] |
| 16:43 |
<gehel> |
depooling and shutting down elastic102[4567] - T168816 |
[production] |
| 15:34 |
<mobrovac@tin> |
Finished deploy [cxserver/deploy@cf3e280]: (no justification provided) (duration: 00m 22s) |
[production] |