6751-6800 of 10000 results (61ms)
2017-08-03 §
10:01 <moritzm> installing poppler security updates on trusty [production]
09:57 <_joe_> systemctl reset-failed puppetmaster.service on labpuppetmaster1002 [production]
09:52 <moritzm> installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) [production]
09:32 <gehel> banning elastic103[01] - T168816 [production]
08:56 <ema> upgrading cache_upload to varnish 4.1.8-1wm1 [production]
08:36 <gehel> banning elastic102[89] - T168816 [production]
08:35 <marostegui> Stop MySQL on db2045 to copy its data to db2075 - T170662 [production]
08:34 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) [production]
08:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) [production]
07:58 <marostegui> Add db2073 and db2074 to tendril - T170662 [production]
06:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) [production]
06:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) [production]
06:01 <marostegui> Compress s7 on db1102 - T172169 [production]
05:57 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) [production]
05:27 <marostegui> Deploy alter table on enwiki - labsdb1010 - T166204 [production]
05:17 <marostegui> Stop replication on labsdb1011 for maintenance - T153743 [production]
03:09 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Aug 3 03:09:22 UTC 2017 (duration 7m 18s) [production]
03:02 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 47s) [production]
02:33 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 53s) [production]
01:40 <twentyafterfour> repositories synced for phabricator migration. [production]
00:28 <reedy@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Simply ores (duration: 00m 47s) [production]
00:26 <twentyafterfour> scheduled downtime for phabricator migration [production]
00:12 <mutante> phab1001 starting ferm service [production]
00:11 <mutante> iridium restarted ferm - rsync fragment was in config but not applied, breaking data rsync to phab1001 [production]
00:05 <mutante> rsyncing /srv/repos from iridium to phab1001 (T163938) [production]
2017-08-02 §
23:53 <ebernhardson@tin> Finished scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages (duration: 36m 21s) [production]
23:17 <ebernhardson@tin> Started scap: dblists/rtl.dblist T172305: Adding RTL database list for project with default RTL languages [production]
21:48 <ejegg> updated SmashPig from f4ca53ca303a7c9cbc4f0fd15d62116f0689b81d to c501f53aa0394a8f99f4b9fd87b3c8b8294511e0 [production]
20:24 <bsitzmann@tin> Finished deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) (duration: 05m 38s) [production]
20:19 <bsitzmann@tin> Started deploy [mobileapps/deploy@3b61ced]: Update mobileapps to 2d8e8f6 (T170325) [production]
19:50 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.11 refs T168053 - rollback due to T172320 [production]
19:24 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.12 refs refs T168053 [production]
19:23 <twentyafterfour> group1 wikis to 1.30.0-wmf.12 refs T168053 [production]
18:41 <thcipriani@tin> Synchronized php-1.30.0-wmf.12/includes/specials/SpecialRecentchanges.php: SWAT: [[gerrit:369574|Follow-up 31be7d0: send tags list if experimental mode is disabled]] (duration: 00m 47s) [production]
18:21 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: beta-only change [[gerrit:369701|Enable HTML5 sections in betalabs]] (duration: 00m 46s) [production]
18:20 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(24|25|26|27).eqiad.wmnet [production]
18:18 <thcipriani@tin> Synchronized php-1.30.0-wmf.12/includes/specials/SpecialUndelete.php: SWAT: [[gerrit:369696|Fix Special:Undelete search - use variable and not request param]] (duration: 00m 46s) [production]
18:18 <gehel> un-banning and repooling elastic102[4567] - T168816 [production]
18:13 <thcipriani@tin> Synchronized wmf-config/jobqueue.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part II (duration: 00m 47s) [production]
18:11 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:368258|JobQueueEventBus: Enable job events in group0 wikis]] T163380 Part I (duration: 00m 47s) [production]
17:56 <ottomata> restart kafka1012 broker with listeners=PLAINTEXT://:9092 to verify https://gerrit.wikimedia.org/r/#/c/356232/ before merge. This should be a functional no-op [production]
17:44 <mobrovac@tin> Finished deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963, take #2 (duration: 00m 16s) [production]
17:44 <mobrovac@tin> Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963, take #2 [production]
17:44 <mobrovac@tin> Finished deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 (duration: 00m 29s) [production]
17:43 <mobrovac@tin> Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 [production]
17:26 <mobrovac@tin> Finished deploy [recommendation-api/deploy@8dfae34]: (no justification provided) (duration: 01m 36s) [production]
17:25 <mobrovac@tin> Started deploy [recommendation-api/deploy@8dfae34]: (no justification provided) [production]
17:18 <herron> installed libmail-spf-perl and restarted spamassassin service on mx[1,2]001 - T172299 [production]
16:45 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(24|25|26|27).eqiad.wmnet [production]
16:43 <gehel> depooling and shutting down elastic102[4567] - T168816 [production]