101-150 of 10000 results (38ms)
2017-08-03 ยง
16:00 <godog> silence cassandra-related alerts on restbase-dev cluster, known OOMs [production]
15:43 <urandom> T172384: lower tombstone failure threshold in RESTBase dev to 1000 [production]
15:39 <reedy@tin> Synchronized wmf-config/interwiki.php: Update for 3 new wikis (duration: 00m 46s) [production]
15:31 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: techconductwiki [production]
15:27 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: techconductwiki (duration: 00m 46s) [production]
15:25 <reedy@tin> Synchronized static/images/project-logos/: techconductwiki (duration: 00m 44s) [production]
15:24 <reedy@tin> Synchronized dblists/: techconductwiki (duration: 00m 47s) [production]
15:03 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic1028.eqiad.wmnet [production]
15:02 <gehel> unbanning and repooling elastic1028 - T168816 [production]
14:58 <reedy@tin> Synchronized static/images/project-logos/: hiwikiversity (duration: 00m 46s) [production]
14:57 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: hiwikiversity (duration: 00m 48s) [production]
14:55 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: hiwikiversity [production]
14:55 <reedy@tin> Synchronized dblists: hiwikiversity (duration: 00m 49s) [production]
14:53 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(29|30|31|32).eqiad.wmnet [production]
14:53 <Dereckson> mwscript initSiteStats.php --wiki srwikiquote --update (T172241) [production]
14:52 <gehel> unbanning and repooling elastic10(29|30|31|32) - T168816 [production]
14:29 <reedy@tin> Synchronized wmf-config/InitialiseSettings.php: wikimania2018wiki (duration: 00m 47s) [production]
14:28 <reedy@tin> rebuilt wikiversions.php and synchronized wikiversions files: (no justification provided) [production]
14:27 <reedy@tin> Synchronized dblists: wikimania2018wiki (duration: 00m 47s) [production]
14:21 <marostegui> Restart MySQL on db2019 to get the new socket location updated [production]
14:19 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2045 - T170662 (duration: 00m 46s) [production]
14:06 <marostegui> Compress s5 on db2075 - T170662 [production]
14:02 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(28|29|30|31|32).eqiad.wmnet [production]
14:01 <gehel> depooling and shutting down elastic10(28|29|30|31|32) - T168816 [production]
14:00 <marostegui> Add db2075 to tendril - T170662 [production]
13:44 <marostegui> Enable gtid back on codfw s4 slaves - T170351 [production]
13:35 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Promote db2051 as s4 codfw master - T170351 (duration: 00m 46s) [production]
13:28 <elukey> drop CookieBlock backup tables for T171883 [production]
13:26 <marostegui> Starting the actual s4 codfw failover db2019 -> db2051 - T170351 [production]
13:22 <gehel> banning elastic1032 - T168816 [production]
13:19 <chasemp> disabling puppet acros wmcs things for testing [production]
13:14 <marostegui> Start topology change for s4 in codfw, slaves will be moved under db2051 - T170351 [production]
13:10 <aude@tin> Synchronized php-1.30.0-wmf.12/extensions/Wikidata: Fix bug in InjectRCRecordsJob (duration: 02m 12s) [production]
13:01 <marostegui> Disable gtid on s4 codfw slaves to get ready for the topology change - T170351 [production]
12:15 <marostegui> Restart MySQL on db2051 - T170351 [production]
10:21 <elukey> removed /run/pacct_shadow.d on stat1005 to allow atopacct.service restart [production]
10:01 <moritzm> installing poppler security updates on trusty [production]
09:57 <_joe_> systemctl reset-failed puppetmaster.service on labpuppetmaster1002 [production]
09:52 <moritzm> installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) [production]
09:32 <gehel> banning elastic103[01] - T168816 [production]
08:56 <ema> upgrading cache_upload to varnish 4.1.8-1wm1 [production]
08:36 <gehel> banning elastic102[89] - T168816 [production]
08:35 <marostegui> Stop MySQL on db2045 to copy its data to db2075 - T170662 [production]
08:34 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) [production]
08:33 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) [production]
07:58 <marostegui> Add db2073 and db2074 to tendril - T170662 [production]
06:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) [production]
06:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) [production]
06:01 <marostegui> Compress s7 on db1102 - T172169 [production]
05:57 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) [production]