6251-6300 of 10000 results (60ms)
2018-06-07 ยง
15:59 <hoo> Finished running "foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https" T196360 T183706 T195014 T196357 [production]
15:38 <urandom> upgrade Cassandra to 3.11.2, restbase1010-{a,b,c} - T178905 [production]
15:29 <hoo> Running "foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https" T196360 T183706 T195014 T196357 [production]
15:23 <hoo> Emptied out the sites and site_identifiers tables on pswikivoyage, pmswikisource, bnwikivoyage and sahwikiquote for T122520, [production]
15:20 <hoo@deploy1001> Synchronized dblists/wikidataclient.dblist: Enable WikidataClient on sahwikiquote and pswikivoyage - T183706, T196360 (duration: 00m 57s) [production]
15:08 <marostegui> Sanitize wikis on db1124 (current sanitarium for s3) - T196362 T196358 T196359 T195008 T193187 [production]
15:04 <reedy@deploy1001> Synchronized wmf-config/interwiki.php: (no justification provided) (duration: 00m 56s) [production]
14:55 <ottomata> beginning rolling restarts of all cluster kafka brokers to apply log.message.timestamp.type=CreateTime - T196407 [production]
14:53 <reedy@deploy1001> rebuilt and synchronized wikiversions files: new wikis [production]
14:53 <marostegui> Sanitize wikis on db1095 (old sanitarium) - T196362 T196358 T196359 T195008 T193187 [production]
14:53 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: new wikis (duration: 00m 57s) [production]
14:50 <reedy@deploy1001> Synchronized static/images/: new wikis (duration: 00m 57s) [production]
14:48 <reedy@deploy1001> Synchronized multiversion/MWMultiVersion.php: idwikimedia (duration: 00m 57s) [production]
14:47 <reedy@deploy1001> Synchronized dblists/: 5 new wikis (duration: 00m 55s) [production]
14:45 <Reedy> created new wiki databases T183706 T192726 T194879 T196357 T196360 [production]
14:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 (duration: 00m 57s) [production]
14:11 <reedy@deploy1001> Synchronized wmf-config/jobqueue-labs.php: labs (duration: 00m 56s) [production]
14:10 <reedy@deploy1001> Synchronized wmf-config/LabsServices.php: labs (duration: 00m 57s) [production]
14:02 <reedy@deploy1001> Synchronized docroot/noc/: Add some more symlinked configs (duration: 00m 57s) [production]
13:34 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1066 (duration: 00m 57s) [production]
13:31 <reedy@deploy1001> Synchronized php-1.32.0-wmf.7/extensions/WikimediaMaintenance/addWiki.php: add all the wikis (duration: 00m 56s) [production]
13:29 <reedy@deploy1001> Synchronized php-1.32.0-wmf.6/extensions/WikimediaMaintenance/addWiki.php: add all the wikis (duration: 00m 58s) [production]
13:26 <reedy@deploy1001> Synchronized dblists/all-labs.dblist: labs (duration: 00m 54s) [production]
13:24 <reedy@deploy1001> Synchronized wikiversions-labs.json: labs (duration: 00m 57s) [production]
13:22 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1066 (duration: 00m 56s) [production]
13:17 <zeljkof> EU SWAT finished [production]
13:16 <zfilipin@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:437965|When using the FileExporter set it as BeatFeature by default (T195370)]] (duration: 00m 56s) [production]
13:10 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:437952|Add FileExporter to BetaFeaturesWhiteList (T195370)]] (duration: 00m 57s) [production]
12:59 <marostegui> Deploy schema change on db1088 - T191316 T192926 T195193 T89737 [production]
12:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 57s) [production]
12:54 <jynus> stop, clone and reimage db1091 [production]
12:52 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 57s) [production]
12:46 <mutante> planet1001/puppetmaster: revoke old cert, sign new cert request, initial puppet run, reinstalled, will turn service active-active again once done (T168490) [production]
12:26 <mutante> planet1001 - schedule downtime, boot to PXE, reinstall with stretch (ganeti) (T168490) [production]
12:15 <moritzm> repooled mw1280 after hardware maintenance (T195734) [production]
11:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085 after alter table (duration: 00m 57s) [production]
10:29 <moritzm> installing openssl security updates [production]
08:50 <marostegui> Deploy schema change on db1085 with replication, this will generate lag on labsdb for s6 section - T191316 T192926 T195193 T89737 [production]
08:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1085 for alter table (duration: 00m 56s) [production]
08:49 <akosiaris> slow reboot of all ganeti eqiad VMs (except bohrium, puppetdb1001, poolcounter1001, mx1001) for kernel upgrades and picking up spec-ctrl cpu flag [production]
08:38 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 00m 55s) [production]
08:34 <marostegui> Stop replication on db1102:3316 and db1125:3316 to update triggers for archive table - T192926 [production]
08:15 <jynus> running ANALYZE on db2091 T196526 [production]
07:46 <marostegui> Deploy schema change on db1093 - T191316 T192926 T195193 T89737 [production]
07:46 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 56s) [production]
07:40 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1098:3316 after alter table (duration: 00m 57s) [production]
07:09 <moritzm> installing git security updates on trusty (Debian already fixed) [production]
06:55 <jynus> relaxing write consistency on db2048 due to ongoing maintenance (sync_binlog,flush_log) [production]
06:26 <marostegui> Deploy sanitarium events on db1125 - T190704 [production]
06:24 <jynus> phabricator maintenance finished [production]