3301-3350 of 10000 results (61ms)
2018-12-04 ยง
11:34 <akosiaris> enable puppet on scb1003, run puppet T197242 [production]
11:33 <mobrovac@deploy1001> Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb1002 - T197242 (duration: 00m 28s) [production]
11:33 <mobrovac@deploy1001> Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb1002 - T197242 [production]
11:31 <akosiaris> enable puppet on scb1002, run puppet T197242 [production]
11:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 T86338 T202167 (duration: 00m 46s) [production]
11:18 <mobrovac@deploy1001> Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb1001 - T197242 (duration: 00m 30s) [production]
11:18 <mobrovac@deploy1001> Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb1001 - T197242 [production]
11:17 <akosiaris> enable puppet on scb1001, run puppet T197242 [production]
11:12 <elukey@deploy1001> Finished deploy [analytics/aqs/deploy@e9a63cc]: Expose offset and underestimate numbers on unique devices - T164201 (duration: 09m 06s) [production]
11:03 <mobrovac@deploy1001> Finished deploy [restbase/deploy@8abcbda]: Disable Citoid test for switching it to Zotero v2 - T211088 T197242 (duration: 20m 59s) [production]
11:03 <elukey@deploy1001> Started deploy [analytics/aqs/deploy@e9a63cc]: Expose offset and underestimate numbers on unique devices - T164201 [production]
10:59 <fdans@deploy1001> Finished deploy [analytics/aqs/deploy@e9a63cc]: Deploying offset and underestimate numbers for uniques (duration: 00m 37s) [production]
10:58 <fdans@deploy1001> Started deploy [analytics/aqs/deploy@e9a63cc]: Deploying offset and underestimate numbers for uniques [production]
10:57 <fdans> deploying AQS to expose offset and underestimate numbers on unique devices [production]
10:51 <moritzm> rebooting analytics-tool1003 to pick up SSBD-enabled qemu [production]
10:47 <moritzm> rebooting analytics-tool1002 to pick up SSBD-enabled qemu [production]
10:43 <mobrovac@deploy1001> Started deploy [restbase/deploy@8abcbda]: Disable Citoid test for switching it to Zotero v2 - T211088 T197242 [production]
10:41 <moritzm> rebooting analytics-tool1001 to pick up SSBD-enabled qemu [production]
10:03 <mobrovac@deploy1001> Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 in codfw - T197242 (duration: 01m 45s) [production]
10:02 <godog> bootstrap cassandra-a on restbase2015 - T210843 [production]
10:01 <mobrovac@deploy1001> Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 in codfw - T197242 [production]
09:59 <gehel> upgrading nginx on elasticsearch eqiad [production]
09:54 <akosiaris> enable puppet on all scb2*, run puppet T197242 [production]
09:52 <gehel> upgrading nginx on elasticsearch codfw [production]
09:52 <mobrovac@deploy1001> Finished deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb2001 - T197242 (duration: 00m 30s) [production]
09:51 <mobrovac@deploy1001> Started deploy [citoid/deploy@b902865]: Switch Citoid to Zotero v2 on scb2001 - T197242 [production]
09:50 <akosiaris> enable puppet on scb2001, run puppet T197242 [production]
09:46 <akosiaris> disable puppet on scb for citoid migration to zoterov2 T197242 [production]
09:46 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch [production]
09:31 <gehel> add elastic2039-2044 to cirrus eqiad (new server) - T210265 [production]
09:11 <gehel> add elastic2038 to cirrus eqiad (new server) - T210265 [production]
09:00 <addshore> graphite1004 & graphite2003, /var/lib/carbon/whisper/MediaWiki/electronpdf/action # Ran https://phabricator.wikimedia.org/P7882 for T157012 [production]
08:54 <marostegui> Deploy schema change on db1097:3314 T86338 T202167 [production]
08:54 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097:3314 T86338 T202167 (duration: 00m 47s) [production]
08:46 <addshore> graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/actions$ sudo -u _graphite find . -type f -name "*-*.wsp" -delete # T120639 [production]
08:46 <addshore> graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/actions$ sudo -u _graphite find . -type f -name "*_*.wsp" -delete # T120639 [production]
08:43 <marostegui> Deploy schema change on db1102:3314 T86338 T202167 [production]
08:42 <marostegui> Deploy schema change on dbstore1002:s4 T86338 T202167 [production]
08:41 <addshore> graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/datamodel$ sudo -u _graphite rm wikipedia_references.wsp # T121521 [production]
08:35 <gehel> restarting stuck tilerator on maps* - T204047 [production]
08:35 <addshore> graphite1004 & graphite2003, /var/lib/carbon/whisper/daily/wikidata/api/wbgetclaims$ sudo -u _graphite find . -type f -name "*.wsp" -delete # T140280 [production]
08:11 <moritzm> installing perl security updates on jessie/trusty (stretch already updated) [production]
07:49 <godog> bootstrap cassandra-c on restbase2014 - T209615 [production]
07:26 <marostegui> Deploy schema change on s4 codfw master (db2051) with replication T86338 T202167 [production]
07:22 <marostegui> Deploy schema change on wikitech primary master (db1073) for labswiki and labtestwiki T86338 T202167 [production]
06:39 <marostegui> Deploy schema change on s5 primary master (db1070) T86338 T202167 [production]
06:37 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1110 T86338 T202167 (duration: 00m 49s) [production]
06:12 <marostegui> Deploy schema change on db1110 T86338 T202167 [production]
06:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1110 T86338 T202167 (duration: 00m 53s) [production]
01:22 <foks> Removing 2FA per request at https://phabricator.wikimedia.org/T210703 [production]