1101-1150 of 10000 results (52ms)
2019-01-17 §
07:00 <marostegui> Start s3 failover T213858 [production]
06:30 <marostegui> Disable puppet on db1075 and db1078 - T213858 [production]
06:26 <marostegui> Enable GTID back on all hosts but db1075 db1078 - T213858 [production]
06:19 <marostegui> Change s3 topology to get ready for s3 failover - T213858 [production]
06:14 <marostegui> Disable gtid on s3 hosts - T213858 [production]
06:10 <marostegui> Downtime s3 hosts for 2 hours - T213858 [production]
04:12 <ppchelko@deploy1001> Finished deploy [mobileapps/deploy@89c4d8d]: revert new summary (duration: 01m 55s) [production]
04:10 <ppchelko@deploy1001> Started deploy [mobileapps/deploy@89c4d8d]: revert new summary [production]
04:02 <cdanis@deploy1001> Started restart [parsoid/deploy@4b82683]: (no justification provided) [production]
2019-01-16 §
23:25 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@0ff39e2]: Deployment attempt with decreased worker count (duration: 04m 08s) [production]
23:21 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@0ff39e2]: Deployment attempt with decreased worker count [production]
23:10 <Krinkle> krinkle@tungsten:/srv/: rm -rf xhprof; for T196406 [production]
21:35 <ppchelko@deploy1001> Finished deploy [recommendation-api/deploy@c1b6b32]: Rollback update to 1a1f824 (duration: 01m 59s) [production]
21:33 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@c1b6b32]: Rollback update to 1a1f824 [production]
21:29 <ppchelko@deploy1001> deploy aborted: log (duration: 00m 02s) [production]
21:29 <ppchelko@deploy1001> Started deploy [recommendation-api/deploy@da83637]: log [production]
21:28 <bmansurov@deploy1001> Finished deploy [recommendation-api/deploy@da83637]: Update to 1a1f824 (duration: 06m 14s) [production]
21:22 <bmansurov@deploy1001> Started deploy [recommendation-api/deploy@da83637]: Update to 1a1f824 [production]
21:17 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes (duration: 06m 31s) [production]
21:10 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@6b344ca]: Update mobileapps to 258d76b page summary changes [production]
20:20 <dduvall@deploy1001> Synchronized php: group1 wikis to 1.33.0-wmf.13 (duration: 00m 51s) [production]
20:19 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.13 [production]
19:48 <gehel> switching wdqs categories traffic to new second instance, puppet will be disabled during the operation on all wdqs nodes - T213212 [production]
19:29 <thcipriani> restarting ci jenkins for upgrade [production]
19:13 <thcipriani> restarting gerrit on cobalt for 2.15.8 upgrade [production]
19:12 <thcipriani@deploy1001> Finished deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on cobalt (duration: 00m 10s) [production]
19:12 <thcipriani@deploy1001> Started deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on cobalt [production]
19:09 <thcipriani@deploy1001> Finished deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on gerrit2001 only (duration: 00m 11s) [production]
19:09 <thcipriani@deploy1001> Started deploy [gerrit/gerrit@cec7995]: Gerrit to 2.15.8 on gerrit2001 only [production]
19:04 <thcipriani> starting gerrit upgrade to 2.15.8 [production]
18:55 <mutante> upgraded jenkins version for jessie and stretch in apt.wikimedia.org to latest LTS [production]
18:16 <addshore> deploy slot done [production]
18:13 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs enabled on wikidatawiki (1% of edits) T204031 (duration: 00m 51s) [production]
18:07 <smalyshev@deploy1001> Finished deploy [wdqs/wdqs@0aa107a]: Re-deploy for fixing vars.sh (duration: 11m 49s) [production]
18:03 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ConstraintsCheckJobs enabled on testwikidatawiki T204031 (duration: 00m 52s) [production]
17:55 <smalyshev@deploy1001> Started deploy [wdqs/wdqs@0aa107a]: Re-deploy for fixing vars.sh [production]
17:53 <jynus> stop upgrade and restart db1111 [production]
17:36 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s) [production]
17:35 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [cirrus] Start using replica group settings (take 2) (T210381) (duration: 00m 51s) [production]
17:22 <vgutierrez> rolling NIC firmware upgrade cp[1077-1080] - T203194 [production]
17:18 <dcausse@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EditorJourney: Enable data collection for viwiki T213348 (duration: 00m 52s) [production]
17:07 <anomie@deploy1001> Synchronized php-1.33.0-wmf.12/includes/page/WikiPage.php: Add temporary logging for T210739 (duration: 00m 53s) [production]
17:05 <vgutierrez> upgrading NIC firmware in cp1076 - T203194 [production]
17:01 <gehel@deploy1001> Finished deploy [wdqs/wdqs@6685dc0]: multi instance fixes (duration: 00m 27s) [production]
17:01 <gehel@deploy1001> Started deploy [wdqs/wdqs@6685dc0]: multi instance fixes [production]
16:58 <gehel@deploy1001> Finished deploy [wdqs/wdqs@6685dc0]: multi instance fixes (duration: 10m 29s) [production]
16:53 <jynus> stop upgrade and restart db1112 [production]
16:47 <gehel@deploy1001> Started deploy [wdqs/wdqs@6685dc0]: multi instance fixes [production]
16:45 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1123 (duration: 00m 52s) [production]
16:45 <vgutierrez> upgrading NIC firmware on cp1075 - T203194 [production]