|
2019-07-12
§
|
| 12:06 |
<fsero> |
recreating citoid staging namespace T227775 |
[production] |
| 12:05 |
<fsero@> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'staging' . |
[production] |
| 12:01 |
<fsero> |
recreating termbox staging namespace T227775 |
[production] |
| 11:41 |
<wm-bot> |
<maurelio> Deployed 1118c54 symfony/process back to 1118c54 symfony/process back to ^3.0 and rebuilt composer |
[tools.stewardbots] |
| 11:23 |
<wm-bot> |
<maurelio> Deploy 17e7694 - Updated composer dependencies and fix PHPCS issues |
[tools.stewardbots] |
| 11:18 |
<wm-bot> |
<maurelio> Head is now at 5099d2e Update queries for actor and comment migration. |
[tools.stewardbots] |
| 11:17 |
<wm-bot> |
<maurelio> git reset --hard origin/master |
[tools.stewardbots] |
| 11:17 |
<wm-bot> |
<maurelio> git reset --hard origin/master |
[tools.stewardbots] |
| 11:13 |
<wm-bot> |
<maurelio> Cherry-picked f23dd89 for testing. |
[tools.stewardbots] |
| 11:09 |
<jynus@deploy1001> |
Synchronized wmf-config/db-codfw.php: Switchover db2045 x1 codfw master to db2069 (duration: 00m 51s) |
[production] |
| 10:24 |
<jynus> |
switchover x1 codfw master from db2045 to db2069 T227862 |
[production] |
| 10:23 |
<jynus> |
switchover x1 codfw master from db2045 to db2069 |
[production] |
| 09:43 |
<moritzm> |
shut down ldap-codfw-replica01/ldap-codfw-replica02 (pending reimage) |
[production] |
| 08:18 |
<jijiki> |
enable puppet on mw1222 |
[production] |
| 06:52 |
<samwilson> |
Restarted Discourse app. |
[discourse] |
| 06:35 |
<vgutierrez> |
upgrading acme-chief to version 0.19 in acme-chief test instances - T225945 |
[production] |
| 06:28 |
<vgutierrez> |
uploaded acme-chief 0.19 to apt.wikimedia.org (buster) - T225945 |
[production] |
| 05:45 |
<elukey> |
sudo -i /usr/local/sbin/restart-php7.2-fpm on mwdebug* to clear opcache |
[production] |
| 01:01 |
<Krinkle> |
mw1342 generated some ~ 11,500 additional PHP errors over a 4 hour period (18:00-22:30 UTC), ref T224491 |
[production] |
| 00:59 |
<Krinkle> |
mw1342 is generating strange PHP erros (php7 only), ref T224491 |
[production] |
| 00:58 |
<urandom> |
bootstrapping restbase1017-a -- T222960 |
[production] |
| 00:50 |
<mutante> |
restbase1018 - restart ferm service |
[production] |
| 00:32 |
<James_F> |
Zuul: Migrate from php70-phan-seccheck to php72-phan-seccheck T226420 |
[releng] |
| 00:15 |
<krinkle@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: e4bd91f71b (duration: 00m 50s) |
[production] |
| 00:13 |
<krinkle@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: f309856f0912 (duration: 00m 50s) |
[production] |
| 00:03 |
<eevans@deploy1001> |
Finished deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) (duration: 00m 03s) |
[production] |
| 00:03 |
<eevans@deploy1001> |
Started deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) |
[production] |
| 00:01 |
<eevans@deploy1001> |
Finished deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) (duration: 00m 25s) |
[production] |
| 00:01 |
<eevans@deploy1001> |
Started deploy [cassandra/metrics-collector@df909a1]: deploy logback to restbase1017 (T222960) |
[production] |
|
2019-07-11
§
|
| 23:58 |
<thcipriani@deploy1001> |
Synchronized php-1.34.0-wmf.13/includes/watcheditem/WatchedItemStore.php: SWAT: [[gerrit:522155|WatchedItemStore: Fix fatal when revision is deleted]] T226741 (duration: 00m 51s) |
[production] |
| 23:49 |
<eevans@deploy1001> |
Finished deploy [cassandra/logstash-logback-encoder@d085ffa]: deploy logback to restbase1017 (T222960) (duration: 00m 47s) |
[production] |
| 23:48 |
<eevans@deploy1001> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa]: deploy logback to restbase1017 (T222960) |
[production] |
| 23:47 |
<eevans@deploy1001> |
Finished deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) (duration: 01m 56s) |
[production] |
| 23:45 |
<eevans@deploy1001> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) |
[production] |
| 23:38 |
<eevans@deploy1001> |
deploy aborted: (no justification provided) (duration: 02m 00s) |
[production] |
| 23:36 |
<eevans@deploy1001> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa]: (no justification provided) |
[production] |
| 23:33 |
<James_F> |
Pushing docker mediawiki-phan-seccheck:0.4.0 |
[releng] |
| 23:15 |
<thcipriani@deploy1001> |
Synchronized wmf-config: SWAT: [[gerrit:521338|Oversample all EditAttemptStep events on VE-as-mobile-default wikis]] T227317 (duration: 00m 50s) |
[production] |
| 22:59 |
<mutante> |
netmon1003 - removing servermon - servermon.wikimedia.org is being decom'ed (T198939) |
[production] |
| 22:37 |
<RoanKattouw> |
Deployed fix for T224240, accidentally rode along with Tyler's no-op scap |
[production] |
| 22:34 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki back to 1.34.0-wmf.13 |
[production] |
| 22:26 |
<thcipriani@deploy1001> |
Finished scap: no op scap sync to rebuild l10n-cache (T227814) (duration: 19m 34s) |
[production] |
| 22:07 |
<bd808> |
Ran `sudo systemctl stop designate_floating_ip_ptr_records_updater.service` on cloudcontrol1003 |
[admin] |
| 22:07 |
<thcipriani@deploy1001> |
Started scap: no op scap sync to rebuild l10n-cache (T227814) |
[production] |
| 22:01 |
<bd808> |
`sudo apt-get install python2.7-dbg` on cloudcontrol1003 to debug hung python process |
[admin] |
| 21:48 |
<bd808> |
Ran `sudo systemctl stop designate_floating_ip_ptr_records_updater.service` on cloudcontrol1004 |
[admin] |
| 21:34 |
<James_F> |
Pushing new php-based docker images with php-bcmath extension for T227043 |
[releng] |
| 21:28 |
<ottomata> |
rerunning eventlogging_to_druid_readingdepth_hourly |
[analytics] |
| 21:26 |
<ottomata> |
rerunning eventlogging_to_druid_navigationtiming_hourly |
[analytics] |
| 21:23 |
<otto@deploy1001> |
Finished deploy [analytics/refinery@3296aab]: (no justification provided) (duration: 02m 02s) |
[production] |