|
2017-11-14
§
|
| 17:56 |
<ebernhardson@tin> |
Started deploy [search/MjoLniR/deploy@607adfb]: (no justification provided) |
[production] |
| 17:44 |
<herron> |
restarted puppetdb on nitrogen and nihal to pick up jre updates |
[production] |
| 17:42 |
<smalyshev@tin> |
Finished deploy [wdqs/wdqs@b44cf27]: data reload/T176593 (duration: 00m 16s) |
[production] |
| 17:42 |
<smalyshev@tin> |
Started deploy [wdqs/wdqs@b44cf27]: data reload/T176593 |
[production] |
| 17:27 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.3 (duration: 07m 58s) |
[production] |
| 17:12 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: Beta-only, no-op (duration: 00m 43s) |
[production] |
| 17:11 |
<demon@tin> |
Synchronized wmf-config/extension-list-labs: No-op (duration: 00m 44s) |
[production] |
| 17:10 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.6 [keeping static files] (duration: 02m 48s) |
[production] |
| 16:32 |
<twentyafterfour> |
Restarting apache2 on phab1001 (deploy phabricator hotfix: D876 ) |
[production] |
| 16:23 |
<jynus> |
stop labsdb1010 mariadb to clone it later to labsdb1009 T179244 |
[production] |
| 15:04 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully pool db1105 in s1 and s2 - T178359 (duration: 00m 45s) |
[production] |
| 15:00 |
<thcipriani@tin> |
testing IRC logging |
[production] |
| 15:00 |
<urandom> |
Decommissioning Cassandra, restbase1012-c.eqiad.wmnet (T179422) |
[production] |
| 14:37 |
<moritzm> |
installing postgres security updates on maps* |
[production] |
| 14:29 |
<zeljkof> |
EU SWAT finished |
[production] |
| 14:07 |
<moritzm> |
installing postgres security updates on labsdb1004 |
[production] |
| 13:11 |
<moritzm> |
installing openssl updates |
[production] |
| 13:10 |
<akosiaris> |
shutdown install1002 for disk resize |
[production] |
| 12:57 |
<godog> |
upgrade grafana to 4.6.1 on https://grafana-labs.wikimedia.org/ - T180428 |
[production] |
| 12:03 |
<ema> |
restart varnish-be on cp3007, requests failing with 'no backend connection' |
[production] |
| 11:49 |
<moritzm> |
rebooting remaining app servers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) |
[production] |
| 11:22 |
<moritzm> |
rebooting remaining API servers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) |
[production] |
| 11:04 |
<godog> |
reimage restbase2002 - T179422 |
[production] |
| 10:50 |
<marostegui> |
Deploy alter table on s5: db1104 db1100 db1106 - T174569 |
[production] |
| 10:32 |
<elukey> |
removed old target configs from /srv/prometheus/analytics/targets on prometheus100[34] after https://gerrit.wikimedia.org/r/391179 |
[production] |
| 10:23 |
<moritzm> |
rebooting image scalers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) |
[production] |
| 10:07 |
<godog> |
upload scap 3.7.2-1 - T127762 |
[production] |
| 09:59 |
<mobrovac@tin> |
Synchronized wmf-config/jobqueue.php: JobQueue: Migrate RecordLintJob to EventBus - T175212 (duration: 00m 46s) |
[production] |
| 09:56 |
<marostegui> |
Deploy alter table on s5 - dbstore1001 - T174569 |
[production] |
| 09:49 |
<foks> |
Disabled 2FA for Jean-Frédéric |
[production] |
| 09:46 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db1105 as multi-instance host for s1 and s2 - T178359 (duration: 00m 46s) |
[production] |
| 09:45 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db1105 as multi-instance host for s1 and s2 - T178359 (duration: 00m 47s) |
[production] |
| 09:43 |
<godog> |
upgrade prometheus to 1.8.1 with k8s on prometheus2004 - T177395 |
[production] |
| 09:27 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@df5fca9]: Enable RecordLintJob processing (duration: 00m 40s) |
[production] |
| 09:27 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@df5fca9]: Enable RecordLintJob processing |
[production] |
| 09:07 |
<moritzm> |
rebooting remaining app servers in codfw for update to Linux 4.9.51 (and to pick up OpenSSL updates) |
[production] |
| 09:05 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: mw2108.codfw.wmnet |
[production] |
| 09:05 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: wtp2018.codfw.wmnet |
[production] |
| 08:31 |
<marostegui> |
Deploy alter table on s5 - dbstore1002 - T174569 |
[production] |
| 08:22 |
<addshore@tin> |
Synchronized wmf-config/extension-list-labs: [[gerrit:390385|Add AdvancedSearch to extension-list]] T180147 PT 2/2 LABS ONLY (duration: 00m 46s) |
[production] |
| 08:21 |
<addshore@tin> |
Synchronized wmf-config/extension-list: [[gerrit:390385|Add AdvancedSearch to extension-list]] T180147 PT 1/2 (duration: 00m 47s) |
[production] |
| 08:13 |
<moritzm> |
rebooting job runners in codfw for update to Linux 4.9.51 (and to pick up OpenSSL updates) |
[production] |
| 06:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1103 on s2 and s4 - T178359 (duration: 00m 47s) |
[production] |
| 06:18 |
<marostegui> |
Deploy alter table on s6 primary master (db1061) - T174569 |
[production] |
| 02:30 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Nov 14 02:30:59 UTC 2017 (duration 6m 38s) |
[production] |
| 02:24 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.7) (duration: 07m 28s) |
[production] |
| 01:35 |
<mdholloway> |
mobileapps finished rolling back to 11/8 deployment |
[production] |
| 01:34 |
<mholloway-shell@tin> |
Finished deploy [mobileapps/deploy@00e60b2]: (no justification provided) (duration: 02m 27s) |
[production] |
| 01:31 |
<mholloway-shell@tin> |
Started deploy [mobileapps/deploy@00e60b2]: (no justification provided) |
[production] |
| 01:30 |
<mdholloway> |
mobileapps rolling back today's deployment due to a significant increase in errors. |
[production] |