|
2021-10-29
§
|
| 23:58 |
<andrewbogott> |
deleting all files older than 14 days in /srv/tools/shared/tools/project/.shared/cache |
[tools] |
| 23:29 |
<andrewbogott> |
deleting logs/person_bkl2.out in order to free up nfs space |
[tools.persondata] |
| 23:23 |
<andrewbogott> |
deleting error.log in order to free up nfs space |
[tools.render-tests] |
| 23:22 |
<andrewbogott> |
deleting error.log in order to free up nfs space |
[tools.render] |
| 23:21 |
<andrewbogott> |
deleting ifttt/www/python/src/ifttt.log in order to free up nfs space |
[tools.ifttt] |
| 23:20 |
<andrewbogott> |
deleting giant logfile 'virgule.err' to make space on NFS |
[tools.robokobot] |
| 23:04 |
<btullis> |
deleted all remaining old cassandra snapshots on aqs100x servers. |
[analytics] |
| 22:58 |
<btullis> |
deleted old snapshots from aqs1006 and aqs1009 |
[analytics] |
| 22:57 |
<urbanecm> |
[urbanecm@mwmaint1002 ~]$ mwscript extensions/CentralAuth/maintenance/attachAccount.php --wiki=foundationwiki --userlist users.txt # T205347, users.txt is at P17641 |
[production] |
| 22:02 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4036.ulsfo.wmnet with OS buster |
[production] |
| 21:32 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4036.ulsfo.wmnet with OS buster |
[production] |
| 21:28 |
<brennen> |
manually registering runner-1008-security as a stopgap measure for T294050 |
[releng] |
| 21:20 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:20 |
<legoktm@deploy1002> |
Synchronized php-1.38.0-wmf.6/includes/libs/filebackend/SwiftFileBackend.php: Force using HTTP 1.1 for SwiftFileBackend (T275752) (duration: 00m 55s) |
[production] |
| 21:17 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4034.ulsfo.wmnet with OS buster |
[production] |
| 21:17 |
<legoktm@deploy1002> |
Synchronized php-1.38.0-wmf.6/includes/libs/http/MultiHttpClient.php: MultiHttpClient: Allow setting HTTP protocol version in curl (T275752) (duration: 00m 57s) |
[production] |
| 21:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:16 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4035.ulsfo.wmnet with OS buster |
[production] |
| 21:06 |
<robh@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cp4036.ulsfo.wmnet with OS buster |
[production] |
| 20:43 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4036.ulsfo.wmnet with OS buster |
[production] |
| 20:43 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4035.ulsfo.wmnet with OS buster |
[production] |
| 20:43 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4034.ulsfo.wmnet with OS buster |
[production] |
| 20:39 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4033.ulsfo.wmnet with OS buster |
[production] |
| 19:56 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4033.ulsfo.wmnet with OS buster |
[production] |
| 19:49 |
<robh@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4033.ulsfo.wmnet with OS buster |
[production] |
| 19:15 |
<robh@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4033.ulsfo.wmnet with OS buster |
[production] |
| 17:47 |
<urbanecm> |
Connect Neil Shah-Quinn (WMF)@foundationwiki to SUL (T205347) |
[production] |
| 17:45 |
<razzi> |
set presto_analytics_hive extra parameter engine_params.connect_args.session_props.query_max_run_time to 55s on superset.wikimedia.org |
[analytics] |
| 17:42 |
<urbanecm> |
[urbanecm@mwmaint1002 /srv/mediawiki/php/maintenance]$ mwscript reassignEdits.php --wiki=foundationwiki --norc 'Neil P. Quinn-WMF' 'Neil Shah-Quinn (WMF)' # part of SUL finalisation at foundationwiki, T205347 |
[production] |
| 17:19 |
<bd808> |
Fixed stuck apt configuration on cloudstore-client-1 which was causing puppet failure alerts |
[cloudstore] |
| 16:41 |
<urbanecm> |
Connect Babel AutoCreate@foundationwiki to SUL (T205347) |
[production] |
| 16:37 |
<urbanecm> |
[urbanecm@mwmaint1002 ~]$ mwscript extensions/CentralAuth/maintenance/attachAccount.php --wiki=foundationwiki --userlist users.txt # T205347, users.txt is at P17640 |
[production] |
| 16:22 |
<urbanecm> |
[urbanecm@mwmaint1002 ~]$ mwscript extensions/CentralAuth/maintenance/attachAccount.php --wiki=foundationwiki --userlist users.txt # T205347, users.txt is at P17639 |
[production] |
| 15:27 |
<bd808> |
`sudo touch .no-puppet-checks` on striker-uwsgi03 because I don't care that an apt package is not being installed |
[striker] |
| 12:18 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-test-eqiad cluster: Roll restart of jvm daemons for openjdk upgrade. - elukey@cumin1001 |
[production] |
| 11:00 |
<urbanecm> |
[urbanecm@mwdebug1001 /srv/mediawiki]$ scap pull # livehacking ended |
[production] |
| 10:58 |
<urbanecm> |
stashing on mwdebug1001 |
[production] |
| 10:39 |
<elukey> |
roll restart of kafka-test to pick up new truststore (root PKI added) |
[analytics] |
| 10:38 |
<elukey@cumin1001> |
START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-test-eqiad cluster: Roll restart of jvm daemons for openjdk upgrade. - elukey@cumin1001 |
[production] |
| 10:20 |
<hnowlan@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . |
[production] |
| 10:20 |
<hnowlan@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . |
[production] |
| 09:49 |
<wm-bot> |
<jeanfred> Deploy 40c8cd3 |
[tools.integraality] |
| 09:49 |
<wm-bot> |
<jeanfred> Deploy af49bab (T236590 and T273226) |
[tools.integraality] |
| 09:28 |
<wm-bot> |
<jeanfred> Deploy 2260c8f (follow up to T294570) |
[tools.integraality] |