2201-2250 of 10000 results (18ms)
2020-05-07 §
05:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Set s3 and s7 as read-only=off for maintenance T251158', diff saved to https://phabricator.wikimedia.org/P11167 and previous config saved to /var/cache/conftool/dbconfig/20200507-050419-marostegui.json [production]
05:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Set s3 and s7 as read-only for maintenance T251158', diff saved to https://phabricator.wikimedia.org/P11166 and previous config saved to /var/cache/conftool/dbconfig/20200507-050046-marostegui.json [production]
02:56 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert group1 wikis to 1.35.0-wmf.30 for T252079 [production]
02:55 <brennen> reverting group1 to 1.35.0-wmf.30 for T252079 [production]
00:12 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
2020-05-06 §
23:59 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Disable GrowthExperiments guidance on testwiki (duration: 01m 07s) [production]
23:18 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable password-reset-update on Wikipedias (T245791) (duration: 01m 07s) [production]
22:22 <brennen@deploy1001> Synchronized php-1.35.0-wmf.31/includes/revisionlist/RevisionItem.php: [[gerrit:594803|RevisionItem: Fix providing timestamp in getRevisionLink ]] (duration: 01m 09s) [production]
21:45 <andrewbogott> updating puppet compiler facts [production]
21:07 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
21:05 <ryankemper@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
21:04 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
20:35 <ejegg> updated Fundraising CiviCRM from b15b2cfbb5 to cfb6101e39 [production]
19:08 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.31 (duration: 01m 08s) [production]
19:07 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.31 [production]
19:03 <brennen> CORRECTION: 1.35.0-wmf.31 train unblocked (T249963), rolling forward to group1 [production]
19:03 <brennen> 1.35.0-wmf.31 train unblocked (T249963), rolling forward to group0 [production]
18:58 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.31/includes/specials/pagers/DeletedContribsPager.php: deploy https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/594778/ fixes UBN T252052 (duration: 01m 09s) [production]
18:54 <volans> upgraded spicerack to spicerack_0.0.34-1_amd64.deb on cumin[12]001 [production]
18:45 <volans> uploaded spicerack_0.0.34-1_amd64.deb to apt.wikimedia.org stretch-wikimedia [production]
18:44 <volans@deploy1001> Finished deploy [homer/deploy@8224f0a]: Release v0.2.2 (duration: 00m 18s) [production]
18:43 <volans@deploy1001> Started deploy [homer/deploy@8224f0a]: Release v0.2.2 [production]
18:28 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.31/includes/specials/pagers/DeletedContribsPager.php: sync https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/594768/ fixes T252043 (duration: 01m 08s) [production]
17:34 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:31 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:12 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:06 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:05 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
16:21 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:41 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:27 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:36 <mutante> puppetmaster - revoking cert for webserver-misc-apps , recreating it with static-codereview.wikimedia.org as addiitonal SAN (T243056) [production]
13:32 <hashar> Restarting CI Jenkins [production]
13:27 <mutante> puppetmaster - revoking cert for webserver-misc-static, not used anymore, merged into webserver-misc-apps [production]
13:27 <moritzm> installing graphicsmagick security updates [production]
13:25 <XioNoX> Upgrade Routinator 3000 to 0.7.0 on rpki2001 - T252010 [production]
13:25 <XioNoX> add routinator 3000 0.7.0 to buster-wikimedia - T252010 [production]
13:19 <ema> cp: upgrade purged to v0.10 [production]
13:08 <godog> start swift decom ms-be101[678] - T252008 [production]
11:22 <kart_> EU SWAT done. [production]
11:13 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|594668|Enable ContentTranslation in Armenian WP as a default tool (T249229)]] (duration: 01m 08s) [production]
10:27 <ema> cp2027: test purged v0.10 [production]
10:20 <moritzm> restarting apache on dbmonitor/grafana/miscweb/graphite/netmon to pick up openldap update [production]
10:00 <moritzm> installing remaining openldap security updates (client-side libs, tools) [production]
09:52 <jbond42> enable rember me feature of CAS [production]
09:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1121 and remove db1103:3314 from vslow in s4', diff saved to https://phabricator.wikimedia.org/P11159 and previous config saved to /var/cache/conftool/dbconfig/20200506-093940-marostegui.json [production]
09:12 <marostegui> Upgrade package on s3 and s7 master (db1123 and db1086) in preparation for tomorrow's restart - T251158 [production]
08:56 <jbond42> restarting ps1-a4-eqiad.mgmt.eqiad.wmnet. [production]
08:53 <jynus> kill FTWRL on db2101 [production]
08:43 <oblivian@deploy1001> Synchronized wmf-config/CommonSettings.php: Reverting change on mw1407 T99740 (duration: 01m 16s) [production]