|
2019-12-19
ยง
|
| 18:26 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@e7200d2] (thin): deploying analytics-refinery together with refinery-source v0.0.109 (thin) |
[production] |
| 18:24 |
<mforns@deploy1001> |
Finished deploy [analytics/refinery@e7200d2]: deploying analytics-refinery together with refinery-source v0.0.109 (duration: 07m 58s) |
[production] |
| 18:16 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@e7200d2]: deploying analytics-refinery together with refinery-source v0.0.109 |
[production] |
| 18:03 |
<James_F> |
Running `foreachwiki maintenance/deleteTag.php --batch-size 500 HHVM` on mwmaint1002 for T75181 |
[production] |
| 18:02 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: MachineVision: Remove new upload labeling job delay (duration: 00m 57s) |
[production] |
| 17:38 |
<James_F> |
Running `mwscript deleteTag.php --wiki=testwiki --batch-size 100 HHVM` for T75181 final testing |
[production] |
| 16:57 |
<addshore> |
addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=10 # T237984, Full pass (33 rows missing currently) |
[production] |
| 16:53 |
<addshore@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/Wikibase/lib/includes/Store/Sql/Terms/DatabaseTermIdsCleaner.php: T237984 [[gerrit:559529]] Fix incorrect deletion of rows in DatabaseTermIdsCleaner (duration: 00m 56s) |
[production] |
| 16:22 |
<addshore> |
addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=2 --from-id=36185524 # T237984 (For `P4155`, then will stop) |
[production] |
| 16:21 |
<addshore> |
Processed up to page 36567013 (P4152) |
[production] |
| 16:10 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:10 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:53 |
<XioNoX> |
enable netflow sampling in ulsfo |
[production] |
| 15:34 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:34 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:12 |
<ejegg> |
updated fundraising internal dashboard from 913d690621 to b75f9074de |
[production] |
| 15:10 |
<ejegg> |
updated payments-wiki from 7131303dba to 827e3235dc |
[production] |
| 14:50 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Mark REL1_34 stable in ExtensionDistributor (duration: 00m 53s) |
[production] |
| 14:47 |
<_joe_> |
restart pybal on the primary low-traffic balancers in eqiad, codfw |
[production] |
| 14:41 |
<ema> |
cp1075, cp4028: ats-backend-restart to disable xdebug plugin T241001 |
[production] |
| 14:40 |
<_joe_> |
restarting pybal on the backup low-traffic in eqiad,codfw |
[production] |
| 14:12 |
<phamhi@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:10 |
<phamhi@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:48 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:45 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:41 |
<phamhi@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:41 |
<phamhi@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1136', diff saved to https://phabricator.wikimedia.org/P9979 and previous config saved to /var/cache/conftool/dbconfig/20191219-133525-marostegui.json |
[production] |
| 13:34 |
<ema> |
pool cp1089 with ATS backend T227432 |
[production] |
| 13:33 |
<ema> |
pool cp2023 with ATS backend T227432 |
[production] |
| 13:18 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9978 and previous config saved to /var/cache/conftool/dbconfig/20191219-131832-marostegui.json |
[production] |
| 13:17 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:15 |
<James_F> |
mwscript emptyUserGroup.php --wiki=mediawikiwiki oauthadmin T241142 |
[production] |
| 13:15 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:12 |
<ema@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:12 |
<ema@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9977 and previous config saved to /var/cache/conftool/dbconfig/20191219-130832-marostegui.json |
[production] |
| 13:02 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.11 |
[production] |
| 12:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1136', diff saved to https://phabricator.wikimedia.org/P9976 and previous config saved to /var/cache/conftool/dbconfig/20191219-125748-marostegui.json |
[production] |
| 12:53 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1136, s7 candidate master, for upgrade', diff saved to https://phabricator.wikimedia.org/P9975 and previous config saved to /var/cache/conftool/dbconfig/20191219-125314-marostegui.json |
[production] |
| 12:52 |
<moritzm> |
failover ganeti master in ulsfo to ganeti4002 for a test |
[production] |
| 12:52 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/WikiLove/includes/ApiWikiLove.php: T241094 ApiWikiLove: Don't pass null to implode(), but fall back to [] (duration: 01m 02s) |
[production] |
| 12:52 |
<ema> |
depool cp2023 and cp1089 for ATS reimages T227432. Reimaged together because of T238817 |
[production] |
| 12:37 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Cleanup: Remove CLI 'display_errors=stderr' setting (duration: 01m 01s) |
[production] |
| 12:37 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:35 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:32 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Cleanup: Remove very old 'error_append_string' INI override (duration: 01m 02s) |
[production] |
| 12:30 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Cleanup: Move core DB/SQL-related config closer together (duration: 01m 02s) |
[production] |
| 12:03 |
<moritzm> |
installing netflow4001 |
[production] |
| 11:43 |
<addshore> |
addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=5 --from-id=4089887 # T237984 - Will stop after P433 |
[production] |