201-250 of 10000 results (30ms)
2020-01-08 §
07:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10081 and previous config saved to /var/cache/conftool/dbconfig/20200108-070614-marostegui.json [production]
07:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1079', diff saved to https://phabricator.wikimedia.org/P10080 and previous config saved to /var/cache/conftool/dbconfig/20200108-070009-marostegui.json [production]
06:56 <marostegui> Upgrade db1079 [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1079', diff saved to https://phabricator.wikimedia.org/P10079 and previous config saved to /var/cache/conftool/dbconfig/20200108-064404-marostegui.json [production]
06:42 <marostegui> Remove partitions from revision table on s6 for db1096:3316 - T239453 [production]
06:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1096:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10078 and previous config saved to /var/cache/conftool/dbconfig/20200108-064144-marostegui.json [production]
06:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1098:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10077 and previous config saved to /var/cache/conftool/dbconfig/20200108-063550-marostegui.json [production]
05:41 <XioNoX> enable netflow in eqsin [production]
03:54 <volker-e@deploy1001> Finished deploy [design/style-guide@ad595d5]: Deploy design/style-guide: (duration: 00m 08s) [production]
03:54 <volker-e@deploy1001> Started deploy [design/style-guide@ad595d5]: Deploy design/style-guide: [production]
00:38 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@024488f]: airflow: set mjolnir dag start date to today (20200108) (duration: 00m 42s) [production]
00:37 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@024488f]: airflow: set mjolnir dag start date to today (20200108) [production]
00:21 <reedy@deploy1001> Synchronized wmf-config/throttle.php: T240845 (duration: 01m 04s) [production]
2020-01-07 §
23:53 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@cb228ae]: Force python to use python3.5 dependencies (take two) (duration: 00m 10s) [production]
23:53 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@cb228ae]: Force python to use python3.5 dependencies (take two) [production]
23:36 <mutante> [puppetmaster2001:/var/run/confd-template] $ sudo rm .cloudceph*.err [production]
23:02 <cdanis> cp3055.mgmt% racadm serveraction powercycle T240425 [production]
20:42 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@6c1f455]: Bump to master: Allow cli to load without pyspark (duration: 05m 55s) [production]
20:40 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.35.0-wmf.14 refs T233862 [production]
20:36 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@6c1f455]: Bump to master: Allow cli to load without pyspark [production]
20:30 <jhuneidi@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.14 refs T233862 (duration: 29m 01s) [production]
20:12 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@867d674]: Bump to master: Allow cli to load without pyspark (duration: 05m 13s) [production]
20:06 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@867d674]: Bump to master: Allow cli to load without pyspark [production]
20:01 <jhuneidi@deploy1001> Started scap: testwikis wikis to 1.35.0-wmf.14 refs T233862 [production]
19:28 <James_F> mwscript createAndPromote.php foundationwiki 'Jdforrester (WMF)' --force --custom-groups=interface-admin for T241950 [production]
19:02 <James_F> 1.35.0-wmf.14 was branched at fb16374c5bdb9d14729f358fb81638fc91640b4f T233862 [production]
18:38 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@511f745]: [airflow] Force PYTHONPATH to use pyspark 3.5 deps (duration: 00m 14s) [production]
18:38 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@511f745]: [airflow] Force PYTHONPATH to use pyspark 3.5 deps [production]
17:31 <Urbanecm> Run scap pull at mwdebug1001, test over [production]
17:29 <Urbanecm> Stashing at mwdebug1001 [production]
17:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2076 T241647', diff saved to https://phabricator.wikimedia.org/P10072 and previous config saved to /var/cache/conftool/dbconfig/20200107-172839-marostegui.json [production]
17:23 <marostegui> Remove partitions from dewiki.revision from db2089:3315 T239453 [production]
17:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1088', diff saved to https://phabricator.wikimedia.org/P10071 and previous config saved to /var/cache/conftool/dbconfig/20200107-171955-marostegui.json [production]
17:18 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@b378752]: bump numpy to 1.17.2 (duration: 05m 53s) [production]
17:18 <vgutierrez> restarting pybal on lvs1015 - T240715 [production]
17:13 <vgutierrez> restarting pybal on lvs1016 - T240715 [production]
17:12 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@b378752]: bump numpy to 1.17.2 [production]
17:10 <vgutierrez@puppetmaster1001> conftool action : set/pooled=yes; selector: service=cloudceph,name=cloudcephmon1003.wikimedia.org [production]
17:10 <vgutierrez@puppetmaster1001> conftool action : set/pooled=yes; selector: service=cloudceph,name=cloudcephmon1002.wikimedia.org [production]
17:10 <vgutierrez@puppetmaster1001> conftool action : set/pooled=yes; selector: service=cloudceph,name=cloudcephmon1001.wikimedia.org [production]
16:43 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Disable banner on Special:Block for partial blocks early-adopter wikis T240300 (duration: 00m 57s) [production]
16:10 <elukey> cr1/cr2-eqiad: set port 443 (was 8190) for term schema in analytics-in4 [production]
15:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1088', diff saved to https://phabricator.wikimedia.org/P10070 and previous config saved to /var/cache/conftool/dbconfig/20200107-154529-marostegui.json [production]
15:44 <papaul> shutting down db2076 for FW upgrade [production]
15:41 <moritzm> installing urldownloader2002 T241979 [production]
15:30 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:27 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1088', diff saved to https://phabricator.wikimedia.org/P10069 and previous config saved to /var/cache/conftool/dbconfig/20200107-152304-marostegui.json [production]
15:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1088', diff saved to https://phabricator.wikimedia.org/P10068 and previous config saved to /var/cache/conftool/dbconfig/20200107-151633-marostegui.json [production]
15:11 <moritzm> installing urldownloader2001 T241979 [production]