|
2020-04-20
ยง
|
| 18:21 |
<otto@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 18:20 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Adjust dummy name of fake Parsoid extension to just 'Parsoid' (duration: 01m 01s) |
[production] |
| 18:19 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'canary' . |
[production] |
| 18:19 |
<otto@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 18:14 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T236104 Wait to update the globals cache file for opcache regeneration (duration: 01m 02s) |
[production] |
| 18:11 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 02s) |
[production] |
| 18:06 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 02s) |
[production] |
| 18:05 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: DiscussionTools: EditAttemptStepSamplingRate increase for some wikis T250086 (duration: 01m 10s) |
[production] |
| 17:07 |
<James_F> |
Zuul: Unarchive the WikiShare extension T250400 |
[releng] |
| 16:55 |
<James_F> |
Zuul: Archive the TemplateInfo extension T250591 |
[releng] |
| 15:41 |
<halfak> |
Deploying ORES 5d977f4 |
[releng] |
| 15:41 |
<halfak> |
Deploying ORES 5d977f4 |
[deployment-prep] |
| 15:33 |
<Urbanecm> |
mwscript importImages.php --wiki=commonswiki --comment-ext=txt --user=Victorgrigas /home/urbanecm/upload (T250687) |
[production] |
| 15:31 |
<bd808> |
Rebuilding Docker containers to pick up tools-webservice v0.68 (T250625) |
[tools] |
| 15:10 |
<marostegui> |
Upgrade db2079 |
[production] |
| 14:57 |
<cdanis@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=wdqs,name=eqiad |
[production] |
| 14:54 |
<addshore> |
restart blazegraph on wdqs1006 |
[production] |
| 14:53 |
<addshore> |
depool wdqs1006 as it stopped updating |
[production] |
| 14:47 |
<arturo> |
added joakino to toolsbeta.admin LDAP group |
[toolsbeta] |
| 14:47 |
<arturo> |
added joakino to tools.admin LDAP group |
[tools] |
| 14:38 |
<ottomata> |
restarting eventlogging-processor with updated python3-ua-parser for parsing KaiOS user ageints |
[analytics] |
| 14:28 |
<marostegui> |
Upgrade db2096 (x1 codfw master) |
[production] |
| 14:24 |
<marostegui> |
Upgrade db2101 |
[production] |
| 14:18 |
<marostegui> |
Upgrade dbstore1005 |
[production] |
| 14:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1127 after upgrade', diff saved to https://phabricator.wikimedia.org/P11025 and previous config saved to /var/cache/conftool/dbconfig/20200420-141711-marostegui.json |
[production] |
| 14:13 |
<marostegui> |
Upgrade db2131 |
[production] |
| 14:10 |
<marostegui> |
Upgrade db1127 |
[production] |
| 14:10 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1127 for upgrade', diff saved to https://phabricator.wikimedia.org/P11023 and previous config saved to /var/cache/conftool/dbconfig/20200420-141017-marostegui.json |
[production] |
| 14:06 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1089 after schema change', diff saved to https://phabricator.wikimedia.org/P11022 and previous config saved to /var/cache/conftool/dbconfig/20200420-140642-marostegui.json |
[production] |
| 13:50 |
<marostegui> |
Deploy schema change on codfw master - T250055 |
[production] |
| 13:30 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Undeploying graphoid on beta (duration: 01m 07s) |
[production] |
| 13:28 |
<jeh> |
shutdown elasticsearch v5 cluster running Jessie T236606 |
[tools] |
| 13:18 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1081 after schema change, restore db1097:3314 original weights', diff saved to https://phabricator.wikimedia.org/P11021 and previous config saved to /var/cache/conftool/dbconfig/20200420-131823-marostegui.json |
[production] |
| 12:46 |
<arturo> |
uploading tools-webservice v0.68 to aptly stretch-tools and update it on relevant servers (T250625) |
[tools] |
| 12:40 |
<XioNoX> |
remove all disabled termsfrom cr2-eqiad |
[production] |
| 12:31 |
<XioNoX> |
remove all disabled BGP neighbors on cr2-esams |
[production] |
| 12:11 |
<mateusbs17> |
Running `REINDEX DATABASE gis` in maps2004.codfw.wmnet (which is depooled at the moment) |
[production] |
| 12:06 |
<arturo> |
installing tools-webservice v0.68 for testing |
[toolsbeta] |
| 12:06 |
<arturo> |
uploaded tools-webservice v0.68 to stretch-toolsbeta for testing |
[tools] |
| 11:59 |
<arturo> |
`root@tools-sge-services-03:~# aptly db cleanup` removed 340 unreferenced packages, and 2 unreferenced files |
[tools] |
| 11:41 |
<mutante> |
puppetmaster - revoking cert for webserver-misc-apps.discovery.wmnet and recreating it with additional static microsite names (T247650) |
[production] |
| 11:27 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:591017|Temporarily enable event oversampling for conflicts (T249616)]] (duration: 01m 00s) |
[production] |
| 11:25 |
<awight@deploy1001> |
Synchronized php-1.35.0-wmf.28/extensions/TwoColConflict: SWAT: [[gerrit:591016|Configurable EditStepAttempt oversampling for conflicts (T249616)]] (duration: 01m 03s) |
[production] |
| 11:05 |
<mutante> |
rsyncing static-bugzilla files from bromine to miscweb1002 (T247650) |
[production] |
| 11:05 |
<arturo> |
poweroff `toolsbeta-services-01`. I suspect this VM is not in use because no puppet role is in used there |
[toolsbeta] |
| 11:02 |
<mutante> |
bromine/vega: stop rsyncd which was removed from puppet |
[production] |
| 10:58 |
<arturo> |
run `aborrero@toolsbeta-puppetdb-02:~ $ sudo systemctl restart puppetdb` the service was in failed state, causing puppet failures across the whole project |
[toolsbeta] |
| 10:49 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:591023| Bumping portals to master (563985)]] (duration: 00m 57s) |
[production] |
| 10:48 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:591023| Bumping portals to master (563985)]] (duration: 01m 03s) |
[production] |
| 10:37 |
<elukey> |
apt-get purge rsync on mwlog* after https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/589600/ |
[production] |