|
2019-08-01
ยง
|
| 20:47 |
<mutante> |
scandium - turning into an mw appserver |
[production] |
| 20:46 |
<mutante> |
puppetmaster: create mcrouter certs for scandium.eqiad.wmnet needed to make it an appserver (https://wikitech.wikimedia.org/wiki/Mcrouter#Generate_certs_for_a_new_host) (T228069) |
[production] |
| 20:29 |
<bblack> |
restart pybal on lvs1014 |
[production] |
| 19:57 |
<bblack> |
lvs1016 - restart pybal for slight LVS config change for cloudelastic - T224324 |
[production] |
| 19:40 |
<brennen@deploy1001> |
Synchronized php: Revert group1 and group2 back to 1.34.0-wmf.15 (duration: 00m 53s) |
[production] |
| 19:39 |
<twentyafterfour> |
finished phabricator database dump |
[production] |
| 19:34 |
<bblack> |
lvs1014 - puppetize and restart pybal for cloudelastic LVS - T224324 |
[production] |
| 19:31 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 and group2 to 1.34.0-wmf.15 |
[production] |
| 19:20 |
<brennen> |
rolling back to wfm.15 on group1 and group2 while we investigate T229575 |
[production] |
| 19:12 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.16 |
[production] |
| 18:52 |
<mutante> |
scandium (parsoid testing) - added mw application server roles - puppet work / maintenance |
[production] |
| 18:47 |
<mutante> |
stat1004 - starting nagios-nrpe-server which got killed again - jbd2/md0-8 invoked oom-killer |
[production] |
| 18:32 |
<bblack@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=^cloudelastic.* |
[production] |
| 18:30 |
<bblack> |
lvs1016: puppet re-enabled, pybal restarted, cloudelastic deploy - T224324 |
[production] |
| 18:06 |
<urbanecm@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: 469c42d: Switch testwiki to read sessions from kask, with fallback to redis (T222099) (duration: 00m 55s) |
[production] |
| 17:42 |
<bblack> |
disable puppet on lvs1014 + lvs1016 for cloudelastic LVS merge - T224324 |
[production] |
| 17:36 |
<twentyafterfour> |
running db dump on phab1003 (in tmux). command: sudo ./bin/storage dump --output /srv/dumps/phabricator_db_20190801.sql.gz --compress |
[production] |
| 16:05 |
<XioNoX> |
power down msw1-codfw |
[production] |
| 15:47 |
<XioNoX> |
start codfw mgmt work - T228112 |
[production] |
| 15:40 |
<brennen@deploy1001> |
Synchronized php: group1 wikis to 1.34.0-wmf.16 (duration: 00m 54s) |
[production] |
| 15:39 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.16 |
[production] |
| 15:16 |
<mholloway-shell@deploy1001> |
Synchronized php-1.34.0-wmf.15/extensions/Wikibase: Do not warn about entity that was not found in WikiPageEntityRevisionLookup (T229482) (duration: 01m 14s) |
[production] |
| 15:13 |
<mholloway-shell@deploy1001> |
Synchronized php-1.34.0-wmf.16/extensions/Wikibase: Do not warn about entity that was not found in WikiPageEntityRevisionLookup (T229482) (duration: 01m 20s) |
[production] |
| 14:51 |
<herron> |
performing rolling restarts of eqiad logstash cluster for security updates |
[production] |
| 14:38 |
<cdanis@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Iaaa1238 comment-only no-op change (dbctl to 100% of production!) (duration: 00m 55s) |
[production] |
| 14:22 |
<cdanis@deploy1001> |
Synchronized wmf-config/etcd.php: Iaaa1238 dbctl to 100% of production! (duration: 00m 54s) |
[production] |
| 12:38 |
<jbond42> |
add cp1008 to canary hosts https://github.com/wikimedia/puppet/blob/production/hieradata/role/common/puppetmaster/frontend.yaml#L22 |
[production] |
| 12:18 |
<marostegui> |
Rename math table on db1089 (enwiki) - T196055 |
[production] |
| 11:42 |
<Urbanecm> |
EU SWAT done |
[production] |
| 11:40 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: c51baa3: Add files.geocollections.info to the wgCopyUploadsDomains whitelist for commonswiki (T229547) (duration: 00m 55s) |
[production] |
| 11:34 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 1e4458e: Add nlm.nih.gov to the wgCopyUploadsDomains whitelist for commonswiki (T229470) (duration: 00m 53s) |
[production] |
| 11:23 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: c164132: Revert "Revert "Switch property terms migration to WRITE_NEW on production wikidata"" (T225053) (duration: 00m 55s) |
[production] |
| 11:19 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.16/extensions/ExternalGuidance/: SWAT: 9402c36: Provide the messages in the target language of translation (T228019) (duration: 00m 56s) |
[production] |
| 11:09 |
<urbanecm@deploy1001> |
Synchronized wmf-config/flaggedrevs.php: SWAT: 7db98f3: flaggedrevs.php: Remove useless wgAddGroups/wgRemoveGroups declarations (duration: 00m 55s) |
[production] |
| 11:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/flaggedrevs.php: SWAT: aa82657: flaggedrevs.php: Allow wikis to remove ability to promote to/demote from autoreview/editor (T229346) (duration: 00m 54s) |
[production] |
| 10:51 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Remove db2058 from config T229543 (duration: 00m 57s) |
[production] |
| 10:50 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Remove db2058 from config T229543 (duration: 00m 55s) |
[production] |
| 10:12 |
<jbond42> |
rolling upgrade for patch |
[production] |
| 10:10 |
<_joe_> |
repooling mw1348 after reimaging as pure-php7 |
[production] |
| 07:38 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Provision db2126 into s2 T228969 (duration: 00m 55s) |
[production] |
| 07:37 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Provision db2126 into s2 T228969 (duration: 00m 54s) |
[production] |
| 07:35 |
<marostegui@cumin1001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8844', previous config saved to /var/cache/conftool/dbconfig/20190801-073459-marostegui.json |
[production] |
| 07:29 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: dc=eqiad,name=mw1348.eqiad.wmnet |
[production] |
| 07:27 |
<_joe_> |
removing mw1348 from rotation - reimaging for T228976 |
[production] |
| 07:10 |
<marostegui@cumin1001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8843', previous config saved to /var/cache/conftool/dbconfig/20190801-071022-marostegui.json |
[production] |
| 07:09 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1112 (duration: 00m 54s) |
[production] |
| 06:59 |
<elukey> |
install python3-docopt manually on lithium to test check_anycast_healthchecker |
[production] |
| 06:51 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=eqiad,name=mw1270.eqiad.wmnet |
[production] |
| 06:42 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=eqiad,name=mw1270.eqiad.wmnet |
[production] |
| 06:42 |
<_joe_> |
depooling mw1270 while migrating it to pure-php7 |
[production] |