|
2017-08-04
§
|
| 23:51 |
<mutante> |
phab2001 - removed outdated /etc/hosts entries, that fixed rsync, syncing /srv/repos/ from phab1001 |
[production] |
| 23:35 |
<mutante> |
phab2001 rebooting |
[production] |
| 23:35 |
<mutante> |
phab2001 - installing various package upgrades, apt-get autoremove old kernel images |
[production] |
| 23:12 |
<mutante> |
"reserved" UID 498 for phd on https://wikitech.wikimedia.org/wiki/UID | phab2001: find -exec chown to fix all the files , restart cron |
[production] |
| 23:04 |
<mutante> |
phab2001 - changing UID/GID for phd user from 997:997 to 498:498 to make it match phab1001, to fix rsync breaking permissions. (rsync forces --numeric-ids when fetching from and rsyncd configured with chroot=yes). chown -R phw:www-data /srv/repos/ |
[production] |
| 22:37 |
<ejegg> |
restarted donations and refund queue consumers |
[production] |
| 21:44 |
<ejegg> |
stopped donations and refund queue consumers |
[production] |
| 21:24 |
<urandom> |
T172384: Disabling Puppet in dev environment to prevent unattended Cassandra restarts |
[production] |
| 20:19 |
<mutante> |
renewing SSL cert for status.wm.org (just like wikitech-static, but that one didnt have monitoring?) |
[production] |
| 20:02 |
<mutante> |
wikitech-static-ord - apt-get install certbot |
[production] |
| 19:41 |
<ejegg> |
updated CiviCRM from f1fd7f0f9e89f59a8fc4daaa5e95803a2f60acbb to f24ba787f711ed38029594f3f3049bd79221ddd7 |
[production] |
| 19:38 |
<mutante> |
renaming graphite varnish director/fixing config, running puppet on cache misc, tested on cp1045 |
[production] |
| 18:17 |
<andrewbogott> |
switched most cloud instance to new puppetmasters, as per https://phabricator.wikimedia.org/T171786 |
[production] |
| 11:46 |
<marostegui> |
Deploy schema change directly on s3 master for maiwikimedia - T172485 |
[production] |
| 11:30 |
<marostegui> |
Deploy schema change directly on s3 master for kbpwiki - T172485 |
[production] |
| 11:14 |
<marostegui> |
Deploy schema change directly on s3 master for dinwiki - T172485 |
[production] |
| 10:14 |
<marostegui> |
Deploy schema change directly on s3 master for atjwiki - T172485 |
[production] |
| 10:05 |
<marostegui> |
Stop replication on db2073 for maintenance |
[production] |
| 09:22 |
<marostegui> |
Add dbstore2002 to tendril - T171321 |
[production] |
| 09:19 |
<marostegui> |
Deploy schema change directly on s3 master for techconductwiki - T172485 |
[production] |
| 08:35 |
<marostegui> |
Deploy schema change directly on s3 master for hiwikiversity - T172485 |
[production] |
| 08:19 |
<marostegui> |
Deploy schema change directly on s3 master for wikimania2018wiki - T172485 |
[production] |
| 08:04 |
<marostegui> |
Sanitize wikimania2018wiki on sanitarium and sanitarium2 - T155041 |
[production] |
| 07:47 |
<marostegui> |
Stop MySQL on db2073 to copy its data to dbstore2002 - https://phabricator.wikimedia.org/T171321 |
[production] |
| 07:47 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2073 - T171321 (duration: 00m 47s) |
[production] |
| 07:07 |
<moritzm> |
installing imagemagick regression security updates on trusty |
[production] |
| 06:47 |
<marostegui> |
Sanitize hiwikiversity on sanitarium and sanitarium2 - T171829 |
[production] |
| 05:23 |
<mutante> |
phab1001 sudo ip addr del 10.64.32.186/32 dev eth0 (T172478) |
[production] |
| 02:28 |
<dzahn@neodymium> |
conftool action : set/pooled=yes; selector: name=phab1001-vcs.eqiad.wmnet |
[production] |
| 02:28 |
<dzahn@neodymium> |
conftool action : set/pooled=no; selector: name=phab1001-vcs.eqiad.wmnet |
[production] |
| 02:15 |
<mutante> |
phab1001 can't talk to mx servers via IPv6, but works via IPv4. iridium and other mailservers can also talk IPv6 to it. why? it did not change even when stopping ferm on client and on server it allows from anywhere. workaround for now was to hardcode IPv4 IP in phab config. (T163938) |
[production] |
| 02:13 |
<twentyafterfour> |
outgoing phab mail is working again |
[production] |
| 01:16 |
<twentyafterfour> |
twentyafterfour@phab1001:/srv/repos$ sudo chown -R phd:www-data /srv/repos |
[production] |
| 01:16 |
<twentyafterfour> |
twentyafterfour@phab1001:/srv/repos$ sudo chmod -x /usr/local/sbin/sync-srv-repos |
[production] |
| 01:12 |
<mutante> |
phab1001 - stopped and started exim, which is now running with same options as iridium |
[production] |
| 00:53 |
<twentyafterfour> |
starting phd to shut up icinga |
[production] |
| 00:40 |
<ebernhardson@tin> |
Synchronized php-1.30.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: Turn CirrusSearch MLR test back off (duration: 00m 47s) |
[production] |
| 00:35 |
<twentyafterfour> |
phabricator web service is also up |
[production] |
| 00:34 |
<mutante> |
phab1001 - service IPs switched - puppet ran - ssh-phab service up |
[production] |
| 00:30 |
<twentyafterfour> |
phab1001 chown -R phd:phd /srv/repos |
[production] |
| 00:28 |
<twentyafterfour> |
testing phd on phab1001 |
[production] |
| 00:24 |
<mutante> |
phab1001 sudo ip addr add 2620:0:861:103:10:64:32:186/128 dev eth0 |
[production] |
| 00:24 |
<mutante> |
phab1001 sudo ip addr add 10.64.32.186/32 dev eth0 |
[production] |
| 00:23 |
<mutante> |
iridium sudo ip addr del 2620:0:861:ed1a::3:16/128 dev lo |
[production] |
| 00:23 |
<mutante> |
iridiium sudo ip addr del 208.80.154.250/32 dev lo |
[production] |
| 00:23 |
<mutante> |
iridium sudo ip addr del 2620:0:861:103:10:64:32:186/128 dev eth0 |
[production] |
| 00:23 |
<mutante> |
iridium sudo ip addr del 10.64.32.186/32 dev eth0 |
[production] |
| 00:07 |
<twentyafterfour> |
stoped phd and apache on iridium |
[production] |