|
2019-04-29
§
|
| 08:39 |
<godog> |
begin migration of bast4002 to prometheus v2 - T187987 |
[production] |
| 08:38 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) (duration: 15m 38s) |
[production] |
| 08:33 |
<elukey> |
restart keyholder on deploy1001 + rearm keys |
[production] |
| 08:29 |
<arturo> |
cleanup disk in tools-sgebastion-09, was full of debug logs and unused apt packages |
[tools] |
| 08:28 |
<elukey> |
restart keyholder-proxy on deploy1001 (attempt to see if new analytics scap settings got applied) |
[production] |
| 08:25 |
<oblivian@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Enable unicode overrides table for php 7.2 T219279 (duration: 00m 53s) |
[production] |
| 08:25 |
<jynus> |
stop dbstore2001:s2 for cloning to db2098 T220572 |
[production] |
| 08:23 |
<oblivian@deploy1001> |
Synchronized wmf-config/Php72ToUpper.php: Adding unicode overrides table for php 7.2 T219279 (duration: 00m 54s) |
[production] |
| 08:23 |
<joal@deploy1001> |
Started deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) |
[production] |
| 08:22 |
<joal> |
Deploying refinery using scap (analytics-deploy user test) |
[analytics] |
| 07:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Move db2045 from s8 to x1 T219493 (duration: 00m 55s) |
[production] |
| 07:47 |
<marostegui> |
Stop mysql on db2034 (lag will happen on x1 codfw) - T219493 |
[production] |
| 07:44 |
<marostegui> |
Stop replication on db2034 (x1 master) for maintenance - T219493 |
[production] |
| 07:13 |
<moritzm> |
updated stretch netboot image for 9.9 point release |
[production] |
|
2019-04-28
§
|
| 20:49 |
<lucaswerkmeister> |
deployed bd9b272b21 |
[tools.quickcategories] |
| 20:15 |
<xSavitar> |
Restart successful, tool up and running again |
[tools.awmd-stats] |
| 20:13 |
<xSavitar> |
Restarting the tool... |
[tools.awmd-stats] |
| 17:46 |
<jiji@cumin1001> |
conftool action : set/pooled=no; selector: name=cp3037.esams.wmnet |
[production] |
| 17:46 |
<jijiki> |
Depooling cp3037 |
[production] |
| 16:14 |
<lucaswerkmeister> |
deployed 9d3c6e3dc3 |
[tools.quickcategories] |
| 14:55 |
<James_F> |
Updated trwiki's MediaWiki:Common.css to not over-ride the logo. |
[production] |
| 14:53 |
<James_F> |
Manually purged the trwiki logos from Varnish as part of updating them for 2 year anniversary. |
[production] |
| 14:47 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki.png: trwiki: Update logo for 2 year anniversary, part III (duration: 00m 53s) |
[production] |
| 14:45 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki-1.5x.png: trwiki: Update logo for 2 year anniversary, part II (duration: 00m 53s) |
[production] |
| 14:44 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki-2x.png: trwiki: Update logo for 2 year anniversary, part I (duration: 00m 55s) |
[production] |
| 13:03 |
<xSavitar> |
restart complete, tool up and running again |
[tools.awmd-stats] |
| 12:58 |
<xSavitar> |
Restart the tool after maintenance work complete |
[tools.awmd-stats] |
| 12:53 |
<xSavitar> |
Down/Shutdown tool for little maintenance work (for 2mins) |
[tools.awmd-stats] |
|
2019-04-26
§
|
| 20:15 |
<foks> |
changing email and password for "Lemon martini@global" |
[production] |
| 19:38 |
<foks> |
changing password for JDiPierro@global |
[production] |
| 19:21 |
<bblack> |
varnish-backend-restart on cp4026, evidence of artificial 503s from mbox lag behavior, probably related to the semi-abuse client doing odd 404 traffic to ulsfo that's triggering bugs in swift's rewrite.py .... |
[production] |
| 19:04 |
<foks> |
changing password for Subinsebastien |
[production] |
| 17:50 |
<mutante> |
analytics1052 - reported broken systemd state in Icinga - service mcelog was in state failed - systemctl start mcelog - (T212219 ?) |
[production] |
| 16:18 |
<jynus> |
stop s6 mariadb instance on dbstore2001 T220572 |
[production] |
| 16:18 |
<xSavitar> |
Restart successful, tool up and running again |
[tools.awmd-stats] |
| 16:14 |
<xSavitar> |
Restarting the tool |
[tools.awmd-stats] |
| 15:51 |
<arturo> |
andrew updated dns servers for the cloud-instances2-b-eqiad subnet in neutron: 208.80.154.143 and 208.80.154.24 |
[admin] |
| 15:34 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: thumbor1001 ms-fe1005 ms-be1013 scb1001 restbase1007 |
[production] |
| 15:27 |
<chicocvenancio> |
paws-proxy-02 redirecting main page to https://www.mediawiki.org/wiki/PAWS T221886 |
[paws] |
| 15:05 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: ores1001.yaml wtp1025.yaml rdb1006.yaml |
[production] |
| 14:18 |
<marostegui> |
Set pc1004-1006 and pc2004-2006 as unracked on netbox - T209858 T210969 |
[production] |
| 13:33 |
<Krenair> |
shut off deployment-conf03 after discussion with otto.mata and elu.key - it seems ancient, broken, unused. T218729 |
[releng] |
| 13:17 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: mw1311.yaml, mx2001 & dubnium |
[production] |
| 12:52 |
<ema> |
cp4025: restart varnish-be due to mbox lag |
[production] |