|
2019-03-06
§
|
| 10:36 |
<hashar> |
Deploying a hotfix for Translate https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Translate/+/494659/ |
[production] |
| 10:22 |
<ema> |
lvs100[12],lvs1016: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 09:11 |
<ema> |
lvs200[123]: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 09:05 |
<moritzm> |
removed debmonitor host entry for ruthenium (T216062) |
[production] |
| 09:01 |
<mutante> |
switching noc.wikimedia.org from apache to httpd module (mwmaint2001, then mwmaint1002) |
[production] |
| 08:48 |
<akosiaris@cumin1001> |
conftool action : set/weight=12; selector: dc=eqiad,service=citoid,cluster=scb,name=kubernetes.* |
[production] |
| 08:48 |
<akosiaris@cumin1001> |
conftool action : set/weight=15; selector: dc=codfw,service=citoid,cluster=scb,name=kubernetes.* |
[production] |
| 08:48 |
<akosiaris> |
increase citoid traffic to kubernetes infrastructure to 50% T213194 |
[production] |
| 08:48 |
<akosiaris> |
increase citoid traffic to kubernetes infrastructure to 50% |
[production] |
| 08:47 |
<marostegui> |
Deploy schema change on s3 codfw, this will generate lag on codfw - T86342 |
[production] |
| 08:42 |
<ema> |
lvs300[12]: upgrade linux to 4.9.144-3.1, reboot for L1TF kernel/microcode updates T203011 |
[production] |
| 08:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090 after MySQL upgrade (duration: 00m 59s) |
[production] |
| 08:15 |
<marostegui> |
Stop MySQL on db1090 for mysql upgrade |
[production] |
| 08:14 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090 for MySQL upgrade (duration: 00m 56s) |
[production] |
| 08:14 |
<marostegui> |
Reload haproxy on dbproxy1010 to repool labsdb1011 |
[production] |
| 07:48 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1105 after MySQL upgrade (duration: 00m 56s) |
[production] |
| 07:40 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic db1105 after MySQL upgrade (duration: 00m 56s) |
[production] |
| 07:34 |
<marostegui> |
Remove dbstore1002 from tendril and zarcillo T216491 |
[production] |
| 07:09 |
<elukey> |
raised analytics user's max_user_connection from 10 to 100 on labsdb1012 - T215231 |
[production] |
| 07:06 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic db1105 after MySQL upgrade (duration: 00m 56s) |
[production] |
| 06:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1105 after MySQL upgrade (duration: 00m 56s) |
[production] |
| 06:32 |
<marostegui> |
Stop MySQL on db1105 for MySQL upgrade |
[production] |
| 06:31 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1105 for MySQL upgrade (duration: 01m 14s) |
[production] |
| 06:27 |
<marostegui> |
Add labsdb1012 to tendril and zarcillo - T215231 |
[production] |
| 05:50 |
<kart_> |
Finished manual run of unpublished ContentTranslation draft purge script (T217310) |
[production] |
| 04:26 |
<eileen> |
civicrm revision changed from 196493f372 to 4aac68eead, config revision is 8ca90b4c7b |
[production] |
| 04:00 |
<kart_> |
Started manual run of unpublished ContentTranslation draft purge script (T217310) |
[production] |
| 02:28 |
<bd808> |
Shutdown webservice because it is redirecting all requests to a non-existent Cloud VPS proxy (https://wmt.wmflabs.org/) |
[tools.irc-wmt] |
| 02:26 |
<bd808> |
Moved webservice from Trusty job grid to Stretch job grid |
[tools.irc-wmt] |
| 00:55 |
<twentyafterfour> |
finished US Eveninig SWAT. |
[production] |
| 00:41 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: sync https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/494524/ for SWAT refs T217276 (duration: 00m 55s) |
[production] |
| 00:23 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/mobile.php: sync https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/494271/ for SWAT refs T212253 (duration: 00m 56s) |
[production] |
| 00:12 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: sync https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/493236/ for SWAT. refs T217080 (duration: 00m 56s) |
[production] |
|
2019-03-05
§
|
| 23:51 |
<ejegg> |
updated payments-wiki from 4f2935ad17 to f1a89d7045 |
[production] |
| 21:05 |
<godog> |
temporarily stop requests to k8s instance on prometheus2004 |
[production] |
| 21:00 |
<herron> |
restarted apache on grafana1001 |
[production] |
| 20:43 |
<herron> |
retarted apache on grafana1001 |
[production] |
| 20:10 |
<thcipriani> |
reenable beta-scap-eqiad |
[releng] |
| 19:56 |
<hashar@deploy1001> |
Synchronized php-1.33.0-wmf.20/extensions/LdapAuthentication/: Stop referring to the now-killed AuthPlugin class - T217692 (duration: 00m 57s) |
[production] |
| 19:49 |
<paladox> |
enabling kafka on gerrit-test3 in mwvagrant for the multi master gerrit setup. |
[git] |
| 19:37 |
<paladox> |
applying role::gerrit to gerrit-test4 |
[gerrit] |
| 19:17 |
<thcipriani> |
disable beta-scap-eqiad due to T217587 |
[releng] |
| 19:11 |
<Zppix> |
Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-mysql.git |
[git] |
| 19:00 |
<Zppix> |
Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-test.git, gerrit-test3.git, puppet-paladox.git, and jenkins-slave-01.git |
[git] |
| 18:27 |
<bd808> |
Added BryanDavis (self) as projectadmin to investigate T217681 |
[gerrit] |
| 17:44 |
<godog> |
bounce uwsgi on graphite1004 |
[production] |
| 17:25 |
<herron> |
restarting uwsgi-graphite-web on graphite1004 |
[production] |
| 16:54 |
<moritzm> |
imported logstash 1:5.6.14-1 to thirdparty/elastic56 |
[production] |
| 16:52 |
<herron> |
restarting uwsgi-graphite-web on graphite1004 |
[production] |
| 16:44 |
<paladox> |
creating gerrit-test4 instance (to test a multi master gerrit setup from gerrit-test3) |
[gerrit] |