|
2017-05-29
§
|
| 13:02 |
<akosiaris> |
enable puppet across eqiad/esams after puppetmaster upgrade. |
[production] |
| 12:52 |
<akosiaris> |
disable puppet across eqiad/esams for puppetmaster upgrade. This should avoid any irc spam about failed puppet agent runs |
[production] |
| 12:52 |
<akosiaris> |
enable puppet across codfw/ulsfo after puppetmaster upgrade |
[production] |
| 12:41 |
<akosiaris> |
disable puppet across codfw/ulsfo for puppetmaster upgrade. This should avoid any irc spam about failed puppet agent runs |
[production] |
| 12:36 |
<moritzm> |
installing imagemagick security updates on jessie |
[production] |
| 12:31 |
<akosiaris> |
update kubernetes policy-options on cr{1,2}-{eqiad,codfw}. T165732 |
[production] |
| 10:39 |
<moritzm> |
installing fop security updates |
[production] |
| 10:22 |
<hashar> |
force refreshed Nodepool Trusty images. Was stuck somehow |
[releng] |
| 10:18 |
<ema> |
upgrade nginx to 1.11.10-1+wmf1 on hassium and hassaleh |
[production] |
| 10:06 |
<hashar> |
deployment-tin rm -fR /usr/src/hhvm T166492 |
[releng] |
| 09:53 |
<moritzm> |
upgrade remaining mw* hosts already running HHVM 3.18 to 3.18.2+dfsg-1+wmf4 |
[production] |
| 09:51 |
<hashar> |
deployment-tin: rm /var/lib/l10nupdate/caches/cache-master/*.json T166492 |
[releng] |
| 09:45 |
<joal> |
Restarted wikidata-articleplaceholder_metrics-wf-2017-5-27 |
[analytics] |
| 09:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1045 (duration: 00m 41s) |
[production] |
| 09:01 |
<marostegui> |
Drop gather tables from: testwiki, test2wiki, enwikivoyage, hewiki, enwiki - T166097 |
[production] |
| 08:02 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove db1023 - T166486 (duration: 00m 41s) |
[production] |
| 08:02 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Remove db1023 - T166486 (duration: 00m 42s) |
[production] |
| 07:38 |
<marostegui> |
Stop MySQL on db1095 to take a backup - this will make labsdb1009,10 and 11 break replication while it is down - T153743 |
[production] |
| 07:01 |
<_joe_> |
reeanbling scap on mw2140, T166328 |
[production] |
| 06:45 |
<_joe_> |
restarting changeprop on scb1002, using 15 gigs of RAM |
[production] |
| 06:42 |
<marostegui> |
Deploy alter table s3 - dbstore2002 - T166278 |
[production] |
| 06:41 |
<marostegui> |
Deploy alter table s4 - dbstore1002 - T166206 |
[production] |
| 06:33 |
<_joe_> |
trying to restart pdfrender on scb1002 |
[production] |
| 06:32 |
<marostegui> |
Deploy alter table s3 - db2036 - T166278 |
[production] |
| 06:32 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2043, depool db2036 - T166278 (duration: 01m 44s) |
[production] |
| 06:29 |
<_joe_> |
powercycling mw1294 |
[production] |
| 06:11 |
<marostegui> |
Deploy alter table on s4 db1084 - T166206 |
[production] |
| 06:10 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1091, depool db1084 - T166206 (duration: 02m 45s) |
[production] |
| 06:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1091 - T166206 (duration: 03m 01s) |
[production] |
| 05:54 |
<marostegui> |
Restart MySQL on db1047 - T166452 |
[production] |
| 02:24 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.1) (duration: 08m 20s) |
[production] |
|
2017-05-26
§
|
| 20:32 |
<bd808> |
Added tools-webgrid-lighttpd-14{19,2[0-8]} as submit hosts |
[tools] |
| 20:31 |
<bd808> |
Added tools-webgrid-lighttpd-1412 and tools-webgrid-lighttpd-1413 as submit hosts |
[tools] |
| 20:28 |
<bd808> |
sudo qconf -as tools-webgrid-lighttpd-1417.tools.eqiad.wmflabs |
[tools] |
| 14:29 |
<marostegui> |
Stop pt-table-checksum on s1 - T162807 |
[production] |
| 14:04 |
<marostegui> |
Deploy alter tabel on s3 revision table db2043 - T166278 |
[production] |
| 14:03 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2050, depool db2043 - T166278 (duration: 00m 41s) |
[production] |
| 13:57 |
<_joe_> |
consuming the backlog of htmlCacheUpdate jobs for enwiktionary |
[production] |
| 13:19 |
<gehel> |
restart wdqs-updater on all wdqs nodes - T166378 |
[production] |
| 12:55 |
<marostegui> |
Deploy alter table s4 on db1097 - T166206 |
[production] |
| 12:54 |
<elukey> |
restarted master Hadoop daemons for jvm upgrade |
[analytics] |
| 12:44 |
<elukey> |
Restart Hadoop daemons on analytics100[12] (Hadoop master nodes) for jvm upgrades |
[production] |
| 12:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1097 - T166206 (duration: 00m 41s) |
[production] |
| 12:39 |
<elukey> |
re-added analytics1030 to the hadoop workers |
[analytics] |
| 10:56 |
<gehel> |
restart wdqs-updater on all wdqs nodes - T166378 |
[production] |