|
2018-11-29
§
|
| 12:30 |
<jynus> |
run puppet on notebook1004, people1001, rutherfordium to fix failures |
[production] |
| 12:13 |
<dcausse@deploy1001> |
Synchronized dblists/cirrussearch-big-indices.dblist: T210381: [cirrus] multi-instance: add cirrussearch-big-indices.dblist (duration: 00m 53s) |
[production] |
| 12:09 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Use normal config for labswiki (duration: 00m 55s) |
[production] |
| 12:01 |
<banyek> |
repooling labsdb1010 after upgrades - T209517 |
[production] |
| 10:17 |
<elukey> |
remove zookeeper's crontabs from conf100[1-3] to fix cronspam |
[production] |
| 10:16 |
<arturo> |
T209626 icinga downtime labvirt1011 for 1 month to avoid bogus pages |
[production] |
| 10:01 |
<banyek> |
depooling labsdb1010 due of maintenance - T209517 |
[production] |
| 09:55 |
<gehel> |
restarting prometheus-elasticsearch-exporter-9200 on all elastic cirrus nodes |
[production] |
| 09:11 |
<akosiaris> |
increase nofile of process to 20k and maxclients to 15k to account for the backlog of ores scorings |
[production] |
| 08:48 |
<_joe_> |
restarting uwsgi-ores on ores1003 |
[production] |
| 08:04 |
<vgutierrez> |
replacing TLS certificates in gerrit - T207050 |
[production] |
| 06:59 |
<marostegui> |
Stop MySQL on pc1006 to clone pc1009 - T208383 |
[production] |
| 06:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool pc1006 - T208383 (duration: 00m 53s) |
[production] |
| 06:36 |
<marostegui> |
Deploy schema change on db1061 (s6 master) - T202167 |
[production] |
| 06:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1088 T202167 (duration: 00m 53s) |
[production] |
| 06:31 |
<marostegui> |
Deploy schema change on db1088 - T202167 |
[production] |
| 06:31 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 T202167 (duration: 00m 56s) |
[production] |
| 06:15 |
<reedy@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/OATHAuth: revert logging (loldeployingfromaplane) (duration: 00m 59s) |
[production] |
| 06:11 |
<marostegui> |
Deploy schema change on s6 primary master - T86338 |
[production] |
| 04:08 |
<ejegg> |
updated fundraising internal dashboard from 5e9fb9a3ef to 1e4dd2a9ec |
[production] |
| 03:30 |
<ejegg> |
updated payments-wiki from 42283c73d0 to 34250e80b5 |
[production] |
| 00:55 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.6/includes/: Add block notice stats on EditPage (T201718) (duration: 01m 14s) |
[production] |
| 00:08 |
<catrope@deploy1001> |
Synchronized wmf-config/throttle.php: T210681 (duration: 01m 04s) |
[production] |
|
2018-11-28
§
|
| 23:23 |
<tzatziki> |
changing a few passwords for compromised accounts |
[production] |
| 21:35 |
<mutante> |
gnt-instance reboot proton1001.eqiad (stopped working, no SSH) |
[production] |
| 21:28 |
<arlolra> |
Updated Parsoid to 18a98af (T209236, T210437, T184755, T187142, T208470, T207286, T206777, T205710, T205546, T204477) |
[production] |
| 21:26 |
<mutante> |
rebooting proton1002 |
[production] |
| 21:19 |
<herron> |
restarted nagios-nrpe-server on proton1002 |
[production] |
| 21:16 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@9ed8c47]: Updating Parsoid to 18a98af (duration: 09m 35s) |
[production] |
| 21:06 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@9ed8c47]: Updating Parsoid to 18a98af |
[production] |
| 20:41 |
<herron> |
rebooting logstash1005 for security updates |
[production] |
| 20:22 |
<paravoid> |
neodymium: mv /srv/jnt{,.old} (use cumin1001 instead!) |
[production] |
| 19:40 |
<herron> |
rebooting logstash1004 to pick up security updates |
[production] |
| 19:30 |
<ebernhardson> |
start goreplay logging of port 9200 across eqiad elastic cluster to track down T208248 |
[production] |
| 19:05 |
<ejegg> |
updated payments-wiki from 3e0c97a969 to 6552acdc0f |
[production] |
| 18:58 |
<ladsgroup@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/ORES/includes/Hooks/ApiHooksHandler.php: [[gerrit:476334|Don't try to add scores in API where there is nothing to add (T210610)]] (duration: 00m 55s) |
[production] |
| 18:33 |
<thcipriani@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/Wikibase/lib/includes/Formatters/CachingKartographerEmbeddingHandler.php: [[gerrit:476312|Never return null in CachingKartographerEmbeddingHandler::getParserOutput]] T210617 (duration: 00m 53s) |
[production] |
| 18:26 |
<thcipriani@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/EventBus/includes/EventBus.php: SWAT: [[gerrit:476314|Revert "Revert "Revert "Set event datetime with microsecond resolution."""]] T210608 (duration: 00m 55s) |
[production] |
| 17:16 |
<bblack> |
rebooting lvs1006, console was unresponsive |
[production] |
| 17:11 |
<thcipriani@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:476303|Disable classic_entity wbsearchentities AB test]] T209402 T210618 (duration: 00m 55s) |
[production] |
| 17:01 |
<chasemp> |
stat1004:~# aptitude install exfat-fuse exfat-utils (elukey fyi) |
[production] |
| 16:57 |
<mutante> |
restarting gerrit |
[production] |
| 16:54 |
<thcipriani@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/WikimediaIncubator/extension.json: [[gerrit:476304|Revert "Replace wiki with wikipedia as wmf-config has been updated"]] T117023 (duration: 00m 54s) |
[production] |
| 16:53 |
<mutante> |
gerrit about to restart for logging config change |
[production] |
| 16:50 |
<gtirloni> |
T206916 created shnwiki views/index in labsdb replicas |
[production] |
| 15:55 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: T85757: repool db1122 (duration: 00m 53s) |
[production] |
| 15:52 |
<banyek> |
repooling db1122 after schema change (T85757) |
[production] |
| 15:51 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1085 T86338 (duration: 00m 52s) |
[production] |
| 15:49 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki back to 1.33.0-wmf.4 |
[production] |
| 15:24 |
<vgutierrez> |
use a certcentral managed TLS certificate in dumps.wm.o - T207050 |
[production] |