|
2018-11-29
§
|
| 17:02 |
<robh> |
decom of labvirt101[01] continuing |
[production] |
| 16:10 |
<anomie@mwmaint1002> |
Running Wikibase/populateSitesTable.php and cleanupUsersWithNoId.php on more wiktionaries, incubatorwiki, and sourceswiki for T210732 |
[production] |
| 15:54 |
<papaul> |
shutting down ms-be2047 for maintenance |
[production] |
| 15:35 |
<gtirloni> |
T196507 downtimed and powercycled cloudvirt1019 |
[production] |
| 15:32 |
<anomie@mwmaint1002> |
Running Wikibase/populateSitesTable.php and cleanupUsersWithNoId.php on several other wiktionaries for T210732 |
[production] |
| 15:29 |
<gehel> |
activating multiple elasticsearch instances on cirrus / eqiad - T207918 |
[production] |
| 15:18 |
<$WHO> |
Running Wikibase populateSitesTable.php on eswiktionary for T210732 |
[production] |
| 14:31 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: Revert all wikis to 1.33.0-wmf.6 |
[production] |
| 14:29 |
<hashar@deploy1001> |
scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 14:17 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.6 |
[production] |
| 14:10 |
<hashar> |
test stashbot |
[production] |
| 14:05 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki to 1.33.0-wmf.6 |
[production] |
| 14:03 |
<moritzm> |
uploaded nodejs 6.11.0~dfsg-1+wmf3 to apt.wikimedia.org/stretch-wikimedia (backporting the current security fixes) |
[production] |
| 13:45 |
<hashar@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/Wikibase: feature flag for globe coordinator formatter using kartographer - T184933 T210617 (duration: 01m 18s) |
[production] |
| 13:40 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Clarify parsercache keys section (duration: 00m 53s) |
[production] |
| 13:39 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Clarify parsercache keys section (duration: 00m 52s) |
[production] |
| 13:17 |
<moritzm> |
rebooting certcentral1001 to pick up SSBD-enabled qemu/kernel update |
[production] |
| 13:14 |
<moritzm> |
rebooting certcentral2001 to pick up SSBD-enabled qemu/kernel update |
[production] |
| 13:12 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Pool pc1009 in pc3 - T208383 (duration: 00m 53s) |
[production] |
| 13:05 |
<marostegui> |
Upgrade pc3 tendril topology - T208383 |
[production] |
| 13:00 |
<mobrovac@deploy1001> |
Started restart [eventstreams/deploy@07033d4]: Restart ES on scb1004 due to possible memory leak (again) |
[production] |
| 12:49 |
<dcausse> |
EU swat done |
[production] |
| 12:48 |
<dcausse@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/TwoColConflict/: Fix unescaped HTML injected into conflict resolution interface (duration: 00m 53s) |
[production] |
| 12:30 |
<jynus> |
run puppet on notebook1004, people1001, rutherfordium to fix failures |
[production] |
| 12:13 |
<dcausse@deploy1001> |
Synchronized dblists/cirrussearch-big-indices.dblist: T210381: [cirrus] multi-instance: add cirrussearch-big-indices.dblist (duration: 00m 53s) |
[production] |
| 12:09 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Use normal config for labswiki (duration: 00m 55s) |
[production] |
| 12:01 |
<banyek> |
repooling labsdb1010 after upgrades - T209517 |
[production] |
| 10:17 |
<elukey> |
remove zookeeper's crontabs from conf100[1-3] to fix cronspam |
[production] |
| 10:16 |
<arturo> |
T209626 icinga downtime labvirt1011 for 1 month to avoid bogus pages |
[production] |
| 10:01 |
<banyek> |
depooling labsdb1010 due of maintenance - T209517 |
[production] |
| 09:55 |
<gehel> |
restarting prometheus-elasticsearch-exporter-9200 on all elastic cirrus nodes |
[production] |
| 09:11 |
<akosiaris> |
increase nofile of process to 20k and maxclients to 15k to account for the backlog of ores scorings |
[production] |
| 08:48 |
<_joe_> |
restarting uwsgi-ores on ores1003 |
[production] |
| 08:04 |
<vgutierrez> |
replacing TLS certificates in gerrit - T207050 |
[production] |
| 06:59 |
<marostegui> |
Stop MySQL on pc1006 to clone pc1009 - T208383 |
[production] |
| 06:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool pc1006 - T208383 (duration: 00m 53s) |
[production] |
| 06:36 |
<marostegui> |
Deploy schema change on db1061 (s6 master) - T202167 |
[production] |
| 06:35 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1088 T202167 (duration: 00m 53s) |
[production] |
| 06:31 |
<marostegui> |
Deploy schema change on db1088 - T202167 |
[production] |
| 06:31 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 T202167 (duration: 00m 56s) |
[production] |
| 06:15 |
<reedy@deploy1001> |
Synchronized php-1.33.0-wmf.6/extensions/OATHAuth: revert logging (loldeployingfromaplane) (duration: 00m 59s) |
[production] |
| 06:11 |
<marostegui> |
Deploy schema change on s6 primary master - T86338 |
[production] |
| 04:08 |
<ejegg> |
updated fundraising internal dashboard from 5e9fb9a3ef to 1e4dd2a9ec |
[production] |
| 03:30 |
<ejegg> |
updated payments-wiki from 42283c73d0 to 34250e80b5 |
[production] |
| 00:55 |
<catrope@deploy1001> |
Synchronized php-1.33.0-wmf.6/includes/: Add block notice stats on EditPage (T201718) (duration: 01m 14s) |
[production] |
| 00:08 |
<catrope@deploy1001> |
Synchronized wmf-config/throttle.php: T210681 (duration: 01m 04s) |
[production] |