2017-06-19
§
|
17:42 |
<ejegg> |
updated fundraising tools from 585f546aa0c092ccd938a9a01b4bc3eb7662804d to 457bddb843f69867f24cd072ede1f6733d59c853 |
[production] |
17:21 |
<moritzm> |
installing exim4 security updates |
[production] |
15:48 |
<moritzm> |
uploaded linux-meta_1.13 to apt.wikimedia.org (with this update the linux-meta package now also defaults to 4.9 (previously 4.4)) |
[production] |
15:47 |
<moritzm> |
uploaded linux_4.9.25-1~bpo8+3 to apt.wikimedia.org |
[production] |
15:25 |
<volans> |
installed python-setuptools-scm on copper |
[production] |
15:16 |
<marostegui> |
Deploy alter table labsdb1009 - T166207 |
[production] |
15:12 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=chlorine.eqiad.wmnet |
[production] |
15:03 |
<mobrovac> |
restbase restbase2001 is out of rotation, performing experiments with the new cassandra driver v3.2.2 which seems to be causing problems only in production |
[production] |
14:59 |
<godog> |
cold reset ms-be1013 drac |
[production] |
14:53 |
<gehel> |
pausing cluster restart of elasticsearch eqiad |
[production] |
14:24 |
<godog> |
roll-upgrade swift to 2.10 on ms-be10[22-30] - T162609 |
[production] |
14:08 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1070 - T153743 (duration: 00m 41s) |
[production] |
14:06 |
<gehel> |
starting cluster restart on elasticsearch / cirrus / eqiad for ltr plugin deployment |
[production] |
14:01 |
<gehel> |
restarting elasticsearch / relforge for ltr plugin deployment |
[production] |
13:58 |
<gehel> |
remove decommissioned nodes from redis / trebuchet for elasticsearch/plugins |
[production] |
13:48 |
<gehel> |
deploying latest elasticsearch plugin (ltr plugin) |
[production] |
13:48 |
<moritzm> |
fixing salt minion setup on wtp1047 |
[production] |
13:44 |
<hashar> |
European SWAT completed |
[production] |
13:44 |
<aude@tin> |
Synchronized wmf-config/Wikibase.php: Remove old constraints section config (duration: 00m 41s) |
[production] |
13:42 |
<aude@tin> |
Synchronized wmf-config/Wikibase-production.php: Add constraints section to property pages on test.wikidata (duration: 00m 41s) |
[production] |
13:29 |
<dcausse@tin> |
Synchronized wmf-config/InitialiseSettings.php: [cleanup] remove old interwiki search config (duration: 00m 41s) |
[production] |
13:28 |
<dcausse@tin> |
Synchronized wmf-config/CirrusSearch-labs.php: [cleanup] remove old interwiki search config (duration: 00m 41s) |
[production] |
13:21 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable OOjs UI buttons on EditPage for plwiki - T162849 (duration: 00m 42s) |
[production] |
13:08 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add sandbox link for dtywiki - T168038 (duration: 00m 42s) |
[production] |
12:54 |
<dcausse> |
restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin |
[production] |
12:36 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=chlorine.eqiad.wmnet |
[production] |
12:04 |
<elukey> |
run 'echo "autoLearnMode=1" > /tmp/disable_learn && megacli -AdpBbuCmd -SetBbuProperties -f /tmp/disable_learn -a0' on all the analytics workers to disable BBU Auto learn - T167809 |
[production] |
11:33 |
<marostegui> |
Rename user Smuconlaw → Sgconlaw - T168109 |
[production] |
11:31 |
<jynus> |
restarting replication on dbstore1002:s3 and db1015 |
[production] |
11:19 |
<moritzm> |
rebooting cp3007 for kernel update |
[production] |
11:01 |
<_joe_> |
depooling mw1170-mw1179 for decommissioning, T168271 |
[production] |
10:15 |
<godog> |
roll-upgrade swift to 2.10 on to ms-fe1* - T162609 |
[production] |
09:56 |
<akosiaris> |
migrate neon.eqiad.wmnet to ganeti01.svc.eqiad.wmnet's row_A nodegroup |
[production] |
09:55 |
<dcausse> |
restarting elasticsearch on relforge1* to pickup new snapshot of the ltr plugin |
[production] |
09:33 |
<jynus> |
temporarily stop dbstore1002:s3 and db1015 to fix srwiki |
[production] |
09:30 |
<marostegui> |
Deploy alter table on s2 - dbstore1001 - T166205 |
[production] |
09:18 |
<godog> |
swift eqiad-prod: remove ms-be1001 - ms-be1012 - T166489 |
[production] |
09:13 |
<paravoid> |
rebooting achernar to address CPU throttling and apply the BIOS update |
[production] |
09:11 |
<paravoid> |
upgrading achernar's BIOS from 1.2.4 to 2.4.2 hoping it will address recurring CPU throttling issue (T162850) |
[production] |
09:07 |
<akosiaris> |
restart ircecho on einsteinium, was not notifying due to a thrown exception |
[production] |
08:35 |
<marostegui> |
Drop table title key from s2 - T164949 |
[production] |
08:16 |
<marostegui> |
Drop table titlekey on s6 - T164949 |
[production] |
07:59 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool pc2004,5,6 after maintenance (duration: 00m 41s) |
[production] |
07:42 |
<moritzm> |
restarting app server canaries to pick up gnutls update |
[production] |
07:13 |
<marostegui> |
Reboot ms-be1010 |
[production] |
07:10 |
<marostegui> |
Deploy alter table s5 - codfw master - db2023 (and will replicate) so this will generate lag on codfw slaves - T166207 |
[production] |
07:09 |
<jynus> |
upgrade, reboot and clear data on pc2006 |
[production] |
07:05 |
<jynus> |
upgrade, reboot and clear data on pc2005 |
[production] |
07:03 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Depool pc2005 & pc2006 (duration: 00m 41s) |
[production] |
06:58 |
<moritzm> |
installing gnutls security updates |
[production] |