|
2016-10-31
ยง
|
| 20:16 |
<bblack> |
upgrading cache_maps to nginx-1.11.4-1+wmf13 |
[production] |
| 20:15 |
<arlolra> |
starting Parsoid deploy |
[production] |
| 19:17 |
<elukey> |
restarted varnishkafka-webrequest on cp2018 and cp3045 (CRITICALs in icinga, librdkafka errors logged for kafka1018.eqiad.wmnet) |
[production] |
| 19:12 |
<yurik@tin> |
Synchronized wmf-config/InitialiseSettings.php: touch and sync - logs are flooded (duration: 00m 46s) |
[production] |
| 18:55 |
<yurik@tin> |
Synchronized wmf-config: labs syncup https://gerrit.wikimedia.org/r/#/c/318883 (duration: 00m 49s) |
[production] |
| 17:59 |
<ottomata> |
kafka preferred-prelica-election for analytics-eqiad to promote kafka1018 as leader |
[production] |
| 17:27 |
<mark> |
Chris moved cr2-eqiad:xe-5/0/[0-2] and xe-5/1/2 to xe-3/1/[0-3] |
[production] |
| 17:05 |
<chasemp> |
reboot labstore1004 |
[production] |
| 17:00 |
<ottomata> |
kafka preferred replica election on main-eqiad kafka cluster to promote kafka1003 as leader for its preferred partitions |
[production] |
| 15:44 |
<mark> |
Chris moved cr2-eqiad:xe-5/1/[0-3] to xe-3/1/[0-3] |
[production] |
| 15:35 |
<mark> |
Disabled ports cr2-eqiad:xe-5/1/[0-3] (row A-D uplinks) |
[production] |
| 15:28 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2034 for maintenance - T149553 (duration: 00m 46s) |
[production] |
| 15:21 |
<Reedy> |
created oathauth_users table on officewiki T135889 |
[production] |
| 15:17 |
<reedy@tin> |
Synchronized php-1.28.0-wmf.23/extensions/WikimediaMaintenance/createExtensionTables.php: Add OATHAuth (duration: 00m 46s) |
[production] |
| 14:49 |
<ottomata> |
adding kafka1003 in as replicas for active main-eqiad topics |
[production] |
| 14:32 |
<moritzm> |
rebooting labstore2004 for kernel update |
[production] |
| 14:12 |
<moritzm> |
rebooting labstore2003 for kernel update |
[production] |
| 14:12 |
<ottomata> |
adding kafka1003 as kafka broker in main-eqiad cluster |
[production] |
| 14:00 |
<Reedy> |
that deploy was was "Show changes from last 14 days in watchlist in cswiki T148327 " |
[production] |
| 14:00 |
<reedy@tin> |
Synchronized wmf-config/: (no message) (duration: 00m 50s) |
[production] |
| 13:59 |
<moritzm> |
powercycling labnet1002 |
[production] |
| 13:58 |
<reedy@tin> |
Synchronized docroot/noc/: nocnocnoc (duration: 00m 45s) |
[production] |
| 13:57 |
<reedy@tin> |
Synchronized wmf-config/: Remove old ContactPage files (duration: 00m 47s) |
[production] |
| 13:54 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Use MetaContactPages (duration: 00m 48s) |
[production] |
| 13:52 |
<moritzm> |
powercycling labcontrol1002 |
[production] |
| 13:52 |
<reedy@tin> |
Synchronized wmf-config/MetaContactPages.php: Stage new file (duration: 00m 46s) |
[production] |
| 13:46 |
<reedy@tin> |
Synchronized wmf-config/throttle.php: Throttle rule for T149443 (duration: 00m 46s) |
[production] |
| 13:39 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable newusermessage on kkwiki T149563 (duration: 00m 55s) |
[production] |
| 13:35 |
<moritzm> |
rebooting labstore2001 for kernel update |
[production] |
| 13:31 |
<moritzm> |
rebooting labstore1002 for kernel update |
[production] |
| 13:06 |
<moritzm> |
rebooting ganeti1001 for kernel update |
[production] |
| 12:32 |
<bblack> |
upgrading nginx to 1.11.4-1+wmf13 on cache_misc - T148917 |
[production] |
| 12:31 |
<moritzm> |
migrating nodes from ganeti1001 for kernel reboot |
[production] |
| 12:27 |
<moritzm> |
failover ganeti1002 as new master in eqiad |
[production] |
| 12:08 |
<bblack> |
upgrading nginx to 1.11.4-1+wmf13 on cache_upload - T148917 |
[production] |
| 12:07 |
<bblack> |
upgrading nginx to 1.11.4-1+wmf13 on cache_upload |
[production] |
| 11:49 |
<bblack> |
uploaded nginx-1.11.4-1+wmf13 to carbon jessie-wikimedia (logfile spam fixup) |
[production] |
| 11:32 |
<moritzm> |
updating parsoid in codfw to nodejs 4.6.0 |
[production] |
| 11:03 |
<jmm@tin> |
Synchronized wmf-config/ProductionServices.php: Reenabled poolcounter1001 after maintenance (duration: 00m 45s) |
[production] |
| 11:00 |
<elukey> |
restarting cassandra on aqs100[456] for OpenJDK upgrades |
[production] |
| 10:48 |
<moritzm> |
rebooting poolcounter1001 for kernel update |
[production] |
| 10:40 |
<moritzm> |
temporarily disabled poolcounter1001 for maintenance |
[production] |
| 10:40 |
<jmm@tin> |
Synchronized wmf-config/ProductionServices.php: disabled poolcounter1001 for maintenance (duration: 00m 47s) |
[production] |
| 10:08 |
<_joe_> |
uploaded mcrouter 0.24.0-1 to jessie-wikimedia T132317 |
[production] |
| 08:17 |
<moritzm> |
rebooting rdb2* for kernel update |
[production] |
| 07:56 |
<jynus> |
stopping replication on db1057 (s1-master) from codfw for codfw maintenance |
[production] |
| 07:43 |
<elukey> |
powercycled cp2010 (not reachable via ssh, com2 console showed a frozen screen) |
[production] |
| 07:10 |
<marostegui> |
Deploying schema change s1 enwiki codfw (db2016 - master) - T147166 |
[production] |
| 05:04 |
<madhuvishy> |
Upgraded systemd on notebook1002 to 230-7~bpo8+2 from backports |
[production] |
| 04:48 |
<madhuvishy> |
Upgraded systemd notebook1001 to 230-7~bpo8+2 from backports |
[production] |