|
2017-08-03
ยง
|
| 14:48 |
<chasemp> |
remove openstack::clientlib from novaproxy-02 it is not on novaproxy-01. no one is sure why it is there atm. hopefully this doesn't explode. |
[project-proxy] |
| 14:29 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: wikimania2018wiki (duration: 00m 47s) |
[production] |
| 14:28 |
<reedy@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: (no justification provided) |
[production] |
| 14:27 |
<reedy@tin> |
Synchronized dblists: wikimania2018wiki (duration: 00m 47s) |
[production] |
| 14:21 |
<marostegui> |
Restart MySQL on db2019 to get the new socket location updated |
[production] |
| 14:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2045 - T170662 (duration: 00m 46s) |
[production] |
| 14:11 |
<ottomata> |
pausing oozie druid jobs and doing a cluster upgrade/restart again to make sure updated version of mysql-metadata-storage jar is properly loaded |
[analytics] |
| 14:06 |
<marostegui> |
Compress s5 on db2075 - T170662 |
[production] |
| 14:02 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(28|29|30|31|32).eqiad.wmnet |
[production] |
| 14:01 |
<gehel> |
depooling and shutting down elastic10(28|29|30|31|32) - T168816 |
[production] |
| 14:00 |
<marostegui> |
Add db2075 to tendril - T170662 |
[production] |
| 13:44 |
<marostegui> |
Enable gtid back on codfw s4 slaves - T170351 |
[production] |
| 13:35 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Promote db2051 as s4 codfw master - T170351 (duration: 00m 46s) |
[production] |
| 13:28 |
<elukey> |
drop CookieBlock backup tables for T171883 |
[production] |
| 13:26 |
<marostegui> |
Starting the actual s4 codfw failover db2019 -> db2051 - T170351 |
[production] |
| 13:22 |
<gehel> |
banning elastic1032 - T168816 |
[production] |
| 13:19 |
<chasemp> |
disabling puppet acros wmcs things for testing |
[production] |
| 13:14 |
<marostegui> |
Start topology change for s4 in codfw, slaves will be moved under db2051 - T170351 |
[production] |
| 13:10 |
<aude@tin> |
Synchronized php-1.30.0-wmf.12/extensions/Wikidata: Fix bug in InjectRCRecordsJob (duration: 02m 12s) |
[production] |
| 13:01 |
<marostegui> |
Disable gtid on s4 codfw slaves to get ready for the topology change - T170351 |
[production] |
| 12:15 |
<marostegui> |
Restart MySQL on db2051 - T170351 |
[production] |
| 12:02 |
<hashar> |
Added integration-slave-docker-1004 to the pool of jenkins slaves - T150502 |
[releng] |
| 10:21 |
<elukey> |
removed /run/pacct_shadow.d on stat1005 to allow atopacct.service restart |
[production] |
| 10:12 |
<hashar> |
gerrit: marked wikimedia/communications/WP-Victor read-only and [ARCHIVED] - T107430 |
[releng] |
| 10:01 |
<moritzm> |
installing poppler security updates on trusty |
[production] |
| 09:57 |
<_joe_> |
systemctl reset-failed puppetmaster.service on labpuppetmaster1002 |
[production] |
| 09:56 |
<elukey> |
set piwik in maintenance mode to allow mysql updates |
[analytics] |
| 09:52 |
<moritzm> |
installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) |
[production] |
| 09:32 |
<gehel> |
banning elastic103[01] - T168816 |
[production] |
| 08:56 |
<ema> |
upgrading cache_upload to varnish 4.1.8-1wm1 |
[production] |
| 08:36 |
<gehel> |
banning elastic102[89] - T168816 |
[production] |
| 08:35 |
<marostegui> |
Stop MySQL on db2045 to copy its data to db2075 - T170662 |
[production] |
| 08:34 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 08:33 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 08:08 |
<elukey> |
restarted Druid jobs failed over night (drud_loader.py error) and due to Hive metastore restart |
[analytics] |
| 08:03 |
<elukey> |
restart hive-metastore to pick up new JVM Xms settings |
[analytics] |
| 07:58 |
<marostegui> |
Add db2073 and db2074 to tendril - T170662 |
[production] |
| 06:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:01 |
<marostegui> |
Compress s7 on db1102 - T172169 |
[production] |
| 05:57 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) |
[production] |
| 05:27 |
<marostegui> |
Deploy alter table on enwiki - labsdb1010 - T166204 |
[production] |
| 05:17 |
<marostegui> |
Stop replication on labsdb1011 for maintenance - T153743 |
[production] |
| 04:50 |
<SMalyshev> |
update cherry-pick for https://gerrit.wikimedia.org/r/#/c/299825/8 on deployment-puppetmaster02.deployment-prep.eqiad.wmflabs |
[releng] |
| 03:09 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 3 03:09:22 UTC 2017 (duration 7m 18s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 47s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 53s) |
[production] |
| 01:40 |
<twentyafterfour> |
repositories synced for phabricator migration. |
[production] |
| 00:47 |
<bd808> |
tools-bastion-03 not usably responsive to interactive commands; will reboot |
[tools] |
| 00:28 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Simply ores (duration: 00m 47s) |
[production] |