|
2017-08-03
§
|
| 14:21 |
<marostegui> |
Restart MySQL on db2019 to get the new socket location updated |
[production] |
| 14:19 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2045 - T170662 (duration: 00m 46s) |
[production] |
| 14:06 |
<marostegui> |
Compress s5 on db2075 - T170662 |
[production] |
| 14:02 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(28|29|30|31|32).eqiad.wmnet |
[production] |
| 14:01 |
<gehel> |
depooling and shutting down elastic10(28|29|30|31|32) - T168816 |
[production] |
| 14:00 |
<marostegui> |
Add db2075 to tendril - T170662 |
[production] |
| 13:44 |
<marostegui> |
Enable gtid back on codfw s4 slaves - T170351 |
[production] |
| 13:35 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Promote db2051 as s4 codfw master - T170351 (duration: 00m 46s) |
[production] |
| 13:28 |
<elukey> |
drop CookieBlock backup tables for T171883 |
[production] |
| 13:26 |
<marostegui> |
Starting the actual s4 codfw failover db2019 -> db2051 - T170351 |
[production] |
| 13:22 |
<gehel> |
banning elastic1032 - T168816 |
[production] |
| 13:19 |
<chasemp> |
disabling puppet acros wmcs things for testing |
[production] |
| 13:14 |
<marostegui> |
Start topology change for s4 in codfw, slaves will be moved under db2051 - T170351 |
[production] |
| 13:10 |
<aude@tin> |
Synchronized php-1.30.0-wmf.12/extensions/Wikidata: Fix bug in InjectRCRecordsJob (duration: 02m 12s) |
[production] |
| 13:01 |
<marostegui> |
Disable gtid on s4 codfw slaves to get ready for the topology change - T170351 |
[production] |
| 12:15 |
<marostegui> |
Restart MySQL on db2051 - T170351 |
[production] |
| 10:21 |
<elukey> |
removed /run/pacct_shadow.d on stat1005 to allow atopacct.service restart |
[production] |
| 10:01 |
<moritzm> |
installing poppler security updates on trusty |
[production] |
| 09:57 |
<_joe_> |
systemctl reset-failed puppetmaster.service on labpuppetmaster1002 |
[production] |
| 09:52 |
<moritzm> |
installing mysql 5.5 security updates (package as shipped by Debian jessie, not our internal wmf-mariadb package) |
[production] |
| 09:32 |
<gehel> |
banning elastic103[01] - T168816 |
[production] |
| 08:56 |
<ema> |
upgrading cache_upload to varnish 4.1.8-1wm1 |
[production] |
| 08:36 |
<gehel> |
banning elastic102[89] - T168816 |
[production] |
| 08:35 |
<marostegui> |
Stop MySQL on db2045 to copy its data to db2075 - T170662 |
[production] |
| 08:34 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 08:33 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db2045 - T170662 (duration: 00m 47s) |
[production] |
| 07:58 |
<marostegui> |
Add db2073 and db2074 to tendril - T170662 |
[production] |
| 06:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add db2074 to s3 - T170662 (duration: 00m 46s) |
[production] |
| 06:01 |
<marostegui> |
Compress s7 on db1102 - T172169 |
[production] |
| 05:57 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2051 - T170351 (duration: 00m 54s) |
[production] |
| 05:27 |
<marostegui> |
Deploy alter table on enwiki - labsdb1010 - T166204 |
[production] |
| 05:17 |
<marostegui> |
Stop replication on labsdb1011 for maintenance - T153743 |
[production] |
| 03:09 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Aug 3 03:09:22 UTC 2017 (duration 7m 18s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 47s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 53s) |
[production] |
| 01:40 |
<twentyafterfour> |
repositories synced for phabricator migration. |
[production] |
| 00:28 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Simply ores (duration: 00m 47s) |
[production] |
| 00:26 |
<twentyafterfour> |
scheduled downtime for phabricator migration |
[production] |
| 00:12 |
<mutante> |
phab1001 starting ferm service |
[production] |
| 00:11 |
<mutante> |
iridium restarted ferm - rsync fragment was in config but not applied, breaking data rsync to phab1001 |
[production] |
| 00:05 |
<mutante> |
rsyncing /srv/repos from iridium to phab1001 (T163938) |
[production] |