|
2018-11-05
ยง
|
| 21:09 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: Ensure all wikis on 1.33.0-wmf.2 |
[production] |
| 20:58 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@5b8ad3c]: Update deps, removed sections table, T207904 T206048 T207324 |
[production] |
| 20:38 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@5b8ad3c] (dev-cluster): Update deps, removed sections table (duration: 03m 40s) |
[production] |
| 20:35 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@5b8ad3c] (dev-cluster): Update deps, removed sections table |
[production] |
| 19:53 |
<akosiaris> |
do a depool, scap deploy, scap wikiversions-compile, hhvm restart and then a pool in eqiad mediawiki servers |
[production] |
| 19:50 |
<sbisson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:470868|Disable page issues A/B test (duration: 00m 53s) |
[production] |
| 19:44 |
<sbisson@deploy1001> |
Synchronized php-1.33.0-wmf.2/includes/block/BlockRestriction.php: SWAT: [[gerrit:471094|BlockRestriction::update() unnecessarily does a SELECT on the page table.]] (duration: 01m 00s) |
[production] |
| 19:19 |
<andrewbogott> |
migrating project to eqiad1-r |
[language] |
| 19:19 |
<sbisson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471116|Enable error logging for WikimediaEvents]] (duration: 00m 52s) |
[production] |
| 19:12 |
<sbisson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471072|Enable GrowthExperiments logging channel]] (duration: 00m 53s) |
[production] |
| 18:57 |
<_joe_> |
restarting hhvm on mwdebug1002 |
[production] |
| 18:49 |
<zhuyifei1999_> |
`UPDATE query join query_revision on query.latest_rev_id = query_revision.id join query_run on latest_run_id = query_run.id SET status=1 where (status = 2 or status = 0) and query_run.timestamp <= DATE_ADD(NOW(), INTERVAL -30 MINUTE);` 286 rows affected. |
[quarry] |
| 18:44 |
<godog> |
pool graphite1004 for reads - T196484 |
[production] |
| 18:43 |
<XioNoX> |
delete asw2-b - asw-b interface - T183585 |
[production] |
| 18:43 |
<framawiki> |
migration is over T207677 |
[quarry] |
| 18:41 |
<XioNoX> |
remove asw-b-eqiad from LibreNMS - T183585 |
[production] |
| 18:37 |
<XioNoX> |
remove vrrp priority 70 on cr2-eqiad:ae2 to failback VIPs to cr2 - T183585 |
[production] |
| 18:33 |
<zhuyifei1999_> |
flushed redis with flushall |
[quarry] |
| 18:26 |
<XioNoX> |
re-enable ae2 on cr2-eqiad - T183585 |
[production] |
| 18:22 |
<zhuyifei1999_> |
unset db read-only `SET GLOBAL read_only = 0; UNLOCK TABLES;` T207677 |
[quarry] |
| 18:21 |
<thcipriani> |
rollback mwdebug1001 group2 wikis |
[production] |
| 18:13 |
<thcipriani> |
testing php-1.33.0-wmf.2 on group2 wikis on mwdebug1001 |
[production] |
| 18:05 |
<XioNoX> |
disable ae2 on cr2-eqiad - T183585 |
[production] |
| 18:02 |
<XioNoX> |
set vrrp priority 70 on cr2-eqiad:ae2 to failover VIP to cr1 - T183585 |
[production] |
| 18:01 |
<andrewbogott> |
moving instances from eqiad to eqiad1-r |
[quarry] |
| 17:40 |
<zhuyifei1999_> |
set db read-only `FLUSH TABLES WITH READ LOCK; SET GLOBAL read_only = 1;` T207677 |
[quarry] |
| 17:24 |
<zhuyifei1999_> |
shutting down all workers `sudo kill -TERM $(systemctl show -p MainPID celery-quarry-worker.service | cut -d= -f2)` T207677 |
[quarry] |
| 16:49 |
<XioNoX> |
Update LLDP config on cr3-ulsfo - T208630 |
[production] |
| 16:48 |
<vgutierrez> |
uploaded certcentral 0.5 to apt.wikimedia.org (stretch) - T208572 T208378 |
[production] |
| 16:06 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Setting MCR to read-new on all wikis (T198308) (duration: 00m 55s) |
[production] |
| 13:57 |
<jynus_> |
increase consistency of db2050, dbstore2002 s3 after them catching up replication T208462 |
[production] |
| 13:03 |
<gtirloni> |
killed catbot.py (4GB memory consumption on login host) |
[tools.wdml] |
| 12:59 |
<gtirloni> |
shutdown worker2 and worker3 due to high cpu utilization for a very long time |
[tools.iabot] |
| 12:33 |
<ladsgroup@deploy1001> |
Finished deploy [ores/deploy@096ffb3]: T208577 T181632 T208608 (duration: 22m 58s) |
[production] |
| 12:23 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:23 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471088|Increase wikidata dispatchers to 3]] (duration: 00m 54s) |
[production] |
| 12:16 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:470985|Set wgForeignUploadTargets to [] for zhwiki (T208397)]] (duration: 00m 54s) |
[production] |
| 12:10 |
<ladsgroup@deploy1001> |
Started deploy [ores/deploy@096ffb3]: T208577 T181632 T208608 |
[production] |
| 12:05 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:469027|Revert "Anniversary logo for cswiki" (T207589)]] (duration: 00m 58s) |
[production] |
| 10:20 |
<joal> |
Create hive tables wmf.webrequest_subset and wmf.webrequest_subset_tags |
[analytics] |
| 10:02 |
<joal> |
Start mediawiki-history-wikitext job |
[analytics] |
| 10:02 |
<godog> |
reformat xfs filesystems on ms-be1040 - T199198 |
[production] |
| 09:58 |
<joal> |
create wmf.mediawiki_wikitext_history table |
[analytics] |
| 09:46 |
<joal> |
Alter wmf.pageview_whitelist renaming insertion_ts field to insertion_dt for convention |
[analytics] |
| 09:43 |
<joal> |
restart mediawiki-load oozie bundle to pick new deploy |
[analytics] |
| 09:39 |
<joal> |
Restart mediawiki-history-load oozie job to pick new deploy |
[analytics] |
| 09:37 |
<joal> |
Create table wmf_raw.mediawiki_change_tag |
[analytics] |
| 09:24 |
<joal> |
deploying refinery onto HDFSb |
[analytics] |
| 09:17 |
<elukey@deploy1001> |
Finished deploy [analytics/refinery@9d39efa]: fixing stat1004 (duration: 00m 04s) |
[production] |
| 09:17 |
<elukey@deploy1001> |
Started deploy [analytics/refinery@9d39efa]: fixing stat1004 |
[production] |