351-400 of 10000 results (38ms)
2017-07-18 ยง
15:37 <tgr@tin> Finished scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) (forcing; canary errors are unrelated) (duration: 10m 19s) [production]
15:26 <tgr@tin> Started scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) (forcing; canary errors are unrelated) [production]
15:14 <marostegui> Stop MySQL and shutdown pc2006 for mainboard replacement - T170520 [production]
15:08 <tgr@tin> scap failed: RuntimeError scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) (duration: 09m 42s) [production]
15:07 <tgr@tin> scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) [production]
14:58 <tgr@tin> Started scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) [production]
14:55 <godog> upload and roll-upgrade thumbor to 1.1 - T170677 [production]
14:44 <zeljkof> EU SWAT finished! [production]
14:42 <awight@tin> Finished deploy [ores/deploy@1d35aa5]: T170485 (duration: 00m 26s) [production]
14:41 <awight@tin> Started deploy [ores/deploy@1d35aa5]: T170485 [production]
14:39 <zfilipin@tin> Synchronized portals: (no justification provided) (duration: 00m 45s) [production]
14:38 <zfilipin@tin> Synchronized portals/prod/wikipedia.org/assets: (no justification provided) (duration: 00m 44s) [production]
14:37 <moritzm> installing apache updates on silver [production]
14:16 <zfilipin@tin> Synchronized static/images/project-logos/: SWAT: [[gerrit:365948|Make maiwikimedias logo a little bit bigger (T170922)]] (duration: 00m 43s) [production]
14:10 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:365663|New throttle rule (T170844)]] (duration: 00m 43s) [production]
14:07 <zfilipin@tin> Synchronized static/images/project-logos/enwikiquote.png: SWAT: [[gerrit:365409|Update enwikiquotes logo (T170722)]] (duration: 00m 43s) [production]
14:01 <zeljkof> continuing with EU SWAT [production]
13:51 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:365618|Provide HD logos for several Wikiquotes (T150618)]] (duration: 00m 43s) [production]
13:50 <ema> codfw cache_text/upload: upgrade to varnish 4.1.7-1wm1 and reboot for kernel updates [production]
13:48 <zfilipin@tin> Synchronized static/images/project-logos: SWAT: [[gerrit:365618|Provide HD logos for several Wikiquotes (T150618)]] (duration: 00m 44s) [production]
13:19 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 43s) [production]
13:18 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 43s) [production]
13:16 <zfilipin@tin> Synchronized wmf-config/mobile.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 44s) [production]
12:32 <marostegui> Run maintain-views on labsdb1001,1003,1009,1010 and 1011 - T168788 [production]
12:10 <akosiaris> remove oresrdb.svc.eqiad.wmnet in scb1001's /etc/hosts, but do not restart/reload uwsgi-ores and ores-celery-worker [production]
11:56 <akosiaris> add oresrdb.svc.eqiad.wmnet in scb1001's /etc/hosts, restart uwsgi-ores and ores-celery-worker [production]
11:25 <ema> powercycle cp3034, not rebooting properly [production]
11:00 <ema> lvs200[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:59 <ema> lvs200[45] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:54 <ema> lvs400[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:52 <ema> lvs400[34] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:43 <ema> lvs100[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:33 <moritzm> rebooting oresrdb1002 for kernel update [production]
10:32 <ema> lvs100[45] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:28 <moritzm> rebooting oresrdb2002 for kernel update [production]
09:54 <ema> esams cache_text/upload: upgrade to varnish 4.1.7-1wm1 and reboot for kernel updates [production]
09:29 <ema> cp3030: upgrade to varnish 4.1.7-1wm1 and reboot for kernel update [production]
09:15 <ema> lvs300[12] upgrade pybal to 1.13.9 T82747 [production]
09:13 <ema> lvs300[34] upgrade pybal to 1.13.9 T82747 [production]
09:08 <elukey> reboot conf1003 for kernel updates [production]
09:00 <elukey> reboot conf1002 for kernel updates [production]
07:52 <moritzm> upgrade wtp1001 to nodejs 6.11 [production]
07:32 <elukey> moved /home to /srv/home on stat1006 to free disk space (created symling from /home -> /srv/home too) - T152712 [production]
06:42 <moritzm> upgrading restbase on the various test clusters to nodejs 6.11 [production]
05:59 <marostegui> Deploy alter table on s1 - db1065 - T166204 [production]
05:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T166204 (duration: 00m 43s) [production]
05:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 - T166204 (duration: 00m 44s) [production]
04:22 <Jamesofur> remove 2FA from NativeForeigner per T170911 [production]
02:45 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Jul 18 02:45:25 UTC 2017 (duration 6m 36s) [production]
02:38 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.9) (duration: 13m 25s) [production]