1101-1150 of 10000 results (29ms)
2017-07-18 ยง
17:20 <awight@tin> Started deploy [ores/deploy@1d35aa5]: T170485 [production]
17:18 <demon@tin> Finished scap: testwiki to wmf.10 + l10n cache build (duration: 24m 23s) [production]
17:16 <ottomata> stopping kafka broker on kafka1012 to replace disk T168927 [production]
16:53 <demon@tin> Started scap: testwiki to wmf.10 + l10n cache build [production]
16:45 <oblivian@tin> Started deploy [search/MjoLniR@0140aed]: init [production]
16:44 <oblivian@tin> Started deploy [search/MjoLniR@0140aed]: (no justification provided) [production]
16:40 <demon@tin> Pruned MediaWiki: 1.30.0-wmf.7 [keeping static files] (duration: 06m 06s) [production]
16:31 <godog> finish rollout of thumbor 1.1 in eqiad - T170677 [production]
16:00 <marostegui> Deploy alter table on s1 - labsdb1003 - T166204 [production]
15:59 <ema> power-cycle cp2017, stuck rebooting [production]
15:45 <tgr@tin> Synchronized wmf-config/InitialiseSettings.php: T170863 deploy TemplateStyles to some non-content wikis (all target wikis) (duration: 00m 45s) [production]
15:37 <tgr@tin> Finished scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) (forcing; canary errors are unrelated) (duration: 10m 19s) [production]
15:26 <tgr@tin> Started scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) (forcing; canary errors are unrelated) [production]
15:14 <marostegui> Stop MySQL and shutdown pc2006 for mainboard replacement - T170520 [production]
15:08 <tgr@tin> scap failed: RuntimeError scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) (duration: 09m 42s) [production]
15:07 <tgr@tin> scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) [production]
14:58 <tgr@tin> Started scap: T170863 deploy TemplateStyles to some non-content wikis (first step: testwiki/labstestwiki only) [production]
14:55 <godog> upload and roll-upgrade thumbor to 1.1 - T170677 [production]
14:44 <zeljkof> EU SWAT finished! [production]
14:42 <awight@tin> Finished deploy [ores/deploy@1d35aa5]: T170485 (duration: 00m 26s) [production]
14:41 <awight@tin> Started deploy [ores/deploy@1d35aa5]: T170485 [production]
14:39 <zfilipin@tin> Synchronized portals: (no justification provided) (duration: 00m 45s) [production]
14:38 <zfilipin@tin> Synchronized portals/prod/wikipedia.org/assets: (no justification provided) (duration: 00m 44s) [production]
14:37 <moritzm> installing apache updates on silver [production]
14:16 <zfilipin@tin> Synchronized static/images/project-logos/: SWAT: [[gerrit:365948|Make maiwikimedias logo a little bit bigger (T170922)]] (duration: 00m 43s) [production]
14:10 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:365663|New throttle rule (T170844)]] (duration: 00m 43s) [production]
14:07 <zfilipin@tin> Synchronized static/images/project-logos/enwikiquote.png: SWAT: [[gerrit:365409|Update enwikiquotes logo (T170722)]] (duration: 00m 43s) [production]
14:01 <zeljkof> continuing with EU SWAT [production]
13:51 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:365618|Provide HD logos for several Wikiquotes (T150618)]] (duration: 00m 43s) [production]
13:50 <ema> codfw cache_text/upload: upgrade to varnish 4.1.7-1wm1 and reboot for kernel updates [production]
13:48 <zfilipin@tin> Synchronized static/images/project-logos: SWAT: [[gerrit:365618|Provide HD logos for several Wikiquotes (T150618)]] (duration: 00m 44s) [production]
13:19 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 43s) [production]
13:18 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 43s) [production]
13:16 <zfilipin@tin> Synchronized wmf-config/mobile.php: SWAT: [[gerrit:349274|Enable mobile non-JavaScript editing on all MobileFrontend wikis (T125174)]] (duration: 00m 44s) [production]
12:32 <marostegui> Run maintain-views on labsdb1001,1003,1009,1010 and 1011 - T168788 [production]
12:10 <akosiaris> remove oresrdb.svc.eqiad.wmnet in scb1001's /etc/hosts, but do not restart/reload uwsgi-ores and ores-celery-worker [production]
11:56 <akosiaris> add oresrdb.svc.eqiad.wmnet in scb1001's /etc/hosts, restart uwsgi-ores and ores-celery-worker [production]
11:25 <ema> powercycle cp3034, not rebooting properly [production]
11:00 <ema> lvs200[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:59 <ema> lvs200[45] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:54 <ema> lvs400[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:52 <ema> lvs400[34] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:43 <ema> lvs100[12] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:33 <moritzm> rebooting oresrdb1002 for kernel update [production]
10:32 <ema> lvs100[45] upgrade pybal to 1.13.9 T82747 T154759 [production]
10:28 <moritzm> rebooting oresrdb2002 for kernel update [production]
09:54 <ema> esams cache_text/upload: upgrade to varnish 4.1.7-1wm1 and reboot for kernel updates [production]
09:29 <ema> cp3030: upgrade to varnish 4.1.7-1wm1 and reboot for kernel update [production]
09:15 <ema> lvs300[12] upgrade pybal to 1.13.9 T82747 [production]
09:13 <ema> lvs300[34] upgrade pybal to 1.13.9 T82747 [production]