{"id":5087,"date":"2015-06-19T22:26:49","date_gmt":"2015-06-19T20:26:49","guid":{"rendered":"http:\/\/www.hanshafner.de\/blog\/?p=5087"},"modified":"2015-06-20T11:32:04","modified_gmt":"2015-06-20T09:32:04","slug":"yacy-on-the-banana-pi-reducing-cpu-load","status":"publish","type":"post","link":"https:\/\/www.hanshafner.de\/blog\/2015\/06\/19\/yacy-on-the-banana-pi-reducing-cpu-load\/","title":{"rendered":"Yacy on the Banana Pi &#8211; reducing CPU-load"},"content":{"rendered":"<p>I&#8217;ve spent the last week on trying to get <a href=\"http:\/\/yacy.net\/en\/index.html\" target=\"_blank\">YaCy<\/a> working on my <a href=\"http:\/\/lemaker.org\" target=\"_blank\">Banana Pi<\/a>. If you don&#8217;t know what YaCy is, please read up on it because projects like YaCy are going to be important in the future!<\/p>\n<p>The problem I was having was that the Banana Pi just kept turning itself off and none of the logs made any sense to me. Then it hit me: it is probably just getting too hot.<\/p>\n<p>I&#8217;m running\u00a0Linux 3.4.104-bananian on armv7l on the original Banana Pi. It&#8217;s the smallest and quickest distribution I&#8217;ve found.<\/p>\n<p>When researching about tuning YaCys performance most of the articles were dealing with increasing YaCys performance and using every last CPU cycle it can.<\/p>\n<p>So I had to dig a little deeper and unfortunately, the performance settings page isn&#8217;t well documented. At least not for an amateur like myself.<\/p>\n<p><a href=\"http:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\" size-medium wp-image-5089 aligncenter\" src=\"http:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes-640x386.jpg\" alt=\"YaCy Performance Settings of Queues and Processes\" width=\"640\" height=\"386\" srcset=\"https:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes-640x386.jpg 640w, https:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes-785x473.jpg 785w, https:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes-900x543.jpg 900w, https:\/\/www.hanshafner.de\/blog\/wp-content\/uploads\/2015\/06\/YaCy-Performance-Settings-of-Queues-and-Processes.jpg 1516w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p>The most important settings that worked for me in order to reduce the CPU-load when running the YaCy\u00a0crawlers are:<\/p>\n<p><strong>PPM<\/strong> &#8211; this one is set to 6000 when installing YaCy. I&#8217;ve tried setting that to half then to a quarter etc. etc. But really I had to go all the way down to 15 pages per minute. This setting is on the <strong>Crawler Monitor<\/strong> page. It will obviously take _a lot_ longer to index a site and I will see in a couple of weeks how well this holds up for the pages I&#8217;m indexing.<\/p>\n<p>Adjusting the settings on the &#8220;Performance Settings&#8221; page (see screenshot above) helped to reduce CPU load. This was the part that was not quite clear and there are so many parameters that I was scared I was going to break something. Alas, the BPi is now running since 2 hours and the temperature hovers around 44\u00ba C. This is the command to see the temperature:<\/p>\n<blockquote><p>cat \/sys\/devices\/platform\/sunxi-i2c.0\/i2c-0\/0-0034\/temp1_input<\/p><\/blockquote>\n<p>The main reason for me to run YaCy at all is, that I wanted it to only index a few webpages that I regularly need to research. This way I can get pretty clean results without having to deal with content farm and SEOed websites. And I can even access it when I&#8217;m out of the house. Although the speed obviously isn&#8217;t really that great.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve spent the last week on trying to get YaCy working on my Banana Pi. If you don&#8217;t know what YaCy is, please read up on it because projects like YaCy are going to be important in the future! The problem I was having was that the Banana Pi just kept turning itself off and [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[174],"tags":[217,215,216],"class_list":["post-5087","post","type-post","status-publish","format-standard","hentry","category-lifestream","tag-banana-pi","tag-linux","tag-raspberry-pi"],"_links":{"self":[{"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/posts\/5087","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/comments?post=5087"}],"version-history":[{"count":3,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/posts\/5087\/revisions"}],"predecessor-version":[{"id":5091,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/posts\/5087\/revisions\/5091"}],"wp:attachment":[{"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/media?parent=5087"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/categories?post=5087"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hanshafner.de\/blog\/wp-json\/wp\/v2\/tags?post=5087"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}