This means Screaming Frog is allowed to use 512 MB (0.5 GB) of your computer’s RAM. The default number when you first open this file will be “-Xmx512M”. The number located on the second line is the one you’ll need to update. The file is very simple and only includes two lines of information. Then use a text editor like Notepad to open the file named “ScreamingFrogSEOSpider.l4j”. To do this, you’ll first need to open the folder Screaming Frog was downloaded to. Adding more RAM to your computer won’t change how many pages you can crawl until you alert the software it can use more of the available storage. The default setting for Screaming Frog allows it to access 512 MB of RAM. Increase Screaming Frog’s RAM Availability If you’re like me and you always have an assortment of programs running simultaneously while also bouncing back-and-forth between 1,000 different Chrome tabs you’ll be pleasantly surprised by the improvement in day-to-day computer speed. The best part about increasing RAM is it enhances more than just your ability to crawl websites. You may want to perform a quick search on YouTube for your computer model + “RAM Upgrade” to find a tutorial for how to perform the process in case there are specific nuances with your computer. All you do is pop off the back of the computer and slide the RAM cards into the available slots. Installing RAM usually takes about 30 seconds. Once you know how much RAM you can add make sure you purchase RAM cards that are compatible with your computer. You’ll need to do a little research on how much RAM your computer can hold since it ranges anywhere from 4 GB to over 64 GB. For most computers an 8 GB memory card costs around $50. The good news is RAM has become extremely inexpensive. The more RAM your computer has the more pages you can crawl. The Screaming Frog software relies on RAM for holding data during a website crawl. This step is optional but extremely recommended. The following is a tutorial for how to setup Screaming Frog to crawl very large websites. Taking on a website this size requires a handful of important tweaks to Screaming Frog’s configurations. The website pictured has over 3 million indexed pages which makes crawling it a challenge to say the least. Screaming Frog’s default setup is great for tackling websites with less than 10,000 pages but what do you do when you run into a website like the one below? There are many more things you can do once you get a full understanding of Screaming Frog’s capabilities. Find missing meta content and alt attributesĪgain, this is just a small list of the potential uses for crawling a website.Find broken links (internal and external). Verify Google Analytics is located on every page. Perform QA for 301 redirect implementations.Create a list of all URLs/pages on a website.Below are a few of the uses I find particularly helpful. There are many different things you can accomplish using Screaming Frog. What are the reasons for crawling a website? Through the years I’ve evaluated many other options but I’ve yet to find one that truly competes when all considerations are factored in. The software is inexpensive, easy to use, and extremely versatile. My personal tool of choice for crawling a website is Screaming Frog. Crawling a website can provide crucial information about potential issues and possible areas of improvement. One of the very first steps when conducting an SEO audit or preparing for a website redesign is “crawling” (aka “scraping”) the website.
0 Comments
Leave a Reply. |