Call us Today
(888) 846-4937
Email us Today
info@destinymarketingsolutions.com
Call us Today
(888) 846-4937
Email us Today
info@destinymarketingsolutions.com
[00:00:00] Good morning Leonard Parker here. In this video. I'm going to provide a response to a question that came in on quora about SEO spiders. And how do they work? Well SEO spider in a nutshell is the computers that Google and other search engine companies have in a use these computers to crawl your website. So just taking Google for example, Google's [00:00:30] goal is to provide the best information for your search query as possible. And so the way that the search engine finds information and more importantly finds new information is vads SEO spiders or these computers that are reviewing the common phrases crawling your website. So those are what SEO spiders are and they're used to find new content or let's say if you rotate
[00:01:00] Blog article two years ago and then this week you finally got around to updating it. It helps these SEL spiders help Google and other search engines find updated content and it's really the first step when it comes to improving your search engine rankings and your overall organic visibility. So first step is to make sure that your your website is crawlable now to do that. There's a few options first. You [00:01:30] should set up Google search console for your website and this will allow you to view any credibility errors that are going on with your website or any obstacles that's preventing the SEO spiders from curling your website in an efficient manner. So some common issues you might have pages that are marked as no index, but they should be indexed index simply means that
[00:02:00] Eligible to show up in Google and Google search results other issues. Maybe you have a broken link. Maybe you updated the URL and wasn't aware that the URL was updated. And now you have a broken Link in Google and the Google index redirect issues can also provide an issue with redirect with crawling and block SEL spiders from doing their work. Now, [00:02:30] other than that, so let's say once you get Google Search console setup for your website. You also want to make sure that you submit a sitemap for your site and a robots.txt file for your site. And before you submit those to Google you want to make sure that your site map is formatted correctly and it's put together correctly. And if you're not let's identical SEO. I highly recommend using yoast SEO and WordPress
[00:03:00] Um, there are some negative things about co co but as far as something as beginner level as setting up the site map for your site, it's a great option and it will pretty much take care of it for you. And really the sitemap is kind of like a directory to your website. So includes all of the folders all of the pages that are on your website now your robots dot txt file on the other hand gives the search spiders the search [00:03:30] SEO spiders instructions on how to crawl your website. So a common issue like I mentioned before is that end our robust dots text file, you might have all the pages on your site marked as no index and it's been three years and you're wondering why none of your pages are showing up in Google. There are also cases where you might now want a particular page on your site to be available to the general public. So maybe if you're offering a discount based
On [00:04:00] a certain Association or sodium certain affiliation with another company or another organization. You might want that patient only be available to members of that organization and that case you will want to know index that page and I will tell Google and the search Fighters. Hey this page exists by don't want it to show up in the Google search results. And so that's pretty much will pretty much take care of 80% of what you need to know as far [00:04:30] as making your website as efficient as possible to crawl for SEO spiders. Now if you want to troubleshoot issues, there is a free tool called screaming frog SEO and it's free up to if your page I believe has 500 URLs which for most small to medium-sized businesses will should be sufficient and it will identify any issues or broken links identify any issues with redirection.
And [00:05:00] so basically you're redirecting old URL to the new URL but there's some issue in between that redirection and one other thing. This is where I'll close. The video is that you can also look at the internal links for your site. So internal links are very important for SEO and it's a great way to get your newer Pages indexed faster and get them seen by the seo spiders. [00:05:30] So typically when you're building internal links on your website, of course, you want to make sure that let's say we have a page about depression that you only link to pages that are related to that General category. So either that's external links, which I'm not going to talk about here or internal links which are links to other pages on your site and you want to make sure that those are relevant and typically the way you want this to flow.
I don't have [00:06:00] my my whiteboard up here. But you basically want to take the pages on your site to have the most backlinks. So other sites linking to it, so usually that's going to be your homepage or your main your most popular blog Pages. You want to take those pages and then link do it internal links to your more popular Pages or your less popular pages that aren't getting as many or any backlinks at all or not is getting [00:06:30] as much traffic and that's really how you can improve the visibility for those pages because you're linking to them from higher authority pages on your website while also making them easier to find for SEO spiders. So hope this video has been helpful. There's a ton of information out there. I'll share a few resources here in the here in the description. But if you do have any questions, feel free to reach out we can help sort out. What issues your website Maybe.
Maybe having with [00:07:00] the SEO spiders. Thanks and have a great rest of your day.