Ishaan Singh Shekhawat

184 Followers
195 Following
73 Posts
Learning and Sharing about all things SEO | Computer Engineer
LinkedInhttps://www.linkedin.com/in/ishaanss/
Bloghttps://www.ishaanss.com/
Twitterhttps://twitter.com/IshaanSEO

Built a Python SEO crawler that anyone can use, even without coding experience!

This custom SEO crawler:
- Discovers all URLs on a website
- Identifies 404 errors and redirect chains
- Extracts meta titles, descriptions, and headings
- Exports everything to a CSV for easy filtering and analysis

The best part? It includes instructions to run it entirely in Google Colab. So, no installation required, no paid subscriptions, and no coding expertise necessary.

Link: https://www.ishaanss.com/custom-python-seo-crawler/

Custom Python SEO Crawler to Automate Website Analysis

Learn how to use a free Python SEO crawler that analyzes all pages on a website and extracts meta tags/headings. No coding experience required!

Ishaan Singh Shekhawat
Holy moly. This is possibly the best article I've read on the topic to date. On why companies need to hire junior engineers. And what you lose now and in the future by not doing so. #webdev #engineering #hiring #tech by @mipsytipsy https://stackoverflow.blog/2024/06/10/generative-ai-is-not-going-to-build-your-engineering-team-for-you/
Generative AI is not going to build your engineering team for you - Stack Overflow

Want to do a log file analysis but don't have access to a paid tool?

I recently created this Step-By-Step Guide To Doing A Log File Analysis Using R, where you don't even need to install anything on your PC to get started - https://www.ishaanss.com/log-file-analysis-using-r/

And yes, you can apply the steps even if you never coded before.

Complete Log File Analysis without Paid SEO Tools using R

Most SEOs are well aware of how a log file analysis is helpful for a website, but only a few can utilize its full potential. And there are 3 significant

Ishaan Singh Shekhawat

More: I find many site owners don't understand that the linking url must be indexed in order for Google to count that link. If the url, or site overall, doesn't resolve, that "spammy" link cannot possibly hurt you. Google's @johnmu has explained several times that a link is between two canonical urls. So again, if you never set up unnatural links, step away from the disavow file.

#google #seo

Google's Algorithms Uncovered: How the Search Engine Works According to Leaked Documents

In this article, we delve into the inner workings of Google, a tool we all use daily but few truly understand. Following the recent leak of documents in an antitrust lawsuit against Google, we have a unique opportunity to explore Google’s algorithms. Some of these algorithms were already known, but what’s interesting is the internal […]

Natzir Turrado
Someone refused to link to my website because it had the word "death" in the domain and they thought Google would flag their website as adult or something.

🤷‍♂️ A Day In The Life Of An SEO🤷‍♂️

#SEOMemes

An old topic but I have a few old sites where I have neglected to add a redirect so both bare and www resolve - which isn't brilliant but these sites are not that important in the scheme of things and don't get much attention from me.

So I have just been checking which ones are favoured in Google SERPs and it is with the www every time! So that's now my preferred option.

I will set up redirects and test but I don't expect to get any lift in traffic!

#seo

I'm putting together a list of all known AI/LLM crawler user-agents. These are the ones we know of so far:

CCBot (Common Crawl)
GoogleOther (Bard)
GPTBot (OpenAI)
ChatGPT-User (ChatGPT plugins)

What other AI/LLM crawler user-agents do you know of?

#seo #llm #ai

For anyone wondering, I changed my hosting server to @digitalocean and am using @cloudflare for CDN.