Why your site should have robots.txt & sitemap.xml

Have a website? Want it to get found in search engines? If the answer to these questions is “Yes”, then it’s likely you’ve given search engine optimization (SEO) a go at some point, or at least more than a passing thought. While the impulse when getting started with SEO is often diving headfirst into keyword research and link building (where spelling is super important; you should know the difference between affect and effect, for example), there are some lesser talked about aspects of SEO that are just as important. Namely, two crucial files you should have on your site: robots.txt and sitemap.xml.

Read more

What is my IP address?

All Internet users have likely heard the term “IP address” mentioned on their web surfing travels, but do you know what they are and how they work? In this article, we’ll be looking at these mysterious sets of numbers digital devices need to connect to the Internet, and why they are integral to how the Internet functions.

Read more

What is a bot?

If you use the Internet somewhat regularly, you’ve likely encountered a bot (or several!) at some point, perhaps without even realizing it. If you haven’t, you’re an anomaly because bots are all over the Internet. Literally everywhere. In 2020, bot traffic accounted for nearly 40% of all Internet traffic. They’ll often have their own IP address and everything.

Read more