Search engines which include Google, Yahoo and Bing use robots and algorithms to index your website and rank them against other sites.
These algorithms are designed with one thing in mind: to offer the user the most relevant and optimal experience. Simply put, it’s about providing the best experience possible.