Legal and Ethical Responsibilities in Web CrawlingLegal and ethical guidelines for web crawling and best practices