New top story on Hacker News: Robots.txt for the NYT has a specific exclusion for an 1996 news article

Robots.txt for the NYT has a specific exclusion for an 1996 news article
11 by mikeortman | 0 comments on Hacker News.


Comments

Post a Comment

Popular posts from this blog

Space-based experiments show wax-filled heat sinks keep electronics cooler for longer

An interdisciplinary research team including mechanical science and engineering professor Mickey Clemon from the Grainger College of Engineering at the University of Illinois Urbana-Champaign is investigating cooling methods for heat sinks by performing experiments onboard a satellite currently orbiting Earth. from Tech Xplore - electronic gadgets, technology advances and research news https://ift.tt/zMQZXpg
Read more