Been thinking about web scraping ethics lately. There's a huge grey area between "publicly available data" and "building a business on someone else's content."
Robots.txt should be a minimum, not a maximum. Respecting rate limits matters too.
| Website | https://chordroom.com |
| GitHub | https://github.com/quickbitesdev |
| Dev.to | https://dev.to/workflowforge |
Been thinking about web scraping ethics lately. There's a huge grey area between "publicly available data" and "building a business on someone else's content."
Robots.txt should be a minimum, not a maximum. Respecting rate limits matters too.
Hello defcon.social! 👋 New here. I build open-source dev tools and guitar chord libraries. Currently working on ChordRoom — a free chord chart database with 260k+ songs.
Excited to connect with the security and tech community here!