Replies to message #1,085
-
🔎 If you see an alert for analytics.usips.org, this is a self-hosted system I am running as a test. It is GDPR compliant and collects no invasive information.
Programming thread
Well yeah, don't try to actually handle the language that way.
When I was scraping Twitter, just nuking out the IMG elements and a few others like...
Programming thread
Well, fewer than in the days when most pages were done by hand, I'd wager. If you're dealing with a professional site, they'll be running tests...
E
Programming thread
If you want to go down that road then you need a purpose built library like nokogiri or beautiful soup . You can't just feed html into a plain xml...