Hash checking similarities of text
This isn't a new thing, it's probably not even used that much, although it should be. I have a scenario where I'd like to get text, think of news articles from a variety of sources, maybe 4-5 or even 1-200!? and I would like to analyse the text and if certain trigger content is detected then notify me. Such as, a major security breach has happened and it is being reported on multiple cyber security websites and I should action on it pretty fast - now, I don't want to get 1000 alert notifications of the same or similar thing, I would just like to get 1. Or at least less than 10! I was pondering on how to do this and then duck.ai sprang to mind. Why use duck.ai? well, it doesn't slurp what you are doing, it doesn't use any of the data for training, it's also free. So, why not?! I gave it this prompt: If I have multiple sources reporting the same textual data, can you show how to create a hash-based change detection system with python that would identif...