umputun / tg-spam / 29367402134

84%

master: 84%

Build Type

Pull #428

github

Committed by umputun

Commit Message

feat: detect spam in rich messages (telegram articles)

telegram's client "article" compose type arrives as Message.rich_message
(bot api 10.2) with an empty msg.Text, so its content bypassed every spam
check. flatten rich_message into message.Text in transform() so it flows
through the existing pipeline (stopwords, classifier, llm, prohibited-langs,
locator/duplicate detection).

the library decodes rich_message blocks as generic json (RichBlock/RichText
are `any`), so a recursive walker gathers the visible text spans under
text-bearing keys and drops urls, types and list markers.

Pull Request Pull Request #428: detect spam in rich messages (telegram articles)

Coverage Stats

45 of 45 new or added lines in 1 file covered. (100.0%)

2 existing lines in 1 file now uncovered.

8869 of 10599 relevant lines covered (83.68%)

259.28 hits per line