This task is directly related to and will encompass #52, the solution for that no longer works, and I have finally gotten to trying to resolve it.
Problem
Due to anti-bot prevention, sites like lightnovelworld.com who use service like cloudflare no will result in a 403 Forbidden error when trying to reach their sites using HttpClient calls. The goal of this task is to resolve this and allow for continued scraping.
This task is directly related to and will encompass #52, the solution for that no longer works, and I have finally gotten to trying to resolve it.
Problem
Due to anti-bot prevention, sites like
lightnovelworld.comwho use service like cloudflare no will result in a 403 Forbidden error when trying to reach their sites using HttpClient calls. The goal of this task is to resolve this and allow for continued scraping.