HI, there.
I just read your job description carefully, and I can help you.
I'm going to work the task using Scrapy.
If we use Scrapy, we could get the result such as csv, json, html format and so on.
Thank you for reading my article.
Best Reguards.
Michael.