Welcome to amazon-scraper’s documentation!

class app.AmazonScraper(**kwargs)[source]

Hello, this is AmazonScraper!

static get_logger(level=10, verbose=False)[source]

Returns a logger

get_proxies()[source]

Retrieves a list of proxies

static parse_asins_from_file(path)[source]

Reads a list of asins from a file

retrieve_page(asin)[source]

Requests the main product page, saves it, and returns an url for the reviews

retrieve_questions(asin)[source]

Scrapes the questions pages and returns a list of dicts containing questions and respecitive answers

retrieve_reviews(main_reviews_url, review_pages_number)[source]

Collects the review given the url of the reviews page

scrape()[source]

Manages the whole scraping process

scrape_page_questions(asin, page_num, fails, results)[source]

threads to request and scrape a single questions page

scrape_page_reviews(url, fails, results)[source]

threads to request and scrape a single review page

Indices and tables