HuaweiCrawler.core package¶

Submodules¶

HuaweiCrawler.core.core module¶

core

example:

In the Docker Image quanpan302/huawei-crawler:

scrapy startproject tutorial

scrapy runspider /notebooks/src/HuaweiCrawler/core/core.py -o mobile.csv -t csv

class HuaweiCrawler.core.core.TmobileSpider(name=None, **kwargs)[source]¶

Bases: scrapy.spiders.Spider

fieldnames = ['url', 'name']¶

file_name = <_io.TextIOWrapper name='tmobile_spider.csv' mode='w' encoding='UTF-8'>¶

name = 'tmobile_spider'¶

parse(response)[source]¶

parse_detail(response)[source]¶

start_urls = ['https://www.t-mobile.nl/shop/alle-telefoons?ch=es&cc=con&sc=acq']¶

writer = <csv.DictWriter object>¶

Module contents¶

core