Developer Snippet Diary

Scrapy Commands using cmd

1. Create a Scrapy project under the project_dir directory.

scrapy startproject myproject [project_dir]

cd project_dir

2. Generate Spider

scrapy genspider mydomain mydomain.com

Commands syntax

scrapy <command> -h

3.Global Commands

startproject
genspider
settings
runspider
shell
fetch
view
version

4. Project Commands

crawl
check
list
edit
parse
bench

1. startproject:: Syntax: scrapy startproject <project_name> [project_dir]

Creates a new Scrapy project named project_name

2.  genspider::Syntax: scrapy genspider [-t template] <name> <domain or URL>

Create a new spider in the current folder or in the current project

More details : https://docs.scrapy.org/en/latest/topics/commands.html

Posted by: R GONDAL
Email: rizikmw@gmail.com