{"flag":true,"single":true,"pageTitle":"Scrapy Commands using cmd","post":{"id":48,"user_id":"1","slug":"scrapy-commands-using-cmd-oovi","title":"Scrapy Commands using cmd","body":"<p><strong>1. Create a Scrapy project under the project_dir directory.<\/strong><\/p>\r\n<pre class=\"language-markup\"><code>scrapy startproject myproject [project_dir]<\/code><\/pre>\r\n<p>cd project_dir<\/p>\r\n<p><strong>2. Generate Spider<\/strong><\/p>\r\n<pre class=\"language-markup\"><code>scrapy genspider mydomain mydomain.com<\/code><\/pre>\r\n<p>Commands syntax<\/p>\r\n<pre class=\"language-markup\"><code>scrapy &lt;command&gt; -h<\/code><\/pre>\r\n<p><strong>3.Global Commands<\/strong><\/p>\r\n<pre class=\"language-markup\"><code>startproject\r\ngenspider\r\nsettings\r\nrunspider\r\nshell\r\nfetch\r\nview\r\nversion<\/code><\/pre>\r\n<p><strong>4. Project Commands<\/strong><\/p>\r\n<pre class=\"language-markup\"><code>crawl\r\ncheck\r\nlist\r\nedit\r\nparse\r\nbench<\/code><\/pre>\r\n<p><strong>1. startproject::&nbsp;<\/strong><strong>Syntax: <\/strong>scrapy startproject &lt;project_name&gt; [project_dir]<\/p>\r\n<p>Creates a new Scrapy project named project_name<\/p>\r\n<p><strong>2.&nbsp; genspider::Syntax: <\/strong>scrapy genspider [-t template] &lt;name&gt; &lt;domain or URL&gt;<\/p>\r\n<p>Create a new spider in the current folder or in the current project<\/p>\r\n<p>More details : https:\/\/docs.scrapy.org\/en\/latest\/topics\/commands.html<\/p>","category_id":"11","is_private":"0","created_at":"2023-03-25T00:53:15.000000Z","updated_at":"2023-03-25T00:53:15.000000Z","category":{"id":11,"user_id":"1","name":"Scrapy Python","slug":"python-vk7t","parent_id":"5","created_at":"2023-03-21T09:29:28.000000Z","updated_at":"2023-03-21T09:29:43.000000Z"},"user":{"id":1,"name":"R GONDAL","email":"rizikmw@gmail.com","email_verified_at":null,"two_factor_confirmed_at":null,"current_team_id":"1","profile_photo_path":null,"created_at":"2023-03-12T10:49:33.000000Z","updated_at":"2025-01-10T12:59:00.000000Z","profile_photo_url":"https:\/\/ui-avatars.com\/api\/?name=R+G&color=7F9CF5&background=EBF4FF"}},"pageDesc":"1. Create a Scrapy project under the project_dir directory. scrapy startproject myproject [project_dir] cd project_dir 2. Generate Spider sc - Scrapy Commands using cmd (Updated: March 25, 2023) - Read more about Scrapy Commands using cmd at my programming site [SITE]","categories":[]}