Crawling content and Movies of a Persian site using PHP.
Modify config.php file and Run daily or every hours crawler update:
php importer.php
This crawler is designed to automatically update the database. But this will require a DataLife Engine CMS. Something that is not available for free. (Free trial has limitation)
If you want to use a crawler without this CMS(DataLife). You can look at the parser-test.php file.
Database of about 5,000 movies with running crawler once:
| Minute | Hour | Day | Month | Weekday | Command |
|---|---|---|---|---|---|
| 0 | * | * | * | * | /usr/local/bin/ea-php74 /home/hostName/public_html/folder-test/importer.php |
0 * * * * /usr/local/bin/php /home/hostName/public_html/folder-test/importer.php
or
0 * * * * /usr/local/bin/ea-php74 /home/hostName/public_html/folder-test/importer.php
There is a problem with set categories for posts that I do not yet know the exact cause. But editing each category manually solves this to some extent.
DataLife Engine (DLE) — a content management system.
My nickname is Max, Programming language developer, Full-stack programmer. I love computer scientists, researchers, and compilers. (Max Base)
A team includes some programmer, developer, designer, researcher(s) especially Max Base.