Competitor Parser - website parsing for OpenCart/OcStore

Competitor Parser allows you to automatically import products and categories from any third-party website directly into your online store. You set it up once, and then everything runs on schedule without any intervention. Who is this module for?- You want to fill a new store with products from a supplier's website- You need to keep prices and availability up-to-date – the data is updated automatically- You have multiple sources, each of which needs to be parsed according to its own rules- You're tired of manually copying descriptions, photos, and specifications How it works:You create a profile, specify a link to a catalog page or sitemap, configure CSS/XPath selectors for product fields, and set a schedule. The module then automatically crawls all pages, downloads products, and adds them to OpenCart. What it parses:Main product fields:- Name, description (HTML preserved), model, SKU- Price and promotional price- Quantity in stock Images:- Main photo and full product gallery- Images within the HTML description are also downloaded and replaced with local links- Compression and resizing during download (set the maximum width and height)- WebP support - automatically converted to JPG if needed Attributes (features):- Parses name/value pairs from feature tables- Support for grouping by sections - important for complex products (phones, laptops): "Memory," "Camera," "Power," etc. Created as separate attribute groups- The default group name is customized for your store Product Options (Options):- Parses options such as Size, Color, and any other options- Multiple option slots - for sites with different layouts- Each value can be assigned a price and quantity Categories:- Breadcrumbs (for automatic category creation)- Two modes: place all products in one selected category or automatically recreate the hierarchy from breadcrumbs- Categories are created automatically in OpenCart if they don't already exist Data Sources:Link — Catalog page with pagination; the parser navigates through the pages automaticallySitemap — XML Sitemap, takes the list of product URLs directlyFeed / RSS / Atom — Any XML feed with productsPagination is supported in two ways: CSS/XPath selector of the "Next Page" button or URL pattern (?page={n}). Import modes:New only — existing products are not affectedUpdate only — updates existing products, does not create new onesNew + update —creates new products and updates existing onesFull synchronization — additionally removes products from the store that are no longer in the source Background processing and scheduling:Parsing is performed via a cron request – no execution time limits, no timeouts. Each profile has its own cron link – simply add it to the server scheduler. The schedule is configured directly in the profile (cron expression).There is a 0.5-second pause between requests to the source site, browser headers, and cookie support to bypass basic bot protection. Registry and smart matching:The module maintains a registry of all parsed products and categories. When rerun, it does not create duplicates – it finds an existing product by URL, then by SKU, then by name. If the product URL changes, the registry is updated automatically. Risk-free testing:Before running full parsing, check the settings in test mode:Category Page Test — shows how many products were found and example linksProduct Test — parses one page and displays all found fields; nothing is saved to the databaseDiagnostics — shows "found" / "not found" / "empty" / "selector not specified" for each field Service Tools:SEO URL Management – scans the store's URLs, finds products and categories without slugs, fills in missing ones, and corrects duplicate URLs.Image Cleanup – finds files in the module folder that are no longer used in any product, shows how much space will be freed, and deletes them with one click.Registry Cleanup – removes registry entries for which a product or category has already been deleted through the admin panel.Disabling incomplete products — finds and disables products without photos or with a price of 0. Interface:- The entire module is managed from a single page in the OpenCart admin panel- Dark mode support- Real-time logging — see what's happening right now- Multiple profiles — each with its own settings, schedule, and source- Category and product registry with pagination and quick editing links Requirements:- cURL extension (for sending notifications)- Cron on the server (for automated operation)- PHP extensions: curl, gd, dom License:Commercial module linked to a domain.The license is verified through a secure server.One license — one domain.