Problem
The client needed to efficiently manage a large, constantly changing catalog with a lean internal team:
- Suppliers provided product data in varied formats: XLS files, XML feeds, and exports from other marketplaces.
- Prices and stock levels changed frequently and needed to be updated quickly.
- Manual updates were slow, error-prone, and difficult to scale.
- There was no unified way to map supplier fields to the store’s internal data model.
Solution
We designed and implemented a custom import and synchronization module on top of the existing CodeIgniter-based store:
- Developed an import engine capable of reading multiple data source types (XLS, XML, etc.).
- Implemented a flexible field mapping system to match supplier fields with internal product fields.
- Allowed admins to create and save import configurations per supplier for reuse.
- Added group editing tools to update product attributes, categories, and pricing in bulk.
- Set up cron jobs to run scheduled imports for price and stock synchronization.
- Ensured stability and performance when handling large catalogs and repeated updates.
Outcomes
The automation engine significantly improved operational efficiency:
- 4x faster onboarding of new suppliers and product feeds with different data formats.
- 10x reduction in manual catalog update time.
- Up to 99% accuracy in stock & price synchronization across suppliers.
- Automatic updates for 25,000+ SKUs executed reliably via cron. Near-zero manual intervention required for recurring imports.
- Allowed the business to scale its assortment without proportional growth in staff.
Before & After
Before
- Manual updates for each supplier file or feed.
- High risk of outdated prices and out-of-stock products being shown to customers.
- Limited ability to expand the catalog quickly.
After
- Automated imports on schedule.
- Standardized, reusable import configurations for each data source.
- Accurate, synchronized prices and stock levels across the store.
- Scalable foundation to manage thousands of SKUs with minimal manual work.
Tech Details
- Framework: CodeIgniter (PHP).
- Data Sources: XLS files, XML feeds.
- Automation: Cron jobs for scheduled imports and updates.
- Features: Field mapping per supplier, reusable import configurations, bulk editing tools.
- Scale: Designed to handle 1000s of SKUs and frequent updates.