Hi Folks,
I am trying to build a solution where I input an e-commerce product URL
and automatically get all the competitors for that product. If you could provide any direction concerning it. It will be beneficial.

  • mcjoness@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Hell ya I love what we got going in here. @OP let me know when you make progress and share your code, would ya?

  • oo_viper_oo@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    Well, you could calculate distance of all product names or descriptions using some textdistance metric, e.g., rapidfuzz, and then apply clustering on that distance matrix. Resulting clusters would correspond to the products. If you had product images, you could do with some image distance metric.

  • new_name_who_dis_@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    That’s not really an ML problem. It’s a search problem. You’d need an index (or at least db) of all e-commerce products. Then you can potentially use ML to find competitors, but I feel like for this you don’t need ML — a simple if statement for the two products being of the same type will suffice.

  • saintshing@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    First of all, do you already have the data? Scraping and maintaining an updated product list is an entirely separate task and it is not easy.

    If you have already scrapped the data, what data do you have? Just title, or you have the description, brand, model number, images? There was a kaggle competition on matching two products on Shopee for price match guarantee(based on titles and images). You can look at some of the winning solutions.

    https://www.kaggle.com/competitions/shopee-product-matching

    I looked at your post history. You are tring to sell your price monitoring tool but it seems like you dont have a working prototype based on this question?

    • Used-Preparation-921@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      Hi,
      thanks for sharing the Kaggle link will look into it. Yes, I have built a Price Monitoring tool and it is live as well. But currently, the user needs to add the URLs manually or provide the same to us in excel/csv format. I asked this question because I want to automate this process.