Forum Replies Created
- sanninParticipant8 months, 3 weeks ago in reply to: Better Related Products #35366
I consider this solution -as the title says- just a better related products, that displays true related products compared to the woocommerce implementation. The cosine distance of the vectors, combined with a basic filtering should be enough for that task.
Of course it can be much better when for example combined with metarank, to rerank based on ctr etc, but as it is now it has good performance and it is quite easy to implement imho.
sanninParticipant8 months, 3 weeks ago in reply to: Better Related Products #35363Do you mean retrieve similar products on every page view? I am concerned with performance and caching issues.
I could maybe save the result in a transient for a hour, but i prefer to do it overnight. I have a cron at 3am, and it doesn’t take more than an hour for 250k products.
sanninParticipant8 months, 4 weeks ago in reply to: Vespa Integration? #35323Hello,
Sorry for the late reply :/ I must admit that i failed miserably with vespa intergration. 😛 I did not have enough patience to dig in deeper and i encountered some bugs in the beta version of wpsolr that prevented the normal operation. I am not giving it up, but i will wait the official release to try it out again.
But nevertheless thanks to one of your blog posts i discovered metarank, which i managed to implement, but i will discuss it more at another thread.
sanninParticipant10 months, 4 weeks ago in reply to: Vespa Integration? #34213I have not received anything…
sanninParticipant10 months, 4 weeks ago in reply to: Vespa Integration? #34200Yes, i would like to try a pre-release version.
sanninParticipant10 months, 4 weeks ago in reply to: Vespa Integration? #34192Hey, sorry for the late reply. Vespa support ai ranking models such as xgboost.
Unfortunately the showstopper issues seems that it will take a while to be completed…sanninParticipant1 year ago in reply to: Woocommerce Orders with Weaviate #33198I tried hybrid mode but the results were not good. I took your advice for a separate index for orders, i used elasticsearch, because i prefer when i search for an email or telephone to get exact matches, so vector search might not be ideal. So far, it works as intended!
To my understanding, wp-solr indexes order’s custom fields. Does it index the line items of the order? I would like to search for an SKU and find the orders that contain it.
sanninParticipant1 year ago in reply to: Recommendations ETA? #33184Hey!
I am still experimenting with my options on recommendation but for now, i will settle with something relatively simple.
Can i query weaviate using the methods of wpsolr? For example i would like to create a custom weaviate query that brings me the most relevant products in stock so i can show a much better related products slider.
sanninParticipant1 year ago in reply to: Recommendations ETA? #33068How many recommendations per month do you forecast?
For 250k products, Recombee’s standard plan starts at $99/month for 100K API calls/month. After that, it’s around $1/1000 calls/month. I’m not sure it can be beaten with any kind of self-hosted open-source RecSys !If you move the pricing slider, you will see that for > 200k products the price starts at 600 dollars per month. The minimum price of $99/month is for up to 40k products. Unfortunately i still can’t justify the cost for that.
Do you use a GPU for the training? Also, Gorse is a one-machine for training, which can lead to bottlenecks. In general, the training cost of recommenders is underestimated. Unless you choose scalable systems like TorchRec, built with parallel training.
For all my needs i use a AMD Ryzen 9 5950X 16-Core powered dedicated server, which also hosts my sites so its not ideal. But in this case the bottleneck was not gorse but mongodb, because of the huge amount of operations gorse was generating. So no gpu powered yet! I was thinking of a weaviate cluster using my home pc, where i have GTX 1070 being idle most of the time. 🙂
None provides the model training pipeline.
Look at this Vespa’s recommender tutorial for instance.
Weaviate provides the RefToVec module to build a recommender I guess.So if i understand correctly using the product catalog that wp-solr creates, and sending the events separately i might be able to create a ( less than ideal ) recommender system.
sanninParticipant1 year ago in reply to: Weaviate clip encoder #33059Considering the ongoing conversation over github, how can i trigger the indexing of just one product and log the response?
Can you point me to the class and method i should call?
sanninParticipant1 year ago in reply to: Recommendations ETA? #33048The problem with the 250k products is that either SaaS recommender solutions get very expensive or open source solutions get problematic or resource hogs.
Using weaviate with the sentence-transformers/clip-ViT-B-32-multilingual-v1 (Multilingual, 768d) clip vectorizer, the indexing speed was about 10 products per minute, and the vectorizer was using 16 (!) out of 32 cores of my server. Trying the openai vectorizer, resulted in error as i mentioned on the other thread.
Likewise gorse was using a huge amount of memory and cpu in redis/mongodb to calculate the relative products. It took a full 3 days to calculate all products and start again.
I am getting impatient with your Vespa AI implementation to see if it gets any better! 🙂 With either Vespa or Weaviate i would love to find a way to use some AI model to predict CTR like gorse uses matrix factorization. Do you think it will be possible using wp-solr + vespa/weaviate if i send the events manually?
I agree that building a true personalization system will be very hard for a general purpose plugin, but it could be possible to use some hooks/filters and custom fields?
sanninParticipant1 year ago in reply to: Recommendations ETA? #33045I have done a custom implementation on my eshop, with https://github.com/gorse-io/gorse
I collect events with server side tag manager, and send them to the recommender system, with a custom tag i made in tag manager.
My main problem is the amount of products in my site ( more than 250k ) that require these solutions. At the moment i use 3 different stacks, typesense for search, gorse for recommendations, and trying to implement wp-solr for filtering. I believe i could just use wp-solr for all my needs and code a bit when needed for custom functionality, but the foundation must exist in wp-solr.
Will Vespa AI make any difference in this matter or it is just another vector database?
sanninParticipant1 year ago in reply to: Addon for WP Gridbuilder? #33043Ah, i just saw the section in the forums and had to ask! I am currently use facetwp, but i am planning on switching to wp-solr filters when everything works correctly.
sanninParticipant1 year ago in reply to: Recommendations ETA? #33042I am interested in similar features that recombee, algolia and similar services provide.
I understand that it is very complicated thing to do but i am able to write custom code when needed. At the very least i believe i should be able to have related products and maybe upsells and cross-sells.
sanninParticipant1 year ago in reply to: Weaviate clip encoder #33041Ah so its a weaviate issue, i thought it had something to do with woocommerce schema… I will try there first and come back to you.