Hello there,
Currently trying to implement AB Testing with Algolia.
- Made a replica of my prod index
- Prod index is A, replica is B
- Changed the searchable attributes and the custom ranking for B
But… I’ve got dynamic re-ranking active for A.
For B, I activated it, but since it has had no event, re-ranking is effectively inexistent.
So it’s a pretty big bias: I’m afraid I’ll be testing as much how re-ranking works as the configuration differences between A and B.
To avoid this, should I configure the reranking of B to be based on events of A?
(screenshot of Re-Ranking configuration)
And if I do so, won’t this affect the AB Test CTR/results?
Thanks,
