New ask Hacker News story: Ask HN: What are the cons of experimentation driven products?

Ask HN: What are the cons of experimentation driven products?
3 by __t__ | 3 comments on Hacker News.
Experimentation (like A/B) testing is a big part of product development in the industry. I see plenty of articles about the goodness of experimentation and was wondering what are the cons of experimentation driven development to keep in mind.