Ning Cao is an engineering manager in search runtime metadata team at WalmartLabs. Prior to that, he worked at Google, Huawei, etc. Ning has research and industry experience in large-scale distributed systems, search and storage in cloud computing, security and privacy.
Ning received Ph.D. in Electrical and Computer Engineering at Worcester Polytechnic Institute, M.S. and B.S. in Computer Science at Xi’an Jiaotong University. His publications have 4000+ citations: Google Scholar .
As one of core parts in Walmart eCommerce platform, search system is facing challenges like fast growing number of products, increasing search traffic volume, real time update, and new business needs. To handle these challenges, we continuously improve and redesign the search architecture.
This session will first introduce the architecture of Walmart eCommerce search system, followed by its challenges; then discuss several architecture design cases with focus on the search backend system; finally share experience and lessons we have learned in this evolution.
a. Distributed search cloud (vs. open source Solr Cloud)
b. Re-rank (decouple from underlying search engine)
c. Metadata store (support real time update)
d. Microservices
a. Pros & Cons using open source
b. Chaos by microservices Audiences