Description

At Shutterfly, we’re all about people — bringing them together, making them feel welcome, and connecting them to experiences. We make our customers’ memories last a lifetime by capturing, preserving, and sharing them through photography and personalized products. Through our family of brands, trend setting products, cutting edge technology, and best in class customer service, we help our customers, and each other, share life’s joy. 

 We are looking for an experienced A/B Testing Manager to develop and scale Shutterfly’s Experimentation Program. You will use your Program Leadership and expertise in Experimentation to drive significant impact on individual team's ability to rapidly test, learn, and iterate, while unlocking new opportunities for Shutterfly’s go-to-market strategies. 

 Responsibilities: 

  • Act as primary experimentation & optimization point of contact, consulting and supporting various business partners (Product, Engineering, Ecommerce) in the development of their experimentation roadmaps and the design of specific experiments
  • Maintain a testing roadmap & calendar and establish a framework for test scheduling and prioritization. Build an intake process to capture hypotheses, KPIs, opportunity size, and duration estimates.
  • Maintain and proactively monitor live experiments and ensure that appropriate metrics and segments are accurately implemented and reported, while consolidating and sharing findings across teams and verticals
  • Drive self-service reporting by building dynamic dashboards that scale to accommodate various scenarios. Increase visibility by communicating results and findings of individual experiments, as well as the overall program with partners
  • Be the primary owner of our testing platform, and stay up to date with industry trends on experimental methodologies (A/B, Multivariate, MAB etc), tools and platforms
  • Increase experiment velocity by developing efficient processes and automating wherever possible
  • Develop a center-of-excellence among key partners to enable the program to scale responsibly

Qualifications: 

  • 5+ years of experimentation experience with proven expertise in implementing, running, and analyzing A/B tests and multivariate tests in an ecommerce or technology company
  • 1+ year experience in leading a team of A/B Testing analysts delivering impactful analyses
  • Strong familiarity with the methodology and statistics behind effective testing campaigns, with experience tailoring explanations of statistical and technical concepts to a variety of audiences. Experience with personalization testing preferred
  • Deep understanding of the tools that power automation, experimentation, personalization, attribution, and analytics. Strong technical skills - navigate APIs, databases, and system architecture
  • Excellent stakeholder management and collaboration with product managers, data, engineering and analytics teams
  • Experience with testing platforms such as Adobe Target experience, Optimizely. Exposure to recommendation engines a plus
  • Experience with Analytics Platforms including Adobe Analytics (Omniture), Google Analytics and/or similar analytics platforms
  • Experience with SQL.
  • Other programming languages (e.g., Python, R) is a plus
  • Bachelor’s degree or equivalent in a relevant field, such as economics, statistics, mathematics, or computer science
#LI-DS1