Principal DevOps Engineer - Engineering Services

Engineering San Francisco, California

Splunk is seeking a talented Principal DevOps engineer who is passionate about providing world class customer service with a sharp focus on deploying and managing, reliable, robust, high quality engineering platforms and their associated infrastructure and services.  This technical lead position will help specify, develop and deploy state of the art processes and services in support of internal clients and other key stakeholders throughout engineering. The successful candidate has extensive experience working as part of a team on large scale software development within complex multi-platform environments.  He/she demonstrates exceptional problem solving, communication and collaboration skills that span across project and functional teams. Collaboration, creativity, friendliness and patience are important traits required to succeed in this role.


  • Use technical analysis to assess the scalability and reliability of the engineering infrastructure.
  • Provide technical leadership, coaching and mentoring for the existing DevOps/SRE staff.
  • Help lead the transformation to modern DevOps at Splunk by leveraging the latest cutting-edge technologies.
  • Provide timely, world class customer service for requests from all stakeholders and customers including; software development, QA, sustaining and project management. Typical requests would cover; CI/CD systems, SCM, branching, build systems and testing across multiple platform environments.
  • Engage with software development, QA and project management teams to prepare for customization or enhancements required to support new engineering methodologies.
  • Provide recommendations to monitor and improve our engineering infrastructure.
  • Drive improvements of tools used for continuous integration, automated testing and diagnostics, and release management. 
  • Identify issues, collaborate with stakeholders on solutions and provide follow-up on the implementation.
  • Analyze and adapt release configurations and processes to support changing needs and environments.

Minimum qualifications

  • BS/MS degree in CS or related technical field or equivalent practical experience.
  • 12 years of progressive work experience in the Release Engineering, DevOps, SRE functions doing large scale software development.
  • Extensive working experience with modern container technologies; Docker, Kubernetes.
  • Experience with version control and build management tools, e.g. Perforce, Git.
  • Experience with troubleshooting C/C++ builds.
  • Experience in Linux, Windows.
  • Working experience with several modern scripting languages such as; Python, BASH, Go.
  • Experience with the Atlassian tool set: JIRA, Confluence, Bamboo, Bitbucket.
  • In-depth experience with modern CI/CD pipelines and the common components and services typically used with these pipelines:
    • Bitbucket, Gitlab, Github
    • Jenkins, Gitlab, Bamboo
    • Docker, Kubernetes
    • Automation platform
    • Testing tools: SonarQube
    • Secrets storage: Vault
    • Artifact Storage: Artifactory

Preferred qualifications

  • Excellent follow up and communication skills. Ability to keep things conversational and organized while getting things done.
  • Experience with design & administration of highly available engineering environments.
  • Experience with cloud native software development is highly desirable for this role.
  • Extensive exposure to Release Engineering / DevOps / SRE practices, including automation, configuration management, and release management
  • Experience with multiple OS environments - Linux, Windows, Mac OSX, various UNIX flavors.
  • Experience with mobile environments - iOS, Android.
  • Experience with multiple build tools - GCC, Visual Studio, Xcode, Make.
  • Adept at working with teams of highly talented individuals.
  • Experience with virtualization technology, e.g. VMWare.

Thank you for your interest in Splunk!