Principal Performance Engineer - Observability
Description
Join us as we pursue our innovative vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, our customers, having fun, and most meaningfully, to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!
Are you passionate about working on critical systems to create tangible customer impact? Would you like the opportunity to work at a growing company that is changing the way that information is used to support business decisions? If this resonates with you, we would love to speak with you.
At Splunk, each and every release of our software is highly scrutinized to meet the demands of our customers. As a Principal Performance Engineer, you'll have a direct impact on our products' success. You will collaborate with peers, field teams, and customers to understand and encapsulate the user scenarios into industry standard benchmarks. You will work with product management and interact directly with our customers to get direct exposure to the usage patterns we strive to satisfy. You will also drive projects to integrate benchmarking into our continuous integration and test automation frameworks.
What You'll Be Doing:
- Define, develop and perform performance/scalability benchmarks on Splunk observability cloud and Cloud products
- Efficiently working with various profiling tools to identify performance and concurrency bottleneck, propose and implement optimizations to improve the Splunk products and Splunk observability cloud.
- Implement and improve sizing and capacity calculators for key Splunk observability cloud applications on the cloud.
Who You Are & What Makes You Qualified:
- 8 - 12 years of experience in Performance Engineering and Benchmarking
- Skilled in both the art and science of benchmark creation and measurement and modeling of system behavior under load
- Ability to find root cause of performance bottlenecks with profiling tools: flamegraphs, pprof, pstack, qmlprofiler, perf, strace, tcpdump, netstat, ext4slower, opensnoop
- Passionate about finding performance bottlenecks and optimize code
- Experienced in solving problems of load, scale, and optimizations of sophisticated large-scale deployments
- Demonstrated ability in SaaS, Microservice, Cloud Native software companies and projects
- Expert in scripting languages such as Shell, Python and compiled languages (C/C++)
- Proficient in Linux, Docker, AWS, GIT, Artifactory in terms of both tools and systems administration
- Experience in leading and growing a team of junior engineers
- Ability to coordinate activities such as sprint planning, design reviews, code review, and providing updates to engineering manager
Extended Qualifications
- Experience with Splunk observability cloud & enterprise software capacity planning a huge plus
- Experience with big data (Hadoop, Spark) a huge plus
- Experience with data science and ML a plus
- Experience with GPU a plus
Requirements
- Strong fundamentals in software engineering: data structures and algorithms
- Coding proficiency in one or more of the following languages with the ability to quickly learn new languages: Python, Java, Go, Python, C++
- Experience in working on distributed systems like databases, distributed file systems, distributed concurrency control
- Strong debugging and troubleshooting skills including the use of associated tools
- Experience with developing CI/CD systems with Gitlab, test automation frameworks,
- Ability to document your work for the benefit of the team
- Knowledge of REST, grpc or similar communication paradigms
- Knowledge of public cloud services such as AWS, GCP, Azure
- Operational excellence: You think beyond feature delivery into how your code is serving customers in production
- Familiarity with Kafka and data streams for data processing and testing purposes.
- Expertise in software quality engineering principles and practices, including test planning, test case design, and quality assurance methodologies.
- Proven ability to diagnose escalations and production issues and work on effective solutions.
- Strong analytical skills to identify and address test gaps and improve test coverage.
- Bachelor's degree or higher in Computer Science, or equivalent practical experience
- 8 -12 years of related experience with a Bachelor's degree or Masters degree; or equivalent experience
What we offer
A team of incredibly capable and dedicated peers, all the way from engineering to product management and customer support.
A stable, collaborative, and supportive work environment. We work in an open environment, work together to get things done, and adapt to the changing needs of the team. We keep it real by being open and honest.
Balance. We want you to be successful outside of work too. We trust our colleagues to be responsible with their time and commitment, and believe that balance helps cultivate a positive environment.
Fun. We are committed to having every employee want to give it their all, be respectful and a part of the family, and have a smile on their face while doing it.
We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.
For job positions in other locations where required, we will consider employment-qualified applicants with arrest and conviction records.
Note:
Base Pay Range
India
Base Pay: INR 4,800,000.00 - 6,600,000.00 per year
Splunk provides flexibility and choice in the working arrangement for most roles, including remote and/or in-office roles. We have a market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location as set out above, as well as the knowledge, skills and experience of the candidate. In addition to base pay, this role is eligible for incentive compensation and may be eligible for equity or long-term cash awards.
Benefits are an important part of Splunk's Total Rewards package. This role is eligible for a comprehensive, competitive benefits package which may include healthcare and retirement plans, paid time off, wellbeing expense reimbursement, and much more! Learn more about our comprehensive benefits and wellbeing offering at https://splunkbenefits.com.
Thank you for your interest in Splunk!