Staff Designated Support Engineer
Bengaluru, Karnataka, India · Full Time
Be the first to apply
- Experience
- 8–12 yrs
- Salary
- —
- Openings
- 1
- Posted
- 1 小时前
- Work mode
- In office
- Resume
- Required to apply
Where you'll work
Job description
Role Overview
As a Staff Designated Support Engineer, your primary role involves close collaboration with Field and Engineering teams to provide specialized, high-touch support and customized technical solutions for Databricks' premier Digital Native Business customers. Utilizing your advanced expertise in Apache Spark™ and related data technologies, you will troubleshoot and resolve complex technical issues critical to customer success.
Key Responsibilities
- Perform in-depth troubleshooting and root cause analysis to fix performance and stability problems in Spark, SQL, Delta Lake, streaming, and Databricks runtime components, using diagnostic tools such as Spark UI, Mosaic AI Model Service, Directed Acyclic Graphs (DAGs), and event logs.
- Identify continuous monitoring requirements to proactively detect performance degradations, collaborating with R&D and Network Operations teams to optimize customer environments.
- Develop rapid proof-of-concepts, deploy and monitor engineering solutions addressing customer challenges, demonstrating advanced Spark, machine learning, and AI runtime capabilities aligned with customers' business objectives.
- Create detailed playbooks and maintain a comprehensive knowledge base documenting common issues and resolutions related to Spark, machine learning, and AI workflows.
- Educate customer engineering and business teams on best practices for performance tuning, debugging techniques, and effective use of Databricks features.
- Lead pilot programs to implement new best practices, advocate for process improvements, and work cross-functionally to enhance the customer experience.
- Represent customers during business reviews and maintain trusted advisor relationships as the main technical contact.
- Work onsite with Field Engineering, Sales, and Product teams during customer engagements and presentations, delivering rapid solutions to production-impacting issues and building customer confidence through technical expertise.
Qualifications and Experience
- Substantial expertise in Big Data technologies and Apache Spark with 8 to 12 years in distributed computing application design, development, and troubleshooting.
- At least 4 years of hands-on experience delivering production-level Spark, machine learning, and AI solutions using programming languages such as Python, Java, or Scala.
- Proficiency in data engineering involving Data Lakes, SQL-based databases, and cloud data warehousing/ETL platforms including Snowflake, Redshift, and BigQuery.
- Deep technical understanding of Spark internals, Delta and Iceberg data lake formats, JVM optimizations, and memory management; knowledge of AI ecosystems such as machine learning, deep learning, and generative AI technologies.
- Solid experience with cloud platforms like AWS, Azure, or Google Cloud Platform and skillful in building and maintaining CI/CD pipelines, monitoring systems, and alerting frameworks.
- Demonstrated experience in customer-facing roles (e.g., Technical Account Manager, Solutions Architect) for 3 to 5 years, with strong communication, relationship management, and problem resolution skills.
- Excellent proactive problem-solving capabilities, including risk anticipation, mitigation planning, and effectively leveraging subject matter experts and judgment to coordinate team efforts.
- Proven collaborative leadership, working with cross-functional teams and senior leadership to overcome obstacles, mitigate risks, and ensure successful customer outcomes, including generating impactful self-service documentation.
About Databricks
Databricks is a leading data and AI enterprise trusted by over 10,000 organizations worldwide, including top companies and more than half of the Fortune 500. Headquartered in San Francisco, it was founded by the creators of Apache Spark™, Lakehouse, Delta Lake, and MLflow, providing an integrated Data Intelligence Platform for unified data, analytics, and AI.
Additional Information
Databricks offers comprehensive benefits designed to support employees’ diverse needs. The company values diversity and inclusivity and is committed to equal employment opportunity regardless of age, race, gender, disability, or other protected characteristics.
For positions requiring access to export-controlled technology, obtaining a U.S. government license is at the employer’s discretion and may be a condition affecting candidate consideration.