
Databricks · San Francisco
P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development...
At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to
cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers
can focus on the high value challenges that are central to their own missions.
Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, California
to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with
their mission-critical workloads, making us one of the fastest growing SaaS companies in the world.
Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the
boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to
making customers successful on our platform.
We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating
terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and
operating system faults, and our software must gracefully shield our customers from any of the above.
Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down
capabilities of traditional SQL query engines. As a software engineer on the Runtime team at Databricks, you will be building the
next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational
query performance, yet provide the expressiveness and programming abstractions to support diverse workloads ranging from ETL to
data science.
Apache Spark™: Develop the de facto open source standard framework for big data.
Data Plane Storage: Deliver reliable and high performance services and client libraries for storing and accessing humongous amount
of data on cloud storage backends, e.g., AWS S3, Azure Blob Store.
Delta Lake: A storage management system that combines the scale and cost-efficiency of data lakes, the performance and reliability
of a data warehouse, and the low latency of streaming. Its higher level abstractions and guarantees, including ACID transactions
and time travel, drastically simplify the complexity of real-world data engineering architecture.
Delta Pipelines: It's difficult to manage even a single data engineering pipeline. The goal of the Delta Pipelines project is to
make it simple and possible to orchestrate and operate tens of thousands of data pipelines. It provides a higher level abstraction
for expressing data pipelines and enables customers to deploy, test & upgrade pipelines and eliminate operational burdens for
managing and building high quality data pipelines.
Performance Engineering: Build the next generation query optimizer and execution engine that's fast, tuning free, scalable, and
robust.
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and
represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual
compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related
skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above,
Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include
eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your
location is in visit our page here.
Local Pay Range
About Databricks
Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and
over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI.
Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse,
Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific
details on the benefits offered in your region click here.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to
ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment
at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or
expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation,
socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's
discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an
applicant on this basis alone.
Discord has a highly engaged community of millions of daily active users who use the platform for many different reasons, but there’s one thing that nearly everyone does: play video games. Discord plays a uniquely important role in the future of gaming, and we are focused on making it easier and more fun for people to hang out before, during, and after playing games. We're looking for someone who gets excited about building data infrastructure at massive scale and cares deeply about the gaming communities we serve. Someone with passion for building lovable products for Discord users and Discord engineers. We're building the next generation Data Platform that powers decisions for one of the most vibrant platforms in the world. If you're the kind of Staff Engineer who sees ambiguity as an invitation — who builds systems that make whole teams faster, shapes technical strategy across the org, and wants your decisions to directly impact millions of gamers worldwide — we want to talk to you. To learn more about Discord's Data Platform, read our engineering blog, including how we built our modern data stack leveraging open-source tools! This position is based in our San Francisco office. What You'll Be Doing * Own the technical direction of major Data Platform initiatives like GRC, scaling, or stream processing, from problem to production system and post-launch health * Be a force multiplier: build reusable primitives, unblock teammates, and raise the quality bar across the team * Stay a top code contributor. You write real production code while helping others reach the same bar * Partner with XFN stakeholders to translate business problems into clear technical strategy * Champion debate, decide, and commit and 80/20 thinking to drive robust technical solutions supporting multiple team What you should have * 7+ years of software engineering experience with a track record of driving large, ambiguous technical initiatives end-to-end * Expertise in distributed systems and data infrastructure at scale. You've anticipated hard problems before they became incidents * Demonstrated ability to multiply a team's impact through architectural thought leadership, design reviews, reusable abstractions, and well-timed mentorship * Strong technical judgment: when to go fast vs. slow, when to build vs. integrate, and how to bring stakeholders along * Cross-functional influence: you've driven alignment across engineering, product, and business without relying on authority Bonus Points * Passion for Discord and gaming * Experience with data governance, privacy compliance, real-time analytics infrastructure, or cost optimization in large-scale data environments Candidates must reside in or be willing to relocate to the San Francisco Bay Area (Alameda, Contra Costa, Marin, Napa, San Francisco, San Mateo, Santa Clara, Solano, and Sonoma counties). Relocation assistance may be available. The US base salary range for this full-time position is $248,000 to $310,000 + equity + benefits. Our salary ranges are determined by role and level. Within the range, individual pay is determined by additional factors, including job-related skills, experience, and relevant education or training. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include equity, or benefits. Why Discord? Discord plays a uniquely important role in the future of gaming. We're a multiplatform, multigenerational and multiplayer platform that helps people deepen their friendships around games and shared interests, and helps developers build and grow their businesses. We believe games give us a way to have fun with our favorite people, whether listening to music together or grinding in competitive matches for diamond rank. Join us in our mission! Your future is just a click away! Discord is committed to inclusion and providing reasonable accommodations during the interview process. We want you to feel set up for success, so if you are in need of reasonable accommodations, please let your recruiter know. Please see our Applicant and Candidate Privacy Policy for details regarding Discord’s collection and usage of personal information relating to the application and recruitment process by clicking HERE.
About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here. We're seeking an exceptional Staff Software Engineer to join our Observability team at Pinterest. This role combines deep technical expertise in distributed systems and data engineering with a product-oriented mindset to build world-class observability solutions that empower our engineering organization. As a Staff Engineer on the Observability team, you'll be responsible for designing and building the infrastructure and tools that provide visibility into Pinterest's large-scale distributed systems, helping thousands of engineers understand, debug, and optimize their services. What you'll do: * Define and execute the observability roadmap, treating it as a product. Understand engineering team needs and translate them into technical solutions with measurable impact * Architect, build, and scale distributed observability infrastructure (metrics, logs, traces) to handle massive volumes across Pinterest's distributed systems * Build high-performance data pipelines and storage for real-time and historical telemetry analysis at Pinterest scale * Champion Best Practices: Establish observability standards and patterns across the organization, making it easy for teams to instrument their services and gain actionable insights * Technical Leadership: Mentor engineers, lead architectural reviews, and influence technical decisions across teams to improve overall system reliability and performance * Cross-functional Collaboration: Partner with SRE, Infrastructure, Product Engineering, and other teams to understand pain points and deliver solutions that improve developer productivity and system reliability * Innovation: Stay current with observability trends and technologies, evaluating and adopting cutting-edge tools and techniques to keep Pinterest at the forefront What we’re looking for: * Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience * Product Mindset: Demonstrated ability to work backwards from customer needs —understanding user needs, prioritizing features, measuring success, and iterating based on feedback. Experience building internal platforms or tools with strong adoption * Distributed Systems Expertise: 7+ years of experience designing and operating large-scale distributed systems with deep understanding of consistency, availability, scalability, and failure modes * Data Engineering Skills: Strong background in building data pipelines, working with time-series databases, columnar storage, stream processing (Kafka, Flink, etc.), and data modeling at scale * Observability Domain Knowledge: Hands-on experience with modern observability tools and practices including metrics, logging, tracing, and profiling. Familiarity with OpenTelemetry, Prometheus, Grafana, or similar technologies * Programming Proficiency: Expert-level coding skills in languages like Java, Python, Go, or Scala with ability to write production-quality code * Systems Thinking: Ability to see the big picture while managing complex technical details, balancing trade-offs between cost, performance, and reliability * Experience building observability platforms from the ground up or significantly scaling existing solutions * Familiarity with cloud-native architectures and technologies (Kubernetes, service mesh, etc.) * Track record of driving adoption of internal platforms through excellent documentation, UX, and developer advocacy * Experience with machine learning or anomaly detection applied to observability use cases * Strong communication skills with ability to influence stakeholders at all levels * Contributions to open-source observability projects, a plus In-Office Requirement Statement: * We let the type of work you do guide the collaboration style. That means we're not always working in an office, but we continue to gather for key moments of collaboration and connection. * This role will need to be in the office for in-person collaboration 1-2 times/quarter and therefore can be situated anywhere in the country. Relocation Statement: * This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model. #LI-REMOTE #LI-JT1 At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise. Information regarding the culture at Pinterest and benefits available for this position can be found here. US based applicants only $177,185—$364,795 USD Our Commitment to Inclusion: Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support. By submitting this application, I certify that all information submitted in my application and throughout the hiring process is true, accurate, and complete to the best of my knowledge. I understand that any false statement, omission, or misrepresentation may disqualify me from employment consideration or result in termination if discovered after hire.
P-188 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pattern, Lakehouse (CIDR 2021 paper), open platforms that unify data warehousing and advanced analytics. The new architecture will help address several major challenges, including data staleness, reliability, total cost of ownership, data lock-in, and limited use-case support. A critical part of realizing this vision is the next generation (decoupled) query engine and structured storage system that can outperform specialized data warehouses in relational query performance, yet retain the expressiveness and of general purpose systems such as Apache Spark™ to support diverse workloads ranging from ETL to data science. As part of this team, you will be working in one or more of the following areas to design and implement these next gen systems that leapfrog state-of-the-art: * Query compilation and optimization * Distributed query execution and scheduling * Vectorized execution engine * Data security * Resource management * Transaction coordination * Efficient storage structures (encodings, indexes) * Automatic physical data optimization What we look for: * A passion for database systems, storage systems, distributed systems, language design, or performance optimization * Experience working towards a multi-year vision with incremental deliverables * Motivated by delivering customer value and impact * 8+ years of experience working in a related system (preferred) * Optional: PhD in databases or distributed systems Pay Range Transparency Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here. Local Pay Range $192,000—$260,000 USD About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.