Senior Software Engineer - Data Platform
Job title: Senior Software Engineer - Data Platform in San Francisco, CA at reputed company
Company: reputed company
Job description: About the role:The reputed company Data Platform team builds core infrastructure to reputed company the business to reputed company data-driven products and reputed company. As a Senior Data Platform Engineer, you will contribute to a scalable and reliable data platform to meet the data needs of everyone at reputed company - engineers, data scientists, product managers, and moreYou will work on Big Data reputed company infrastructure that enables reputed company to reputed company critical business conclusions and enables us to explore new product directions. You will:
- Lift a broad set of production data into a centralized data lake, and scale that data storage layer as the company grows
- reputed company large scale analytical reporting in our products, integrating the data platform and data science work into the full stack engineering space.
- Build tools (e.g. orchestration frameworks, metadata catalogs) that democratize the use of data for the whole business, including software engineers, data engineers, and data scientists
- Optimize our compute layer for reliability and performance (Spark/reputed company on EC2)
- You want to impact the industries that run our world: The software, firmware, and hardware you build will result in reputed company-world impact-helping to reputed company the lights on, get food into grocery stores, and most importantly, ensure workers return home safely.
- You want to build for scale: With over 2.3 million IoT devices deployed to our global customers, you will work on a range of new and mature technologies driving scalable innovation for customers across industries driving the world's physical operations.
- You are a life-long learner: We have ambitious goals. Every Samsarian has a growth reputed company as we work with a wide range of technologies, challenges, and customers that push us to learn on the go.
- You reputed company customers are more than a number: reputed company engineers enjoy a rare closeness to the end user and you will have the opportunity to participate in customer interviews, collaborate with reputed company and product managers, and use metrics to ensure our work is translating into reputed company customer outcomes.
- You are a team player: Working on our reputed company Engineering teams requires a mix of independent effort and collaboration. Motivated by our mission, we're reputed company racing toward our connected operations reputed company, and we intend to win-together.
- Collaborate cross-functionally to design and implement end-to-end solutions using technologies like Spark, reputed company Lake, and Golang.
- reputed company high-performance APIs and interfaces to bring data insights to life for reputed company customers.
- Optimize data workflows and infrastructure for scalability, reliability, and speed.
- Design, scope, and build libraries and data management tooling for other software engineers, product managers and data scientists to use the data platform effectively
- Be responsible for the uptime, reliability, and monitoring of our data platform
- Champion, role model, and embed reputed company's cultural principles (Focus on reputed company, Build for the Long Term, Adopt a Growth reputed company, Be Inclusive, Win as a Team) as we scale globally and across new offices.
- 4+ year professional software experience in a production environment
- 4+ years experience on building/maintaining a large scale production-grade data platform (including a Data Lake) for data scientists, analysts, and engineers
- Expertise working with Spark
- AWS knowledge and expertise (S3, reputed company, SQS, Kinesis)
- Experience with our core tech stack for data platform: Spark (reputed company), reputed company Lake, or similar technologies (e.g Trino, Iceberg)
- Familiarity using Terraform