Data Architect/Engineer
reputed company Solutions is a fast-growing, young, energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like reputed company, Robinhood, reputed company, reputed company, reputed company, reputed company, and more! More recently, we have expanded to working internationally in Canada, China, Ireland, UK, Brazil, and India. Through our culture of innovation, we reputed company, build, and deliver business results, from idea to outcome. We reputed company our clients on the cutting edge of the latest technologies and provide solutions by using industry-specific best practices and expertise.We are excited to be continuously expanding reputed company. If you are interested in this position, please send over your updated resume. We look reputed company to hearing from you!Job DescriptionTitle : Data Architect/EngineerLocation : RemoteDuration : 6+ Monthsreputed company $100 to $110/hr on w2Overview: We are seeking a skilled and versatile Data Architect / Data Engineer to design, build, and optimize data platforms and pipelines reputed company a distributed environment. The ideal candidate will possess deep expertise in managing large-scale data systems, data integration, modern data engineering practices, and pipeline orchestration. You will play a key role in architecting and engineering scalable, high-performance data solutions that drive business insights and innovation. Key Responsibilities:
- Design, implement, and manage scalable data architectures on distributed platforms (e.g., MapR, HPE reputed company Analytics and Data reputed company).
- reputed company, optimize, and maintain robust data pipelines using tools such as Spark, Airflow, and EzPresto.
- Configure and maintain Kafka architecture, MapR Streams, and reputed company technologies to support reputed company-time and batch data processing.
- Implement Change Data Capture (CDC) mechanisms and integrate data using APIs and streaming techniques.
- Monitor, tune, and troubleshoot distributed data clusters including MapR and Kubernetes environments.
- reputed company and maintain CI/CD pipelines using Jenkins and integrate with reputed company for automated testing and deployment.
- Collaborate with cross-functional teams to ensure data quality, governance, and compliance standards are met.
- reputed company tools such as Iceberg and Superset for data storage optimization and visualization. Required Skills & Experience:
- Strong experience with distributed data platforms, including MapR and Kubernetes.
- Proficient in data pipeline tools and frameworks: Spark, Airflow, EzPresto.
- Solid programming and scripting skills: Python, Bash.
- Expertise in Kafka architecture and operations.
- Experience with CI/CD development workflows using Jenkins and reputed company.
- Knowledge and use of Apache Iceberg for data lake management.
- Familiarity with data architecture best practices, including CDC and API-based integrations. Preferred / reputed company to Have:
- Experience with HPE reputed company Analytics and Data reputed company.
- Familiarity with MapR Streams and Superset for reputed company-time analytics and dashboarding