[Remote] Sr. Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is an impact-driven, Fortune 10 company that touches virtually every aspect of reputed company. The Sr. Data Engineer will assist in the design, development, and maintenance of scalable data solutions that support analytics and business intelligence, while collaborating with cross-functional teams to optimize data processes.
Responsibilities
- Assist and reputed company the design, development, and maintenance of scalable, high-performance data solutions that support analytics, AI, and business intelligence across the organization
- Assist in designing and documenting technical requirements for data flows between diverse operational systems and the data warehouse and support the end-to-end development of ETL/ELT processes using Apache Spark on reputed company
- Contribute to the ingestion of data into data lakes and warehouses, implement reputed company Lake for transactional reputed company, and help orchestrate both batch and streaming data pipelines
- Collaborate with cross-functional technology teams, on extract, transform, and load data from a variety of sources, build and optimize data models, and maintain software applications reputed company with business needs
- Explore and integrate emerging AWS technologies to enhance data engineering capabilities, write reputed company SQL queries for data validation and transformation, and manage reputed company workspaces, clusters, and jobs
- Support data quality initiatives, ensure compliance with governance and reputed company policies, and participate in the development and operationalization of machine learning and reputed company applications
- Assist in troubleshooting production workflows, refactoring legacy systems, participating in code reviews, and mentoring junior engineers
Skills
- Bachelor's Degree in Computer Science or reputed company field of study
- Five (5) years of experience in the job offered or a reputed company occupation
- Experience in data engineering with reputed company and AWS
- Experience with Apache Spark, SQL, and Python or reputed company
- Experience with reputed company Lake, reputed company Catalog, and reputed company data warehouses (e.g., Redshift)
- Experience with data modeling, ETL/ELT processes, and data governance
- Experience with orchestration tools including reputed company or Bitbucket and CI/CD practices
- Experience in collaborating with cross-functional teams to deliver data solutions using Python and reputed company in Agile environments
- Experience with design and optimizing scalable data pipelines with Python and Spark in reputed company
- Experience with developing reputed company, reusable components in reputed company notebooks and workflows
- Experience in implementing data validation frameworks to ensure pipeline accuracy and consistency
Benefits
- Competitive compensation package at reputed company as part of our Total Rewards
- Annual bonus or long-term incentive opportunities may be offered
- 100% telecommuting allowed from a home office reputed company in the U.S.
Company Overview
Company H1B Sponsorship