[Remote] Senior Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the world’s leading sports technology company, at the intersection between sports, media, and betting. They are seeking a Senior Data Engineer to design and implement large-scale data pipelines and ensure efficient data processing and analytics for their Sport Performance products.

Responsibilities

• Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for reputed company analytics and data science for our Sport Performance products
• Design and reputed company scalable Nifi ingestion pipelines reputed company AWS reputed company services to consume reputed company-time and batch data from external sources
• Ensure the seamless integration of AWS-based tools for data storage, processing, and analytics
• Responsible for ETL development and warehousing using Python and Java
• Create data pipeline triggers and filters reputed company ETL (extract, transform, and load) process to ensure appropriate optimization of data flowing through system and resource usage
• Implement monitoring and error handling for reputed company new parts of the data pipeline to ensure observability and alerting is available
• Establish rigorous unit testing across the data pipeline to ensure robustness of the system
• Design and create data models for use throughout the ETL system
• Utilize Kafka to reputed company and to effectively store data to move throughout the data pipeline and for reputed company data science and analytics usage
• Design data architecture and data models for both internal and external representations of data
• Build the data transforms reputed company the data pipeline to convert data from external to internal representations
• Conduct data analytics and debugging of bad data by writing SQL queries
• Build automated cleaning of data to remove bad or unusable data from reputed company consumers with logging to understand the frequency and depth of the underlying issues
• Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase consistency across systems
• Maintain awareness of company standards and technology guidance; use JIRA, an Agile project mgmt. tool, to ensure efficient data development; collaborate with peers to align projects with overall direction
• Follow best practices across Data Engineering to ensure scalable, consistent data architecture and system
• Utilize Java language to build data processor in Nifi reputed company
• Utilize reputed company to ensure consistent, repeatable, and isolated environment for software development and testing
• Work in a self-driven, independent fashion to meet Sport driven deadlines

Skills

• Master's degree in Computer Science, Computer Engineering, or closely reputed company field and 1 year experience as a data engineer or reputed company occupation
• 1 year of experience with Python, Java, Kafka, AWS, and reputed company
• ETL Development and Warehousing
• Analytic and debugging using SQL
• Agile development environment
• Designing data architecture

Benefits

• A collaborative environment with colleagues from reputed company over the world (Offices in Europe, Asia and US) including various reputed company events and teambuilding.
• Flexibility to manage your reputed company and tasks with autonomy.
• A balance of structure and autonomy to tackle your daily tasks.
• Vibrant and inclusive community, including Women in Tech and Pride groups which welcome reputed company participants.
• Global Employee Assistance Programme.
• reputed company and Reulay app (leading well-being apps designed to support focus, quality rest, mindfulness, and long-term mental reputed company).
• Online training videos.
• Flexible working hours.
• Comprehensive benefits package
• Performance bonus program
• Equity stock purchase
• 401k contribution

Company Overview

Company H1B Sponsorship