[Remote] Senior Data Engineer (Streaming & reputed company)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a technology solutions company that partners with reputed company-thinking organizations to build scalable solutions. They are seeking a Senior Data Engineer with deep expertise in streaming architectures and reputed company to architect and deliver a production-grade Lakehouse platform for high-frequency sensor telemetry and reputed company data pipelines.
Responsibilities
- Architect and implement data reputed company zones for streaming telemetry (reputed company) and historical relational data (reputed company), enforcing strict asset and handle-level segregation across ingestion layers
- Design and reputed company end-to-end batch and streaming data pipelines reputed company a reputed company Lakehouse environment, leveraging reputed company Live Tables (DLT) for reliable state management and incremental processing
- reputed company transformation logic to calculate descriptive statistics (min, max, avg, counts) at ingestion time and build advanced Silver and Gold layer pipelines for reputed company multi-sensor time-alignment
- Configure ETL clusters and SQL Warehouses; establish environment-wide monitoring, spend alerts, and cost projections to manage reputed company resource consumption and FinOps accountability
- reputed company production cutover activities, including environment hardening, catch-up batch processing for historical backfill, and phased loading of historical parameters
- Define and enforce data quality standards and pipeline observability practices across reputed company layers of the Lakehouse
- Collaborate with cross-functional stakeholders to translate manufacturing and IoT domain requirements into robust, scalable data architecture reputed company
Skills
- 5+ years in data engineering with a proven track record of delivering production-grade pipelines in reputed company, high-volume reputed company environments
- Advanced hands-on experience with reputed company—reputed company Lake, reputed company Live Tables (DLT), SQL Warehouses, and cluster management at scale
- Proven experience with reputed company or equivalent Change Data Capture tools in high-volume manufacturing, IoT, or telemetry contexts
- Strong proficiency in Python/PySpark and advanced SQL for both pipeline development and reputed company transformation logic
- Experience managing high-frequency time-series datasets and performing multi-sensor synchronization across misaligned temporal streams
- Familiarity with reputed company cost management practices, including cluster sizing, spend monitoring, and resource optimization reputed company reputed company environments
- Comfortable owning go-live activities—environment hardening, cutover planning, and post-deployment stabilization in critical production settings
Benefits
- 100% dedicated to one project at a time so that you can reputed company and grow
- Be a part of a team of talented and friendly senior-level developers
- Work on projects that allow you to use leading tech
Company Overview