Experienced Full Stack Data Engineer – AI Research and Deployment
At arenaflex, we're pushing the boundaries of AI capabilities and delivering these innovations to the world safely. Our mission is to harness AI's potential to solve significant global challenges, sharing its benefits broadly. We're seeking a skilled Data Engineer to lead the development of our data pipelines and foundational tables, collaborating closely with our researchers to help train new models for deployment to our clients.
About arenaflex
arenaflex is a leading AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We strive to push the boundaries of AI capabilities and deliver these innovations to the world safely. Our team is passionate about harnessing AI's potential to solve significant global challenges, sharing its benefits broadly.
Job Description
arenaflex is seeking a skilled Data Engineer to lead the development of our data pipelines and foundational tables. These pipelines are crucial for powering analytics, enhancing security systems, informing business decisions, fostering product innovation, and preventing disruptions. In this role, you will collaborate closely with our researchers to help train new models for deployment to our clients. Your data-driven insights will be instrumental in shaping arenaflex's future.
Responsibilities
* Design, build, and manage data pipelines, ensuring seamless integration of all client event data into our data warehouse.
- Develop standardized datasets to track key product metrics, including user growth, engagement, and revenue.
- Collaborate with teams across Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand data needs and provide solutions.
- Implement robust, fault-tolerant systems for data ingestion and processing.
- Contribute to data architecture and engineering decisions, bringing strong insights and expertise.
- Ensure the security, integrity, and compliance of data according to industry and company standards.
Key Responsibilities:
* Develop and maintain data pipelines, ensuring data quality and integrity.
- Collaborate with cross-functional teams to understand data needs and provide solutions.
- Design and implement data architectures, ensuring scalability and performance.
- Develop and maintain data visualizations, reports, and dashboards to support business decisions.
- Ensure data security, integrity, and compliance according to industry and company standards.
Qualifications
* Proficiency in at least one programming language commonly used in Data Engineering, such as Python, Scala, or Java.
- Experience with distributed processing technologies and frameworks like Hadoop, Flink, and storage systems such as HDFS and S3.
- Expertise in ETL schedulers like Apache Airflow, Dagster, or similar frameworks.
- Strong understanding of Apache Spark with the ability to write, debug, and optimize Spark code.
- Strong analytical and problem-solving skills, with the ability to communicate complex technical concepts to non-technical stakeholders.
Essential Qualifications:
* Bachelor's degree in Computer Science, Data Science, or related field.
- 3+ years of experience in Data Engineering, with a focus on data pipelines and foundational tables.
- Strong understanding of data architecture and engineering principles.
- Experience with cloud-based data platforms, such as AWS or GCP.
Preferred Qualifications:
* Master's degree in Computer Science, Data Science, or related field.
- 5+ years of experience in Data Engineering, with a focus on data pipelines and foundational tables.
- Experience with machine learning and AI, with a focus on model training and deployment.
- Strong understanding of data governance and compliance principles.
Skills and Competencies
* Strong analytical and problem-solving skills, with the ability to communicate complex technical concepts to non-technical stakeholders.
- Excellent collaboration and communication skills, with the ability to work effectively with cross-functional teams.
- Strong understanding of data architecture and engineering principles, with the ability to design and implement scalable and performant data systems.
- Experience with cloud-based data platforms, such as AWS or GCP.
- Strong understanding of data governance and compliance principles.
Career Growth Opportunities and Learning Benefits
* arenaflex offers a comprehensive training program, with opportunities for professional growth and development.
- Collaborate with experienced engineers and researchers to develop new skills and expertise.
- Participate in hackathons and innovation challenges to develop new ideas and solutions.
- Access to cutting-edge technologies and tools, with opportunities to experiment and innovate.
Work Environment and Company Culture
* arenaflex is a remote-first company, with a flexible and inclusive work environment.
- Collaborate with a diverse and talented team of engineers, researchers, and product managers.
- Participate in regular team-building activities and social events.
- Enjoy a comprehensive benefits package, including medical, dental, and vision insurance, mental health and wellness support, and 401(k) plan with a 4% company match.
Compensation, Perks, and Benefits
* Competitive salary of $25/hour, inclusive of generous equity and benefits.
- Comprehensive medical, dental, and vision insurance for you and your family.
- Mental health and wellness support.
- 401(k) plan with a 4% company match.
- Unlimited paid time off and 18+ company holidays annually.
- 20 weeks of paid parental leave and family-planning support.
Why Join arenaflex?
* arenaflex is a leading AI research and deployment company, with a mission to harness AI's potential to solve significant global challenges.
- Collaborate with a diverse and talented team of engineers, researchers, and product managers.
- Participate in regular team-building activities and social events.
- Enjoy a comprehensive benefits package, including medical, dental, and vision insurance, mental health and wellness support, and 401(k) plan with a 4% company match.
We Encourage You to Apply!
Even if you feel you're not a perfect match, we'd still love to hear from you. We are looking for great people to join our friendly team. Apply now to join arenaflex and contribute to a safer and more inclusive technological future. Apply for this job