Experienced Full Stack Data Engineer – Web & Cloud Application Development
Join arenaflex, a leading logistics and transportation company, as we seek enthusiastic and talented individuals to fill immediate openings in our data engineering team. As a data engineer at arenaflex, you will play a vital role in designing, developing, and maintaining large-scale data pipelines, working closely with cross-functional teams to drive business growth and innovation.
About arenaflex
arenaflex is a global leader in logistics and transportation, with a rich history of innovation and customer satisfaction. Our company is built on a strong foundation of teamwork, collaboration, and a passion for delivering exceptional results. As a data engineer at arenaflex, you will be part of a dynamic and fast-paced team that is shaping the future of logistics and transportation.
Key Responsibilities
As a data engineer at arenaflex, your key responsibilities will include:
- Designing, developing, and maintaining large-scale data pipelines to support business growth and innovation
- Collaborating with cross-functional teams to drive business outcomes and deliver exceptional results
- Developing and implementing data engineering solutions to support data-driven decision-making
- Working closely with data scientists and analysts to develop and deploy machine learning models and predictive analytics
- Ensuring data quality, integrity, and security across all data pipelines and systems
- Troubleshooting and resolving complex technical issues related to data engineering and data science
- Developing and maintaining technical documentation and knowledge base for data engineering and data science teams
- Collaborating with senior technologists and data scientists to develop and implement new technologies and solutions
Unexpected Expected Set of Responsibilities
As a data engineer at arenaflex, you will also be expected to:
- Work closely with data architects to design and develop data models and data warehouses
- Collaborate with data scientists to develop and deploy machine learning models and predictive analytics
- Develop and maintain data engineering solutions to support data-driven decision-making
- Work closely with business stakeholders to understand business requirements and develop solutions to meet those needs
- Collaborate with cross-functional teams to develop and implement new technologies and solutions
Fundamental Work Obligations and Obligations
As a data engineer at arenaflex, your fundamental work obligations and obligations will include:
- Understanding both the business and technical issues that data engineering solutions aim to address
- Building tools, platforms, and pipelines to enable teams to clearly and neatly investigate data, build models, and drive decisions
- Scaling from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method
- Collaborating across teams to drive the creation of data-driven functional insights that yield high-value improved solutions
- Delivering clear and actionable value quickly, collaborating with diverse teams of varying backgrounds and disciplines
- Classifying best practices for future reuse as available, reusable examples, templates, and code bases
- Engaging with senior technologists from the broader project and beyond arenaflex (partner environments and clients) to create collaborative energies and ensure smooth handoffs to downstream functional systems
Expertise/Information Thought about an Or more
To be successful as a data engineer at arenaflex, you will need:
- A strong foundation in software engineering, programming, database systems, and distributed systems
- Familiarity with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties
- Experience in building robust cloud-based data engineering and curation solutions to make data products useful for various applications
- In-depth knowledge of the Microsoft Azure tooling for large-scale data engineering endeavors and solutions is highly preferred. Experience with any combination of the following Azure tools: Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Machine Learning
- Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances
- Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues
- A compelling history of planning and delivering large-scale technical solutions that convey clear, ongoing value
- Direct experience having built and delivered strong, complex production systems that execute current, data processing strategies at scale
- Ability to set switch, to offer support to distributed teams which may require a "specialized programmer" to unblock a particularly difficult technical obstacle, and to figure out through issues as they are still being defined
- Demonstrated ability to deliver technical projects with a team, frequently working under close time constraints to deliver value
- An "engineering" attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify impact
- Comfort with working with distributed teams on code-based expectations, using version control systems and code reviews
- Ability to lead data analysis, investigation, and heredity studies to record and upgrade data quality and access
- Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery
Shown mastery working with some of the following common languages and tools:
* Spark (Scala and PySpark), Kafka and other high-volume data tools
- SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB
- Java, Python data tools
- Azure DevOps experience to follow work, develop using git-integrated version control examples, and build and use CI/CD pipelines
- Working knowledge and experience executing data engineering patterns to support shifting business needs
- Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions
- Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to execute streaming ingestions
- Experience creating and implementing warning and monitoring systems
- Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets
- Execution experience across various data stores, messaging frameworks, and data processing engines
- Data joining through APIs as well as REST service
- PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more
Least Capabilities:
Information Architect I:
* Four-year college education in Data Systems, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight
- Essential knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
- Essential knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
- Experience as a junior member of multi-functional project teams
- Solid oral and written communication skills
- A connected postgraduate education might counterbalance the connected experience prerequisites
Sponsorship isn't accessible for Information Designer I job.
Information Specialist II:
* Four-year certification in Software engineering, Data Systems, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight
- Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination
- Solid knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
- Solid knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
- Solid comprehension of the transportation business, contenders, and developing advancements
- Experience as a member of multi-functional project teams
- Solid oral and written communication skills
- A connected postgraduate education might balance the connected experience prerequisites
Sponsorship isn't accessible for Information Architect II job.
Information Designer III:
* Four-year college education in Data Systems, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight
- Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
- Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
- Broad knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
- Solid comprehension of the transportation business, contenders, and advancing advancements
- Experience giving authority in a general preparation or counseling setting
- Experience as a senior member of multi-functional project teams
- Solid oral and written communication skills
- A connected postgraduate education might counterbalance the connected experience necessities.
Information Designer Lead:
* Four-year college education in Data Systems, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight
- Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
- Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
- Broad knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
- Solid comprehension of the transportation business, contenders, and developing advancements
- Experience giving initiative in a general preparation or counseling setting
- Experience as a leader or a senior member of multi-functional project teams
- Solid oral and written communication skills
- A connected postgraduate education might balance the connected experience necessities.
Residence/Movement Data:
* This position can be domiciled anywhere in the US.
Application Standards:
* Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey.
Extra Data
Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Remuneration: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting salary range for this job. Factors that may be used to determine your actual salary may include your education, experience, and performance.
Top 10 Interview Questions
* Can you tell us about yourself?
- What interests you about this position?
- What are your strengths?
- What are your weaknesses?
- Can you give an example of a time when you solved a problem creatively?
- How do you handle stress and pressure?
- How would you describe your work style?
- Can you tell us about a time when you had to work with a difficult colleague or supervisor?
- How do you stay organized and prioritize tasks?
- What are your long-term career goals?
Document Required:
* Required Documents for This Recruitment: The candidate should have this Document Before Apply Online. Candidates Are Suggested To Read the Official Notification Before Applying.
- Document – Qualifications certificate with mark sheets.
- Passport size Photographs
- Signature
How to apply:
* All the eligible candidates can apply for This Job as mentioned below
- Read the official notification carefully From the Official Website.
- Read the Notification Carefully Before Applying.
- Fill out The Application Form (The link Is Given Below)
- Attach the Required Document and Passport Size Photo with Signature.
- Then Submit. Done.
Apply Job! Apply for this job