Extracted from the posting
TL;DR
Designs, builds, and maintains scalable ETL/ELT data pipelines using Snowflake and Apache Airflow, including Airflow DAGs and Snowflake schemas, tables, and views. Writes SQL transformations and Python automation, and implements data validation and monitoring. Works with senior engineers, software developers, and analysts.
The full posting
Who is Element?
We serve as a partner at the intersection of innovation and our clients' needs, efficiently crafting meaningful user experiences for government and commercial customers. By breaking complex problems down into their fundamental elements, we create modern digital solutions that drive efficiency, maximize taxpayer dollars, and deliver essential outcomes that serve the people.
Why Work at Element?
Make an impact that resonates-join our vibrant team and discover how you can improve lives through digital transformation. Our talented professionals bring unparalleled energy and engagement, setting a higher standard for impactful work. Be a part of our team and shape a better future.
Position Summary
Element Solutions is looking for an analytical and critical thinking Data Engineer. The Data Engineer is responsible for designing, developing, implementing, and maintaining scalable data pipelines and data solutions that support customer and organizational needs. This role leverages Snowflake and Apache Airflow to build and manage data integration workflows, optimize data processing, and ensure data quality, reliability, and accessibility.
The Data Engineer works collaboratively with senior engineers, software developers, data analysts, and other project stakeholders to translate technical and business requirements into effective data solutions. This position requires hands-on experience with cloud-based data platforms, workflow orchestration, SQL development, automation, and data pipeline monitoring. The ideal candidate can independently manage routine engineering tasks, troubleshoot technical issues, and contribute to the continuous improvement of data infrastructure and engineering practices.
Key Responsibilities
- Design, build, and maintain reliable, scalable ETL/ELT pipelines for ingesting, transforming, and delivering data.
- Develop Apache Airflow DAGs to orchestrate pipeline tasks, schedules, dependencies, and data-processing workflows.
- Integrate data from sources such as databases, APIs, and files, applying appropriate transformations and preserving data consistency.
- Develop SQL transformations and Snowflake data structures to support downstream data use.
- Build reusable pipeline components and automate recurring processes to improve maintainability and reduce manual effort.
- Support pipeline configuration and deployments across development, test, and production environments.
- Develop and maintain Snowflake database objects, including schemas, tables, and views.
- Implement data loading and transformation processes using Snowflake capabilities and the organization’s approved integration tools.
- Optimize SQL queries and Snowflake workloads by evaluating query performance, warehouse sizing and utilization, and cost.
- Apply appropriate Snowflake data modeling and performance optimization techniques, including clustering when beneficial for the workload.
- Implement and maintain Snowflake roles and permissions in accordance with organizational and customer security requirements.
- Configure Airflow schedules, task dependencies, retries, timeouts, and failure handling to support reliable data workflows.
- Monitor workflow runs, investigate failures, and implement corrective actions to prevent recurring issues.
- Configure alerts and operational logging to support timely detection and troubleshooting of pipeline issues.
- Develop Python scripts and automation to support pipeline operations; use SQL where appropriate for data transformations.
- Maintain workflow and operational documentation, including dependencies, recovery steps, and troubleshooting guidance.
- Develop and maintain automated data validation checks and tests to assess accuracy, completeness, consistency, and integrity.
- Investigate and resolve data-quality issues, documenting their causes and corrective actions.
- Follow established data governance, privacy, security, and access-management requirements when handling data.
- Document data lineage and transformation logic to support traceability and maintainability.
- Follow established procedures for error handling and data recovery, and support compliance with applicable customer, organizational, and regulatory requirements.
- Work with technical teams and stakeholders to clarify data requirements and deliver practical engineering solutions.
- Participate in code reviews, technical design discussions, and development planning.
- Contribute to shared engineering practices for version control, automated testing, and CI/CD.
- Identify and propose improvements to the reliability, scalability, maintainability, and cost efficiency of data solutions.
- Share knowledge with teammates and provide technical guidance when appropriate.
- Perform other related duties as assigned.
Minimum Requirements
Preferred Qualifications
Our People
We invest in the lives of our employees, both in and out of the workplace, by providing competitive pay and benefits packages. Benefits offered may include health care, dental, vision, life insurance; 401(k); paid time off including PTO, holidays, and any other paid leave required by law.
Location
Be in your Element. We are a remote first company based out of Washington, DC. As a HUBZone-certified business we are committed to supporting local economic development.
Element is an equal opportunity employer All qualified applicants will receive consideration for employment without regard to age, ancestry, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status, marital status, protected veteran status, or any other legally protected class.
We believe in a world where solutions we build improve the lives of those who use them.
Compensation: USD 95,000 – 106,000 per year salary