Senior Data Engineer
Senior Data EngineerHybrid - NYCOur client is looking for a Data Engineer with experience in building and optimizing data pipelines, performing ELT processes, and working within a modern data stack.Top 3 skills needed:
BigQuery, DBT, Airflow (or another orchestrator)
Responsibilities:
Collaborate with cross-functional teams and stakeholders to understand data requirements and implement solutions accordingly. Work closely with data scientists to implement efficient ELT processes and performant SQL Ensure data observability, quality, and integrity throughout the data pipeline. Utilize orchestration tools such as Apache Airflow, Dagster, or Luigi to manage and schedule dbt workflows. Optimize and tune existing data pipelines for improved performance, lower cost, and scalability. Design, develop, test, and maintain data architecture to facilitate the extraction, storage, and transformation of raw data for downstream utilization by data scientists Requirements:
5-8
years of experience in data engineering or a similar role. Proficiency in building and maintaining data pipelines using tools like Luigi, Dagster, Apache Airflow, or similar. Programming skills in Python with a strong sense of engineering best practices. Experience working with cloud-based data storage solutions (ideally Google Cloud Storage) Familiarity with dbt best practices Experience with SQL for querying and manipulating large datasets. Familiarity with data modeling concepts and tools. Experience in working with columnar warehouses (ie Bigquery) and relational databases (ie Postgres) Compensation:
$160,000-$190,000 base
equity No visa sponsor/transfers available at this time. No C2C/C2HResearch indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don't worry if you don't tick every single box. We'd still love to hear from you. We encourage underrepresented talent to apply to all our roles& support accessibility needs. Recommended Skills Data Modeling Concepts Data Pipeline Postgre Sql Python (Programming Language) Relational Databases Sql Databases Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
BigQuery, DBT, Airflow (or another orchestrator)
Responsibilities:
Collaborate with cross-functional teams and stakeholders to understand data requirements and implement solutions accordingly. Work closely with data scientists to implement efficient ELT processes and performant SQL Ensure data observability, quality, and integrity throughout the data pipeline. Utilize orchestration tools such as Apache Airflow, Dagster, or Luigi to manage and schedule dbt workflows. Optimize and tune existing data pipelines for improved performance, lower cost, and scalability. Design, develop, test, and maintain data architecture to facilitate the extraction, storage, and transformation of raw data for downstream utilization by data scientists Requirements:
5-8
years of experience in data engineering or a similar role. Proficiency in building and maintaining data pipelines using tools like Luigi, Dagster, Apache Airflow, or similar. Programming skills in Python with a strong sense of engineering best practices. Experience working with cloud-based data storage solutions (ideally Google Cloud Storage) Familiarity with dbt best practices Experience with SQL for querying and manipulating large datasets. Familiarity with data modeling concepts and tools. Experience in working with columnar warehouses (ie Bigquery) and relational databases (ie Postgres) Compensation:
$160,000-$190,000 base
equity No visa sponsor/transfers available at this time. No C2C/C2HResearch indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don't worry if you don't tick every single box. We'd still love to hear from you. We encourage underrepresented talent to apply to all our roles& support accessibility needs. Recommended Skills Data Modeling Concepts Data Pipeline Postgre Sql Python (Programming Language) Relational Databases Sql Databases Apply to this job. Think you're the perfect candidate? Apply on company site $(document).ready( function() $(#ads-desktop-placeholder).html(
n
n
n Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
