Data Pipeline Engineer
RemoteAI · United States
- Type: full time
- Location: country
- Compensation: USD 110000–145000
- Timezone: UTC-8 to UTC-4
About the role
Build robust data pipelines that feed our ML models.\n\nTech stack:\n- Python, Apache Airflow\n- Snowflake, dbt\n- AWS (S3, Redshift, Lambda)\n- Event streaming with Kafka
What You Will Do
As a Data Pipeline Engineer, you will design, build, and maintain robust data pipelines that fuel our analytics and machine learning initiatives. You will leverage your expertise in Python to develop efficient data ingestion and transformation jobs, orchestrating them seamlessly using Apache Airflow. Your work will involve modeling and optimizing data structures within Snowflake, ensuring high performance and scalability for complex queries. You will also integrate and manage data streams from various sources, including those using Kafka, and contribute to the development of data transformation logic with dbt, all within our AWS ecosystem.
Why Join Us
This is an exciting opportunity to join a forward-thinking data team where innovation and collaboration are paramount. You'll have the chance to work on challenging and impactful projects that directly influence business decisions, utilizing cutting-edge technologies in a fully remote environment. We foster a culture of continuous learning and provide ample opportunities for professional growth, allowing you to expand your skillset and career trajectory as we scale.
Who You Are
You are a proactive and detail-oriented engineer with a passion for building reliable data systems. You possess strong problem-solving abilities and thrive in environments where you can architect efficient solutions using technologies like Python and Apache Airflow. You are comfortable working independently within a remote setting, possess excellent communication skills, and are eager to contribute to a collaborative team culture. Your experience with Snowflake, AWS, Kafka, and dbt makes you an ideal candidate to hit the ground running.
Required skills
- Python
- Apache Airflow
- Snowflake
- AWS
- Kafka
- dbt
About RemoteAI
AI-powered hiring and talent matching platform.