Data Engineer
VirtusaThis is a remote position.
We are looking for two Data Engineers to build and maintain the scalable pipelines and lakehouse infrastructure that power our analytics, machine learning, and AI agent platforms. You will ensure that clean, reliable, and well-governed data flows seamlessly from raw operational sources into analytical layers, knowledge graphs, and AI workflows.
Key Responsibilities:
-
Design, build, and maintain scalable batch and streaming ETL/ELT pipelines in cloud environments (Databricks / Snowflake / AWS / Azure).
-
Transform raw structured and semi-structured data into clean, curated analytical models (medallion architecture: Bronze/Silver/Gold) using SQL, Python, and dbt.
-
Implement automated data quality checks, schema validation, logging, and pipeline observability.
-
Collaborate closely with Ontology, Knowledge Graph, and Data Science teams to prepare reliable datasets for downstream graph ingestion and ML feature stores.
-
Enforce data governance, lineage, and security standards (role-based access control, PII handling, GDPR compliance).
Requirements
3+ years of hands-on experience as a Data Engineer building production data pipelines.
Strong proficiency in SQL and Python, with practical experience in distributed data processing (Databricks and PySpark).
Hands-on experience with modern data platforms (Databricks, Snowflake, AWS, or Azure) and transformation/orchestration tools (dbt, Apache Airflow, or Databricks Workflows).
Solid understanding of data modeling concepts (dimensional modeling, lakehouse architecture) and CI/CD best practices (Git).
Detail-oriented approach to data reliability, performance tuning, and pipeline monitoring.
Not the right fit? Get jobs like this by email
New developer jobs, straight to your inbox. Instant alerts or a weekly digest.
Free. No spam, unsubscribe anytime.