Data Engineer

12 Августа

Партнерские Вакансии

Компания "Nitka Technologies, Inc."

Nitka Technologies develops software for customers in the US and Europe and brings together about 300 professionals from Eastern Europe, North and South America, Armenia, Georgia and Kazakhstan.

We are looking for an experienced Data Engineer for a long-term project. The customer is a company in California, an industry leader in the sale of tickets to events in Europe and the USA.

We offer 100% remote, full-time work

Responsibilities:

• Lead discovery and requirements-gathering sessions with business stakeholders; document source schemas and define analytics-ready data model specifications;  
• Build, optimize and maintain end-to-end data pipelines ETL/ELT frameworks with reusable dbt macros, incremental models, and snapshot patterns to ensure fault-tolerant, scalable data delivery;
• Design and implement data models following medallion architecture patterns (bronze/silver/gold), creating foundational tables, star schemas, and reporting marts with defined SLAs and data quality contracts;
• Tune Spark jobs and pipeline components to meet SLA requirements by optimizing partitions, reducing shuffle, and implementing efficient transformation patterns;
• Implement automated data quality checks using frameworks like Great Expectations, establishing quality contracts across pipeline layers;
• Diagnose complex, multi-system pipeline issues—profiling Spark UI stages, tracing Kafka consumer lag, identifying dbt dependency failures—and design mitigations proactively;
• Create and maintain technical documentation, data model diagrams, and operational runbooks for production support;

 Requirements:

• 5+ years of Data engineering experience;
• Advanced proficiency in Python, Spark, and SQL;
• Strong experience with AWS and Databricks;
• Familiarity with Kafka and modern Data stack tools (DBT, Airflow or equivalent);
• Deep understanding of dimensional modeling (star/snowflake schemas), medallion architecture, data warehouse design principles;
• AI fluency: able to structure problems to leverage AI assistance and design pipelines that assume AI-assisted development;  
• Knowledge of system topologies (lambda, kappa, lakehouse);
• Strong spoken English (Intermediate level and higher).

Working conditions:

• Remote work
• Full-time (8 hours/day)
• Attractive USD compensation
• Paid vacation, holidays