Чем предстоит заниматься
Intetics is looking for an experienced Data Engineer / Apache Airflow Specialist to join our distributed team for a data-driven project focused on large-scale ETL workflows, data indexing, and performance optimization
The specialist will design, implement, and optimize data pipelines using Apache Airflow, manage database performance on Oracle and PostgreSQL, and support Elasticsearch integration for efficient data retrieval and search operations
You will also be responsible for ensuring smooth deployment pipelines in GitLab and collaborating with a cross-functional engineering team to enhance the quality and reliability of complex data processes
Develop, orchestrate, and maintain complex Apache Airflow DAGs for ETL and data-processing pipelines
Build and optimize Python-based ETL scripts, integrating with Flask APIs when needed
Design and manage Elasticsearch indexing and performance tuning workflows
Handle Unix/Linux scripting and operations for automation and monitoring
Work with Oracle and PostgreSQL databases for large-scale data processing
Implement and maintain GitLab CI/CD pipelines for build, test, and deploy stages
Collaborate with the project team to ensure scalability, reliability, and quality of data solutions