Big Data Engineer

Bright Vision Technologies

🌍 Удалённо

Senior

Полная занятость

🌐 Глобал

Продуктовая

Tech

Описание вакансии

Обязанности

•Build data processing platforms

•Design big data pipelines

•Document data engineering solutions

•Ensure reliable performant data platforms

•Implement streaming data ingestion

•Ingest structured and unstructured data

•Operate Hadoop data platforms

•Support enterprise analytics

•Transform and analyze data

•Troubleshoot and debug data pipelines

Условия

•Remote work

Технологии: AWS EMR, Airflow, Apache Atlas, Apache Hudi, Apache Iceberg, Apache Spark, Azure HDInsight, CI/CD, Collibra, Databricks, Delta Lake, Distributed Systems, Flink, HBase, HDFS, Hadoop, Hive, Infrastructure as Code, Java, Kafka, Kubernetes, NoSQL, Oozie, Python, Python Scripting, SQL, Scala, Shell Scripting, Spark Streaming, Sqoop, Trino, “as-code”