Описание вакансии
Обязанности
•Analyze complex data sets
•Apply quality assurance best practices
•Create test coverage
•Develop ETL pipelines
•Develop and test interfaces
•Enhance ETL logic
•Handle CI CD automation
•Implement data asset quality guidelines
•Perform performance testing
•Run code scanning and security scanning
•Transform data using AWS and Hadoop
•Troubleshoot software components
•Validate and verify data transformations
Технологии: AWS, Agent Frameworks, Apache Spark, Athena, Aurora, Automated testing, CI/CD, Code Scanning, Data Quality, EC2, ETL, Glue, Hadoop, Kafka, LLM, Lambda, Performance Testing, Prompt engineering, Python, RDS, Redshift, S3, SQL, Secure Coding, Shell Scripting, Spark SQL, Streaming, Unit Testing, Unix Shell, Unix/Shell Scripting
