Data Engineer
Here is a complete and polished Job Description (JD) for the Data Engineer role based on your requirements:
Job Title: Data EngineerJob Location: Poland (Remote)
Employment Type: B2B Contract
About the Role
We are looking for a skilled Data Engineer to join our team on a B2B contract basis for an exciting opportunity with our client, Coforge. This role is fully remote with potential occasional travel on a need basis. The ideal candidate will be based in Poland and have a strong background in data engineering, cloud technologies, and infrastructure automation.
As a Data Engineer, you will work closely with cross-functional teams to design, build, and maintain scalable data pipelines and platforms. You’ll play a critical role in enabling data-driven decision-making across the organization by ensuring data is accurate, accessible, and well-structured.
Key Responsibilities- Design, develop, and maintain scalable and reliable data pipelines on AWS.
- Build and automate data workflows and ETL processes using Python and AWS services.
- Collaborate with data scientists, analysts, and other engineers to understand data requirements and implement effective data solutions.
- Use AWS CDK to provision and manage cloud infrastructure following best practices.
- Implement CI/CD pipelines to streamline development and deployment workflows.
- Ensure data quality, integrity, and governance across all systems.
- Monitor data pipeline performance and troubleshoot issues proactively.
- Participate in code reviews and contribute to continuous improvement efforts.
- Strong experience as a Data Engineer working on cloud-based data solutions.
- Proficiency in AWS services (e.g., S3, Glue, Lambda, Redshift, etc.).
- Advanced Python programming skills for data processing and automation.
- Hands-on experience with CI/CD tools and practices (e.g., GitLab CI, Jenkins).
- Experience with AWS CDK (Cloud Development Kit) for infrastructure as code.
- Solid understanding of software engineering best practices, including version control, testing, and documentation.
- Familiarity with data modeling and data warehousing concepts.
- Experience with containerization (Docker, ECS/EKS) is a plus.
- Knowledge of data security and compliance requirements.
- Prior experience working in an Agile environment.