Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python

Senior Data Engineer (GenAI / AWS)

Duration: 3+ Months (Extension Possible)

Experience: 14+ years Cloud Platform: AWS Primary Language: Python

Key Responsibilities

• Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
• Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
• Implement document chunking, embeddings, vector indexing, and semantic search.
• Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
• Integrate knowledge bases with AI agents for contextual information retrieval.
• Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
• Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
• Optimize data pipelines for scalability, reliability, security, and performance.

All your information will be kept confidential according to EEO guidelines.

Originally posted on Himalayas