AI with Data Engineer

AI DATA ENGINEER

• Location: Plano, TX — Onsite
• Experience: 12+ Years
• Local candidates only

• Bean Infosystems LLC is seeking an experienced AI Data Engineer to design and deliver scalable enterprise data platforms that support Generative AI, machine learning, advanced analytics, and intelligent applications.
• The ideal candidate will combine strong data engineering expertise with hands-on experience in cloud platforms, distributed data processing, AI/ML pipelines, vector databases, RAG architectures, and production-grade data solutions.
• Key Responsibilities
• • Design and implement scalable batch and real-time data pipelines
• • Build data platforms that support Generative AI, machine learning, and analytics use cases
• • Develop ingestion, transformation, validation, and data-quality frameworks
• • Prepare structured and unstructured enterprise data for LLM and RAG applications
• • Build document-processing, chunking, embedding, indexing, and retrieval pipelines
• • Integrate vector databases and semantic-search solutions with enterprise applications
• • Develop data pipelines using Python, SQL, Spark, Kafka, and cloud-native technologies
• • Design data lake, data warehouse, lakehouse, and data-mesh solutions
• • Integrate data from APIs, databases, streaming platforms, files, and enterprise systems
• • Implement metadata management, lineage, governance, security, and access controls
• • Optimize data pipelines for scalability, reliability, performance, and cost
• • Establish automated testing, monitoring, alerting, and observability for data workflows
• • Collaborate with AI engineers, data scientists, architects, application teams, DevOps, and business stakeholders
• • Provide technical leadership, conduct code reviews, and mentor engineering teams
• • Support production deployments, incident resolution, and root-cause analysis
• Required Qualifications
• • 12+ years of experience in data engineering, software engineering, data architecture, or related roles
• • Strong hands-on experience with Python, SQL, Apache Spark, and distributed data processing
• • Experience building enterprise ETL/ELT and real-time streaming pipelines
• • Strong knowledge of Kafka or similar event-streaming technologies
• • Experience with AWS, Microsoft Azure, or Google Cloud Platform
• • Hands-on experience with Databricks, Snowflake, Synapse, BigQuery, Redshift, or similar platforms
• • Experience with Generative AI, LLMs, RAG architectures, embeddings, and semantic retrieval
• • Knowledge of vector databases such as Pinecone, Weaviate, Milvus, FAISS, pgvector, OpenSearch, or Azure AI Search
• • Experience integrating OpenAI, Azure OpenAI, Anthropic, Gemini, or open-source language models
• • Strong understanding of data modeling, data warehousing, lakehouse architecture, and data governance
• • Experience with Airflow, Azure Data Factory, AWS Glue, Informatica, dbt, or comparable orchestration tools
• • Experience with Docker, Kubernetes, Git, CI/CD, and infrastructure automation
• • Strong understanding of data security, privacy, lineage, quality, and regulatory compliance
• • Excellent analytical, troubleshooting, communication, and leadership skills
• • Must be local to the Plano/Dallas, TX area and available to work onsite
• Preferred Qualifications
• • Experience with LangChain, LangGraph, LlamaIndex, Semantic Kernel, or similar AI frameworks
• • Experience building enterprise AI data platforms and knowledge-retrieval solutions
• • Knowledge of MLOps, model deployment, feature stores, and AI observability
• • Experience with Azure AI Foundry, Azure Machine Learning, Amazon Bedrock, or Vertex AI
• • Experience in banking, financial services, healthcare, insurance, telecommunications, or another regulated industry
• • Relevant cloud, Databricks, Snowflake, data engineering, or AI certifications