Data First Jobs

SoTalent

Senior Data Scientist II

Full Time ยท In Office ยท Raleigh, North Carolina (USA)

Posted Sep 28, 2026

Work Options
Seniority Level
Skills
Job Type
Position Group
  • Senior Data Scientist II
  • ๐Ÿ“ Location: Raleigh, North Carolina, United States
  • ๐Ÿข Industry: Technology, Information and Media
  • ๐Ÿ’ผ Work Setting: Hybrid
  • Are you passionate about building production-grade Generative AI solutions, architecting intelligent agent systems, and applying advanced machine learning to solve complex real-world challenges at scale?
  • We are seeking a Senior Data Scientist II to lead the design, development, and optimization of AI-powered applications that leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and modern machine learning techniques. This role combines data science, software engineering, AI architecture, and platform reliability, requiring ownership of AI solutions from experimentation through production deployment and continuous optimization.
  • Key Responsibilities
  • Architect, design, and develop scalable AI-powered applications utilizing Generative AI, machine learning, and retrieval technologies.
  • Build modular agent-based systems and intelligent workflows that support complex business and knowledge-driven use cases.
  • Design and optimize Retrieval-Augmented Generation (RAG) pipelines to improve relevance, accuracy, and performance of AI-powered solutions.
  • Refactor, enhance, and maintain complex Python-based applications to improve scalability, reliability, and maintainability.
  • Develop APIs, services, and backend components that support AI model integration and deployment.
  • Collaborate with product, engineering, and data teams to translate business requirements into production-ready AI solutions.
  • Ensure production readiness through rigorous testing, monitoring, logging, and observability practices.
  • Optimize model inference, retrieval workflows, and system performance across distributed environments.
  • Establish metrics, dashboards, and monitoring frameworks to track application health, model quality, and operational performance.
  • Support deployment, lifecycle management, and continuous improvement of AI and machine learning systems.
  • Drive software engineering best practices including code reviews, testing automation, documentation, and architectural governance.
  • Evaluate emerging AI technologies and recommend innovative solutions to enhance platform capabilities.
  • Required Qualifications
  • Bachelor's, Master's, or PhD in Computer Science, Data Science, Machine Learning, Artificial Intelligence, Engineering, or a related quantitative discipline.
  • Strong experience developing and deploying machine learning and Generative AI solutions in production environments.
  • Advanced proficiency in Python with expertise in software development, system design, and code optimization.
  • Deep understanding of Large Language Models (LLMs), prompt engineering, and retrieval-based AI systems.
  • Hands-on experience designing and implementing Retrieval-Augmented Generation (RAG) solutions.
  • Strong software engineering fundamentals including testing, version control, CI/CD, and application architecture.
  • Experience building distributed applications and scalable backend services.
  • Knowledge of monitoring, observability, logging, and production support practices.
  • Experience with API design, integration, and service-oriented architectures.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration abilities in cross-functional environments.
  • Preferred Qualifications
  • Experience developing agentic AI applications and autonomous workflow systems.
  • Familiarity with OpenSearch, Solr, vector search technologies, and semantic retrieval systems.
  • Experience optimizing LLM inference pipelines and production AI architectures.
  • Knowledge of cloud-native AI platforms, distributed computing, and MLOps practices.
  • Experience implementing governance, reliability, and security controls for AI systems.
  • Background working on enterprise-scale or customer-facing AI products.
  • Key Skills
  • Generative AI
  • Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • Python
  • Machine Learning
  • Data Science
  • Agentic AI Applications
  • Software Engineering
  • Distributed Systems
  • API Design
  • OpenSearch
  • Solr
  • Vector Search
  • Monitoring & Logging
  • Observability
  • Production AI Systems
  • MLOps
  • System Architecture
  • Performance Optimization
  • Cloud Technologies

Mention you found this on Data First Jobs โ€” it helps us bring you more roles like this.

Senior Data Scientist II

SoTalent

Like this role? Get carefully selected jobs like it, twice a week, straight to your inbox.

Free, no spam. Unsubscribe anytime.