Senior Data Engineer (Hybrid)

Senior Data Engineer Atlanta, GA | Hybrid Working An exciting opportunity has arisen for an experienced Senior Data Engineer to join a high-performing global AI and Data Engineering team focused on delivering advanced industrial AI, IoT, and real-time analytics solutions. This role offers the chance to work on cutting-edge technologies and large-scale data platforms that support intelligent automation and next-generation connected systems. The successful candidate will be responsible for designing and implementing scalable data architectures and high-performance pipelines that enable AI and machine learning capabilities across enterprise environments. Working closely with Data Scientists, ML Engineers, and cross-functional technical teams, you will help transform high-volume IoT telemetry and operational data into reliable, actionable insights that drive innovation and operational efficiency. This role will play a key part in developing modern AI-ready data platforms, including Retrieval Augmented Generation (RAG) systems, vector database integrations, embedding pipelines, and real-time streaming architectures. Key responsibilities include: • Designing and implementing scalable data architectures for AI and IoT workloads • Building and optimising batch and streaming pipelines using Databricks, Delta Lake, and PySpark • Developing robust machine learning and AI data workflows, including feature engineering and inference pipelines • Implementing DataOps best practices, automated testing frameworks, and data quality monitoring • Driving the integration of Generative AI capabilities into enterprise applications and workflows • Collaborating closely with ML Engineers and Data Scientists on model training, deployment, and optimisation • Mentoring team members and contributing to engineering best practices across the wider organisation Candidates should demonstrate strong hands-on experience with: • Databricks and distributed data processing at scale • Delta Lake, Delta Live Tables, and medallion architecture frameworks • PySpark and real-time streaming technologies such as Kafka or Event Hub • Cloud platforms including Azure and GCP • CI/CD workflows, GitHub Actions, and DataOps methodologies • RAG applications, vector databases, and LLM frameworks such as LangChain or LangGraph Additional experience working within AI-driven environments, industrial data platforms, or IoT ecosystems would be highly advantageous. This is an excellent opportunity to join a forward-thinking technology environment focused on innovation, digital transformation, and intelligent operations. The position offers strong long-term career progression, exposure to large-scale enterprise AI initiatives, and the opportunity to work alongside highly skilled engineering and data professionals. The role is based in Atlanta, GA on a hybrid working model. Please note that new hires will be expected to work onsite full-time during the initial onboarding period. Competitive salary & benefits For further information or a confidential discussion, please apply via LinkedIn