Principal AI Data Engineer : Commodity Trading

Exciting Contract Opportunity for a Principal AI Data Engineer to lead a long term Data Platform Build.

A global Commodity Trader requires an experienced Technical Lead to design and deliver scalable data and AI solutions.

The role combines hands-on engineering, AI experimentation and technical leadership, taking solutions from prototype to production while supporting the development of enterprise AI capabilities.

Key Responsibilities

• Design, develop and deploy GenAI, Agentic AI and RAG solutions
• Build scalable data pipelines and architectures for structured and unstructured datasets
• Develop AI agents and workflows using modern LLMs and frameworks
• Implement AI evaluation, testing and benchmarking frameworks
• Leverage Databricks, MLflow, Python and cloud-based AI services
• Establish engineering best practices across CI/CD, testing, version control and deployment
• Contribute to solution architecture, technical roadmaps and delivery backlogs
• Work closely with business stakeholders to translate requirements into production-ready solutions

Core Experience Required:

• 8-12 years of experience
• Strong hands-on experience in AI, GenAI and data engineering
• Advanced knowledge of Databricks, MLflow, Delta Lake and data architecture
• Strong Python and SQL programming skills
• Experience with LLMs, RAG architectures, AI agents, LangChain and LangGraph
• Understanding of data pipelines, ETL/ELT, streaming and cloud technologies, preferably Azure
• Experience with AI evaluation, benchmarking and production deployment
• Strong software engineering practices, including Git, CI/CD and automated testing
• Excellent problem-solving, communication and stakeholder management skills
• Ability to provide technical leadership, drive delivery and work independently

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years.

We are ISO accredited and proud of our excellent TrustPilot Reviews. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.