Senior GCP Engineer – AI/ML

Senior GCP Engineer – AI/ML

Work Arrangement: 100% Remote
Job Type: Long-Term Contract
Pay Rate: $41.25/hour
Experience: 10+ Years
Candidate Requirement: Valid Passport Required
Eligibility: No OPT or Green Card (GC) candidates

Job Overview

We are seeking a Senior GCP Engineer with strong AI/ML and Generative AI expertise to support the development, integration, optimization, and management of enterprise AI solutions on Google Cloud Platform (GCP).

The ideal candidate will have hands-on experience with Vertex AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), prompt engineering, Model Context Protocol (MCP), and AI integrations.

You will be responsible for building and optimizing RAG pipelines, integrating AI assistants with internal and external data sources, managing LLM workflows, and improving the accuracy, reliability, and security of AI-generated responses.

Key Responsibilities

RAG & Knowledge Generation

• Build, maintain, and optimize Retrieval-Augmented Generation (RAG) pipelines.
• Troubleshoot retrieval bottlenecks and improve search and retrieval performance.
• Refine knowledge taxonomies and content structures.
• Analyze user feedback and adjust prompts to improve response quality.
• Identify and reduce LLM hallucinations.
• Improve the accuracy, relevance, and consistency of AI-generated responses.

AI Integrations & MCP

• Design, develop, and deploy connectors that integrate digital assistants with backend systems and data stores.
• Implement Model Context Protocol (MCP) integrations to standardize communication between LLMs, tools, databases, and external services.
• Develop AI connectors and integrations across enterprise data sources.
• Implement secure and reliable data-access mechanisms for AI applications.

Vertex AI & AI Workflow Management

• Develop and manage AI/ML workflows using Google Cloud and Vertex AI.
• Configure and optimize model parameters.
• Manage context windows and optimize context delivery.
• Monitor AI application and model performance across the GCP ecosystem.
• Troubleshoot performance and integration issues within AI/ML workflows.

Advanced LLM Engineering

• Implement tool calling and function calling capabilities.
• Apply advanced prompt engineering techniques.
• Optimize LLM context and response generation.
• Develop fallback and error-handling mechanisms.
• Improve end-to-end response accuracy, reliability, and performance.

Technical Support & Governance

• Collaborate with data, engineering, product, and AI teams.
• Establish and maintain knowledge and content governance practices.
• Troubleshoot connectivity and integration issues.
• Support enterprise AI application reliability and scalability.
• Help establish best practices for secure and responsible AI implementation.

Required Qualifications

Experience

• 10+ years of total IT experience.
• Senior-level experience in cloud engineering and enterprise AI/ML solutions.
• Proven experience designing and supporting enterprise-scale cloud applications.

GCP & AI/ML

• Deep expertise with Google Cloud Platform (GCP).
• Strong hands-on experience with Google Vertex AI.
• Experience developing and managing enterprise AI/ML solutions.
• Strong understanding of Generative AI and Large Language Models (LLMs).

RAG & LLM

• Hands-on experience building and tuning Retrieval-Augmented Generation (RAG) pipelines.
• Strong experience with LLM integration and optimization.
• Advanced prompt engineering experience.
• Experience optimizing AI-generated responses and reducing hallucinations.
• Experience with context management and context window optimization.

MCP & AI Integration

• Practical experience with Model Context Protocol (MCP).
• Experience implementing tool calling/function calling.
• Experience developing AI connectors and integrations.
• Experience connecting LLM-powered applications with databases, APIs, and enterprise data sources.

Knowledge Governance

• Experience with knowledge curation and content management.
• Understanding of content taxonomy and knowledge organization.
• Experience improving AI response quality through knowledge optimization and user feedback.
• Strong understanding of data accuracy, security, and governance.

Ideal Candidate

The ideal candidate is a senior cloud and AI/ML engineer who can work across GCP infrastructure, Vertex AI, RAG, LLMs, MCP, and enterprise AI integrations. You should be comfortable troubleshooting complex AI workflows, improving model responses, and collaborating with cross-functional technical teams.

Work Requirements

• 100% Remote
• Long-term contract opportunity.
• 10+ years of IT experience required.
• Valid passport required.
• OPT candidates are not eligible.
• Green Card (GC) candidates are not eligible.