United States
Be Structured Technology Group
Aviso, LLC
AI Implementation Engineer
United States
Fremont, California, United States
AWS
Position Overview
We are seeking a Staff IT AI Implementation Engineer to lead the architecture, deployment, and operational oversight of our enterprise AI ecosystem. Sitting at the intersection of hands-on technical execution and strategic governance, this role is pivotal in building production-ready AI solutions, automating cross-functional workflows, and shaping responsible AI adoption standards across the organization.
The ideal candidate thrives on delivering scalable AI integrations while acting as a trusted advisor to help business units understand, deploy, and maximize the value of artificial intelligence securely.
Core Responsibilities
- AI Platform Administration: Manage enterprise AI platforms (including frontier LLMs like Claude Enterprise and ChatGPT Enterprise), ensuring secure access controls and seamless coordination with IT infrastructure.
- Workflow Automation & Agent Development: Design, build, deploy, and maintain custom AI agents and automated workflows to solve business challenges while adhering to IT security standards.
- Cross-Functional Advisory: Serve as the primary point of contact for AI requests across all business units. Partner with stakeholders to assess feasibility, scope technical requirements, and deliver production-ready implementations.
- Governance & Security Compliance: Collaborate with IT Security and leadership to establish, implement, and enforce AI governance frameworks and acceptable use policies.
- Vendor & Tool Evaluation: Review and vet emerging AI tools, services, and platform releases alongside IT Security to provide recommendations for adoption or integration.
- Enablement & Training: Develop cross-departmental guidance, best practices, and training programs to support safe, compliant, and effective AI usage.
- Performance & Cost Optimization: Track platform usage metrics, monitor cost allocations, and present operational insights and optimization strategies to leadership.
- Security Reviews: Ensure all agents, MCP servers, integrations, and data connections undergo rigorous IT Security review before deployment, upholding principles of least-privilege access.
Key Qualifications
- Experience: 3+ years of experience in software engineering, data science, ML engineering, or applied AI (or 2+ years specialized in building production LLM applications).
- AI Model Integration: 1–3 years of hands-on experience working with frontier AI services, LLMs, or agent development.
- Agent Architecture: Proven ability to build AI agents utilizing tool/function calling, API integrations, and Model Context Protocol (MCP) frameworks.
- RAG Pipelines: Technical proficiency in Retrieval-Augmented Generation (RAG) architecture, including embeddings, vector databases, chunking strategies, and retrieval evaluation.
- LLM Evaluation: Hands-on experience evaluating LLM performance using test sets, LLM-as-judge frameworks, and prompt regression testing.
- Prompt & Context Engineering: Advanced expertise in production-grade prompt engineering and context optimization.
- AI Security Standards: Strong knowledge of AI-specific security threats (e.g., prompt injection, data leakage, PII handling) and familiarity with the OWASP Top 10 for LLMs.
- Deployment & Managed Services: Experience containerizing AI applications, managing self-hosted/served models, and utilizing cloud AI services (e.g., AWS Bedrock, Azure OpenAI/AI Foundry, Google Vertex AI).
- Governance Frameworks: Familiarity with responsible-AI practices and governance models (such as NIST AI RMF or ISO/IEC 42001).
- Communication & Collaboration: Demonstrated track record of collaborating across business units and translating complex technical concepts for non-technical stakeholders.
Preferred Qualifications
Certifications
- Anthropic Claude Certified Associate / Developer
- AWS Certified AI Practitioner or AWS Certified Generative AI Developer
- Microsoft Azure AI Fundamentals
- CompTIA AI+ or equivalent vendor-neutral credential
- Frameworks & Orchestration: Experience with agent orchestration tools (e.g., LangChain, LangGraph, AutoGen).
- Observability: Experience using LLM observability and cost-tracking platforms (e.g., LangSmith).
- Automation Platforms: Familiarity with workflow automation tools (e.g., Power Automate, n8n, Zapier).
- Model Customization: Hands-on experience with fine-tuning or local deployment frameworks (e.g., Ollama, OpenWebUI).
Company Culture & Benefits
We foster a collaborative, innovative culture centered on continuous growth, cross-functional mentorship, and transformative technology.
We offer a comprehensive benefits package designed to support full employee well-being, including:
- Competitive medical, dental, and vision health coverage
- Retirement savings plans with employer matching
- Short-term and long-term disability protection
- Paid time off, holidays, and parental leave programs
- Wellness programs and dedicated professional development initiatives
More opportunities with one profile
Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.
Create my profile