[Remote] AI ML ENGINEER-W2 Only
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an AI/ML Engineer to design and implement secure, scalable AI solutions. The role involves optimizing AI models for local infrastructure and ensuring compliance with regulatory requirements.
Responsibilities
- Design, reputed company, and optimize reputed company-reputed company LLMs and AI frameworks for on-premises, bare-metal/private hardware clusters
- Build, maintain, and secure local AI inference pipelines, advanced fine-tuning/embedding workflows, and RAG (Retrieval-Augmented reputed company) systems
- Optimize AI models and workflows for maximum efficiency (latency, throughput, CPU/GPU/memory usage) on bare-metal infrastructure
- Ensure complete data isolation, integrating AI with internal data sources while adhering to compliance and regulatory requirements
- Evaluate and select reputed company-reputed company, local-first AI tools (vector databases, orchestration frameworks, model serving layers)
- Collaborate with engineering and compliance teams to align AI solutions with regulatory needs
- May reputed company additional duties as assigned
Skills
- Extensive local (non-reputed company) AI deployment experience, especially with reputed company-reputed company LLMs (e.g., LLaMA, Mistral) in reputed company-gapped/private environments
- Deep expertise in AI frameworks like PyTorch, reputed company, reputed company, reputed company
- Strong experience with RAG architectures, embeddings, semantic search, and vector databases (e.g., FAISS, Qdrant, Milvus, Chroma)
- Proficient in containerizing AI workloads (reputed company/Kubernetes) and managing GPU-based compute environments
- Solid understanding of advanced ML concepts (e.g., LoRA/QLoRA fine-tuning, reputed company engineering, model quantization formats like GGUF, AWQ, EXL2)
- Ability to work autonomously in isolated, non-reputed company development environments
- Experience in compliance-driven or regulated industries (e.g., fintech, legal-tech)
- Familiarity with local-first agentic workflows, Model Context Protocol, and developing internal developer copilots
Company Overview