AI/ML Associate Engineer

About the Role

The AI/ML Associate Engineer position is designed for proactive software engineers who are passionate about developing and supporting AI and machine learning solutions. This role emphasizes crafting production-grade code and contributing to AI-driven features, including those utilizing Microsoft 365 Copilot and associated agents. It suits professionals early in their AI/ML career with strong programming skills and interest in software engineering combined with applied machine learning and enterprise AI platforms.

Primary Responsibilities

• Develop, test, and maintain high-quality production software that supports AI and ML functionalities.
• Create and manage AI-powered features utilizing advanced machine learning and large language model (LLM) techniques, APIs, and services.
• Engage with Copilot-driven workflows across Microsoft Teams, Outlook, Word, and Excel by refining prompts and automating tasks using agent-based methods.
• Design and upkeep backend services, API endpoints, and integrations central to AI/ML use cases.
• Apply generative AI and LLM methodologies such as retrieval-augmented generation (RAG) pipelines, prompt management, evaluation frameworks, and safety measures.
• Integrate embeddings, vector storage, and caching to meet performance and cost goals.
• Participate in AI model integration and lifecycle processes including experimentation, evaluation, deployment, continuous monitoring, and iterations.
• Implement monitoring strategies to ensure model quality, detect drift, manage bias, evaluate performance, and control costs.
• Develop unit and integration tests alongside comprehensive documentation to guarantee reliability, security, and maintainability of AI solutions.
• Collaborate tightly with product managers, designers, and senior technical staff to transform requirements into functional software.
• Adhere to organizational standards concerning security, data governance, and handling of AI systems.

Candidate Qualifications

• Bachelor’s degree in Computer Science, Engineering, or equivalent professional experience.
• Proficient programming skills, particularly in Python and at least one additional language such as Java or C#.
• Strong grasp of software engineering basics, including data structures, API design, version control systems, testing practices, and continuous integration/deployment workflows.
• Familiarity with foundational AI/ML concepts including machine learning algorithms, LLMs, embeddings, and evaluation techniques.
• Hands-on experience with relevant ML tools such as scikit-learn, XGBoost, PyTorch or TensorFlow, and data processing libraries like Pandas or Spark.
• Experience developing APIs and services using RESTful or gRPC protocols, along with containerization via Docker and orchestration using Kubernetes.
• A working understanding of MLOps procedures such as CI/CD for ML, usage of MLflow or Kubeflow, model registries, and automated testing frameworks.

Preferred Skills and Experience

• Familiarity with Microsoft 365 Copilot, Copilot Agents, or other enterprise AI generative platforms.
• Exposure to prompt engineering, AI agent automation workflows, or AI-augmented productivity suites.
• Knowledge of cloud infrastructures with preference for Azure, and experience with Power Platform or Microsoft Graph API integrations.
• Previous involvement in maintaining AI functionality in live production environments.

About the Company

J.P. Morgan is a global leader in financial services, delivering strategic advice and products to major corporations, governments, and wealthy individuals. The company is deeply committed to building trusted, long-lasting partnerships that support its clients’ business goals.

Diversity and Inclusion

The organization values a diverse and inclusive workforce, recognizing its essential contribution to success. J.P. Morgan is an equal opportunity employer and actively ensures no discrimination based on protected categories such as race, religion, gender, age, disability, or any other legally protected status. Reasonable accommodations for religious practices and health needs are provided.

Team Environment

The Corporate Functions team encompasses a variety of domains such as finance, risk management, human resources, and marketing. These teams play a critical role in supporting business operations to ensure success for clients, customers, and employees alike.