hero

The #1 Source for
In-Person NYC Tech Jobs

Build your future in the capital of everything.
Obviously New York.
companies
Jobs

Generative AI - Vice President

J.P. Morgan

J.P. Morgan

Software Engineering, Data Science
Posted on Dec 18, 2025

Join us as we revolutionize the future of data and AI at our organization. As a Generative AI Vice President in the Chief Data and Analytics Office, you will play a pivotal role in shaping firmwide adoption of artificial intelligence. Collaborate with top talent across cloud, engineering, and research teams to deliver impactful solutions. Your work will directly influence how we build, scale, and optimize advanced AI/ML products. Be part of a team that values creativity, ethical practices, and continuous growth—where your expertise drives real business outcomes.

As a Generative AI Vice President in the Chief Data and Analytics Office, you will lead us in developing scalable LLM-based products and reusable APIs. You will collaborate with cross-functional teams to drive innovation and deliver high-impact solutions. Your role empowers you to shape our AI/ML strategy, optimize performance, and foster a culture of collaboration. We value your expertise in both technical and business domains, ensuring you have the opportunity to make a significant impact.

Job Responsibilities

  • Lead the design and delivery of production architectures for AI and ML products
  • Combine vast data assets with advanced AI, including LLMs and Multimodal LLMs
  • Bridge scientific research and software engineering to deliver robust solutions
  • Collaborate with cloud and SRE teams to optimize system performance
  • Develop scalable APIs with clear separation of concerns and well-defined interfaces
  • Foster innovation and continuous improvement across cross-functional teams
  • Ensure solutions meet business objectives and deliver high Return-on-Investment
  • Communicate technical concepts effectively to diverse audiences
  • Align ML product development with organizational goals
  • Mentor and guide teams of ML engineers and scientists
  • Champion ethical and sustainable AI practices

Required Qualifications, Capabilities, and Skills

  • PhD in Computer Science, Mathematics, Statistics, or related quantitative discipline
  • Minimum 5 years as an individual contributor in ML engineering
  • Proven experience working with teams of ML engineers or scientists
  • Strong foundation in statistics, optimization, and ML theory (NLP and/or Computer Vision)
  • Hands-on experience with agent based workflows, MCP, RAG and context engineering.
  • Ability to write clear and concise OKRs and align with business expectations
  • Experience as a responsible owner for ML services in enterprise environments
  • Excellent grasp of computer science fundamentals and SDLC best practices
  • Ability to align ML problem definition with business objectives
  • Strong communication skills for technical and non-technical stakeholders
  • Demonstrated ability to build trust and foster collaboration

Preferred Qualifications, Capabilities, and Skills

  • Hands-on experience with distributed, multi-threaded, scalable applications (Ray, Horovod, DeepSpeed)
  • Experience designing and implementing pipelines using DAGs (Kubeflow, DVC, Ray)
  • Ability to construct batch and streaming microservices with gRPC and/or GraphQL endpoints
  • Demonstrated expertise in parameter-efficient fine-tuning, model quantization, and quantization-aware fine-tuning of LLMs
  • Hands-on knowledge of Chain-of-Thoughts, Tree-of-Thoughts, and Graph-of-Thoughts prompting strategies

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans


The Cybersecurity & Technology Controls group at JPMorganChase aligns the firm’s cybersecurity, access management, controls and resiliency teams. The group proactively and strategically partners with all lines of business and functions to enable them to design, adopt and integrate appropriate controls; deliver processes and solutions efficiently and consistently; and drive automation of controls. The group’s number one priority is to enable the business by keeping the firm safe, stable and resilient.

High Risk Roles (HRR) are sensitive roles within the technology organization that require high assurance of the integrity of staff by virtue of 1) sensitive cybersecurity and technology functions they perform within systems or 2) information they receive regarding sensitive cybersecurity or technology matters. Users in these roles are subject to enhanced pre-hire screening which includes both criminal and credit background checks (as allowed by law). The enhanced screening will need to be successfully completed prior to commencing employment or assignment.



Join our Data and Analytics team, manage data, conduct insightful analytics, and promote impactful decisions.