Senior Developer - AI Software Engineer

We are seeking a talented Mid-Level AI Software Engineer to join our growing Private Markets AI team. In this role, you will design, develop, and deploy AI-powered capabilities that drive real business impact. You will work closely with business stakeholders, engineering, and data engineering teams to build scalable, production-grade AI systems. This is an exciting opportunity to shape the next generation of intelligent products while growing your expertise in a collaborative and innovative environment.

Key Responsibilities

• Evaluate, design and, architect AI Tooling for production use cases within the Private Markets business solving real-world business problems

• Build and maintain end-to-end AI powered solutions covering data ingestion, feature engineering, model training, evaluation, and deployment.

• Integrate large language models (LLMs) and foundation models into product features, including prompt engineering, fine-tuning, and RAG architectures.

• Partner with the Private markets business users to design and build agentic workflows

• Collaborate with data engineers to ensure high-quality, well-structured training datasets and feature stores.

• Write clean, well-tested, and well-documented code following engineering best practices.

• Participate in code reviews, design discussions, and knowledge-sharing sessions with the broader engineering team.

• Stay current with advances in AI/ML research and evaluate emerging tools, frameworks, and techniques for adoption.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Machine Learning, or a related quantitative field

• 7+ years of professional software development experience, with 2+ years focused on building and deploying AI solutions in production environments

• Experience in Private Markets or a related financial sector

• Strong proficiency in Python and AI/agentic frameworks, including LangChain and LangGraph

• Proven ability to design, build, and architect production-grade agentic workflows and enterprise AI systems using LLMs

• Hands-on experience with cloud platforms (AWS or Azure), including native AI services such as Azure AI Foundry, AWS Bedrock, and MCP

• Solid software engineering fundamentals — version control (Git), CI/CD, testing, and containerization (Docker)

• Strong problem-solving skills with the ability to translate ambiguous business requirements into scalable technical solutions

• Experience with prompt engineering and retrieval-augmented generation (RAG)

​Preferred Qualifications

• Experience with fine-tuning techniques (LoRA, RLHF)

• Familiarity with vector databases (Pinecone, Weaviate, Chroma) and embedding-based search systems

• Experience building real-time inference systems or streaming AI pipelines

Location: New York City; hybrid with a minimum of two days per week in office. 

#LI-DD2

#LI-Hybrid

Senior Developer I/II


Applicants must be authorized and have the right to work in the country where the role is located without the need for current or future sponsorship.

Compensation Details

The salary range for this role is $130,000-$170,000. This is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting. We may ultimately pay more or less than the posted range, and the range may be modified in the future. This range is only applicable for jobs to be performed in the job posting location. An employee’s pay position within the salary range will be based on several factors including, but limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, business sector, performance, shift, travel requirements, sales or revenue-based metrics, market benchmarking data, any collective bargaining agreements, and business or organizational needs. This job is also eligible for a discretionary bonus, which, along with base salary and retirement contributions, is part of our total comprehensive package. We offer a comprehensive package of benefits including paid time off, medical/dental/vision insurance, retirement, life insurance and other benefits to eligible employees.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, production, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.

Neuberger is an equal opportunity employer. The Firm and its affiliates do not discriminate in employment because of race, creed, national origin, religion, age, color, sex, marital status, sexual orientation, gender identity, disability, citizenship status or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact onlineaccommodations@nb.com.

Learn about the Applicant Privacy Notice.