AI Engineer

Job Description

Denodo Technologies, Inc. is seeking an AI Engineer in Palo Alto, CA (Telecommuting permissible from anywhere in U.S.). Responsible for developing innovative solutions using Large Language Models (LLMs) in conjunction with the data virtualization platform commercialized by the company (Denodo Platform).

Salary Range: $130,000-$160,000/yr.

Job Responsibilities & Duties

• Responsible for developing innovative solutions using Large Language Models (LLMs) in conjunction with the data virtualization platform commercialized by the company (Denodo Platform).
• Design and manage vector databases and embeddings to support semantic searches.
• Work on a solution using the Retrieval Augmented Generation (RAG) pattern to enable a Large Language Model (LLM) to retrieve and utilize data available through the data virtualization platform developed by the company (Denodo Platform).
  • Ensure the solution can be integrated and deployed in conversational interfaces like chatbots and integrated with other data sources and platforms.
  • Develop a chatbot prototype to illustrate its use.
• Design techniques, leveraging the power of LLMs, to improve the overall user experience and functionality of the Denodo Platform by automating complex tasks and improving query precision.
• Explore and implement additional use cases for LLMs within the data virtualization product, such as automatically correcting misspelled or poorly structured queries, categorizing views, or enhancing query optimization.
• Design, execute, and interpret experiments to evaluate different models and configurations.
• Ensure proper experimental setup, including data preparation and metric selection.
• Analyze and interpret results to drive decisions, ensuring the solutions meet precision and performance criteria and are suitable for real-world integration.
• Optimize the solutions for scalability, security, and performance in enterprise environments.
• Collaborate with several company teams to ensure successful implementation across different environments and customers.

Desired Skills & Experience

• Master’s degree in information systems, computer science or a related field (or foreign equivalent)
• 2 years experience in a similar role within the data management or analytics software industry. 2 years inclusive experience designing, executing and interpreting experiments correctly. 2 years inclusive experience with web development skills, including experience with libraries such as React. 2 years inclusive experience in programming languages like Python and with AI/ML models. 2 years inclusive experience working with Large Language Models (LLM) and Retrieval Augmented Generation (RAG).

• Special Requirements: Demonstrated experience with vector databases and embeddings. Demonstrated experience integrating AI solutions into data virtualization products. Demonstrated experience with developing conversational AI solutions, including chatbots and integration with other platforms. Demonstrated experience with cloud platforms for deploying and scaling AI solutions.