Browse
···
Log in / Register

Prompt Engineer Data Science & Quality Analysis

Negotiable Salary

Checkmate

New York, NY, USA

Favourites
Share

Description

As a Prompt Engineer focused on Data Science and Quality Analysis, you’ll design, test, and evaluate prompts for AI systems that interact with real-world restaurant data. You’ll work cross-functionally to develop AI solutions that drive operational efficiency, improve data interpretation, and support smarter decision-making for restaurant operators. Your work will directly shape how AI models perform in high-stakes, dynamic environments like order processing, reporting, support automation, and performance analysis. Essential Job Functions: Prompt Design & Evaluation: Develop, test, and refine prompts for tasks such as text generation, question answering, data classification, and structured data extraction to optimize Voice AI performance. Data-Driven Analysis & Quality Measurement: Design evaluation frameworks and analyze prompt outputs using quantitative metrics, human-in-the-loop evaluation, and user feedback to identify improvement opportunities. Experimentation & Iteration Conduct experiments to test prompt variations, measure their business and operational impact, and iterate to enhance accuracy, consistency, and safety. Regression Testing & Compliance Build principled regression test suites using tools like LangFuse and Galileo to ensure prompts remain compliant and high-performing as models and use cases evolve. Collaboration Across Teams: Work closely with data science, product, legal, engineering, and operations teams to align prompt designs with business goals, operational workflows, and compliance requirements. Model Adaptation & Strategy Development prompts across multiple LLMs (GPT, LLaMA, Gemini, and Checkmate’s fine-tuned models), understanding model differences to optimize outputs effectively. Team Leadership & Mentorship Lead a team of analysts focused on prompt evaluation and data quality analysis, guiding prioritization, experimentation, and reporting. Collaborate with ops teams for seamless deployment and feedback loops. Research & Continuous Learning Stay up to date on emerging prompting techniques, LLM behaviors, evaluation frameworks, and AI safety practices to keep Checkmate’s AI solutions best-in-class. Requirements Strong analytical and data science skills, with hands-on experience in Python (pandas, NumPy, scikit-learn) Experience designing and conducting experiments and evaluations in applied AI or NLP contexts Proficiency in SQL and working with relational databases (e.g. MySQL, PostgreSQL, Oracle, MS SQL) Good understanding of data processing, quality measurement, and testing fundamentals Experience leading analyst or operations teams, with strong prioritization, mentorship, and collaboration skills Strong problem-solving mindset with a drive to explore, optimize, and automate workflows Excellent communication skills for presenting insights to technical and non-technical stakeholders Bachelor’s degree in Data Science, Computer Science, Statistics, Engineering, or a related field Flexible to work US hours until at least 6 pm ET, with a strong remote setup Preferred Qualifications Experience with LLM evaluation and prompt engineering workflows Familiarity with tools like LangFuse and Galileo for prompt evaluation and analysis Knowledge of cloud platforms (AWS, GCP, Azure) and data pipeline tools Familiarity with machine learning concepts and NLP workflows Master’s or PhD in Data Science, Statistics, Computer Science, or a related field Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k) Life Insurance (Basic, Voluntary & AD&D) Flexible Paid Time Off Family Leave (Maternity, Paternity) Short Term & Long Term Disability Training & Development Work From Home Stock Option Plan

Source:  workable View original post

Location
New York, NY, USA
Show map

workable

You may also like

Workable
Software Quality Assurance Analyst (3608)
Navarro Research and Engineering is recruiting for a Software Quality Assurance (SQA) Analyst in Richland, WA. Navarro Research & Engineering is an award-winning federal contractor dedicated to partnering with clients to advance clean energy and deliver effective solutions for complex challenges in the nuclear and environmental fields. Joining Navarro means being a part of an exceptional team committed to quality and safety while also looking for innovative strategies to create value for the client’s success. Headquartered in Oak Ridge, Tennessee, Navarro has active programs in place across the nation for DOE/NNSA, NASA, and the Department of Defense. This position will support Navarro-ATL. Navarro-ATL is located in Richland, WA, and operates, manages, and maintains the 222-S Laboratory Complex for the Department of Energy. The Navarro-ATL members are Navarro Research and Engineering, Inc. (Oak Ridge, TN), and Advanced Technologies and Laboratories International (Gaithersburg, MD). The SQA Analyst will be responsible for establishing and maintaining a software quality assurance (SQA) program that is in compliance with contractual standards to include NQA-1, DOE QSM, ISO 17025, ISO/IEEE, etc. requirements and other relevant regulatory drivers. The successful candidate for this position will: Have the ability to work both independently and with a team Have excellent verbal and written communication skills Responsibilities: Under minimal supervision: Develop and maintain a SQA program that is in compliance with NQA-1, DOE QSM, ISO 17025, ISO/IEEE, etc. Maintain and enhance SQA templates to meet contractual standards and business needs Author, change, and update Navarro-ATL SQA procedures Assist Navarro-ATL personnel with generating SQA documentation destined for applications/spreadsheets and HISI registration Represent Navarro-ATL on various software-related boards Author, review, edit, and complete final approval of Navarro-ATL SQA records Monitor and maintain the validation status of all software Address and resolve open corrective actions related to SQA Report metrics, trends, potential issues, and improvement initiatives to management on the SQA program Identify and implement initiatives for continuous improvement of the SQA system Ensure software that is designed, changed, or purchased by Navarro-ATL meets NQA-1 requirements and other relevant regulatory standards Ensure all SQA records are well organized, clear, and able to withstand audits both externally and internally Have sufficient knowledge on the SQA procedures and records that support product design, validation, and operation throughout the software lifecycle in order to be the Subject Matter Expert (SME) during audits Ensure (retroactively) all current software records have complete life cycle and requirements traceability records Obtain all required internal qualifications Requirements Minimum Qualifications: Bachelor's degree (BA/BS) in Engineering, Science, or related field and 7 years of experience working in software quality assurance under NQA-1 requirements (related experience may be substituted), or equivalent combination of education and/or experience. Preferred Qualifications: Familiarity with ISO Quality System requirements Prior experience working in an analytical laboratory environment Prior experience with laboratory management information systems (LIMS) Due to the nature of the government contract requirements and/or clearances requirements, US citizenship is required. Navarro is an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, race, religion, color, national origin, age, disability, veteran’s status or any classification protected by applicable state or local law. EEO Employer/Vet/Disabled Compensation: Grade 18: $106,663 - $134,588 In accordance with the Navarro Research and Engineering, Inc (Navarro) salary determination process, Navarro takes into consideration the level of assigned job duties and responsibilities and the candidate’s education, training, and/or experience relative to internal peers and the external labor market. A candidate's salary history will not be used in compensation decisions. Benefits Benefits include medical, dental, and vision insurance; short- and long-term disability insurance; pension benefits*; 401(k) retirement savings plan with employer match; life and accidental death and dismemberment (AD&D) insurance; vacation/sick/holiday pay*. *Based on eligibility rules
Richland, WA, USA
$106,663-134,588/year
Top Jobs in US
洛杉矶泰兰尼斯招聘导购
Job Information: contact information:wangyuansheng@t-aranis.com ● Job Title: Sales Associate ● Position Type: Full-Time/Part-time ● Industry: Retail ● Location: Los Angeles, California, United States At TARANIS, we’re looking for motivated, proactive individuals who excel in a collaborative environment, embrace feedback, and are passionate about continuous learning and personal growth. If you are curious, adaptable, and ready to take on new challenges, we would love to have you join our team. As a member of the TARANIS family, you’ll receive comprehensive onboarding, in-depth product training, and customer management development to ensure your success and ongoing professional growth within the company. Responsibilities: ● Develop strong product knowledge and effectively communicate key features and benefits to customers. ● Greet and engage customers, assess their needs, and drive sales through product recommendations. ● Ensure store displays are organized, visually appealing, and aligned with company standards. ● Track sales, perform inventory checks, and generate accurate reports. ● Handle daily store operations, including receiving shipments, restocking, returns, and supporting loss prevention. ● Deliver exceptional customer service at all stages of the shopping experience—pre-sale, during the sale, and post-sale. ● Stay focused and goal-oriented, maintaining a positive attitude even in high-pressure situations. ● Keep your designated area clean, organized, and safe. ● Be proactive, reliable, and take ownership of your tasks. ● Complete other tasks assigned by the supervisor. ● Approach new challenges and tasks with a 'can-do' attitude. ● Flexibility to work evenings, weekends, and holidays as needed. ● Ability to meet physical demands, including bending, squatting, reaching, climbing ladders, and standing for long periods. Qualifications: ● High school diploma or equivalent required. ● Relevant work experience in retail or customer service is preferred. ● Strong communication skills, with a team-oriented approach and a customer-first mindset. ● Proficiency in English; additional fluency in Chinese and Spanish is a plus. Job Types: Full-time, Part-time Pay: $16.50 - $22.00 per hour Compensation Package: Bonus opportunities Monthly bonus Schedule: 10 hour shift 12 hour shift 8 hour shift Work Location: In person
Los Angeles
$16.5-22/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.