Browse
···
Log in / Register

Prompt Engineer Data Science & Quality Analysis

Negotiable Salary

Checkmate

New York, NY, USA

Favourites
Share

Description

As a Prompt Engineer focused on Data Science and Quality Analysis, you’ll design, test, and evaluate prompts for AI systems that interact with real-world restaurant data. You’ll work cross-functionally to develop AI solutions that drive operational efficiency, improve data interpretation, and support smarter decision-making for restaurant operators. Your work will directly shape how AI models perform in high-stakes, dynamic environments like order processing, reporting, support automation, and performance analysis. Essential Job Functions: Prompt Design & Evaluation: Develop, test, and refine prompts for tasks such as text generation, question answering, data classification, and structured data extraction to optimize Voice AI performance. Data-Driven Analysis & Quality Measurement: Design evaluation frameworks and analyze prompt outputs using quantitative metrics, human-in-the-loop evaluation, and user feedback to identify improvement opportunities. Experimentation & Iteration Conduct experiments to test prompt variations, measure their business and operational impact, and iterate to enhance accuracy, consistency, and safety. Regression Testing & Compliance Build principled regression test suites using tools like LangFuse and Galileo to ensure prompts remain compliant and high-performing as models and use cases evolve. Collaboration Across Teams: Work closely with data science, product, legal, engineering, and operations teams to align prompt designs with business goals, operational workflows, and compliance requirements. Model Adaptation & Strategy Development prompts across multiple LLMs (GPT, LLaMA, Gemini, and Checkmate’s fine-tuned models), understanding model differences to optimize outputs effectively. Team Leadership & Mentorship Lead a team of analysts focused on prompt evaluation and data quality analysis, guiding prioritization, experimentation, and reporting. Collaborate with ops teams for seamless deployment and feedback loops. Research & Continuous Learning Stay up to date on emerging prompting techniques, LLM behaviors, evaluation frameworks, and AI safety practices to keep Checkmate’s AI solutions best-in-class. Requirements Strong analytical and data science skills, with hands-on experience in Python (pandas, NumPy, scikit-learn) Experience designing and conducting experiments and evaluations in applied AI or NLP contexts Proficiency in SQL and working with relational databases (e.g. MySQL, PostgreSQL, Oracle, MS SQL) Good understanding of data processing, quality measurement, and testing fundamentals Experience leading analyst or operations teams, with strong prioritization, mentorship, and collaboration skills Strong problem-solving mindset with a drive to explore, optimize, and automate workflows Excellent communication skills for presenting insights to technical and non-technical stakeholders Bachelor’s degree in Data Science, Computer Science, Statistics, Engineering, or a related field Flexible to work US hours until at least 6 pm ET, with a strong remote setup Preferred Qualifications Experience with LLM evaluation and prompt engineering workflows Familiarity with tools like LangFuse and Galileo for prompt evaluation and analysis Knowledge of cloud platforms (AWS, GCP, Azure) and data pipeline tools Familiarity with machine learning concepts and NLP workflows Master’s or PhD in Data Science, Statistics, Computer Science, or a related field Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k) Life Insurance (Basic, Voluntary & AD&D) Flexible Paid Time Off Family Leave (Maternity, Paternity) Short Term & Long Term Disability Training & Development Work From Home Stock Option Plan

Source:  workable View original post

Location
New York, NY, USA
Show map

workable

You may also like

Workable
QA Analyst (Release Management) - Washington, DC - Rate Open
Job Title : QA Analyst (Release Management) Location : Washington, DC Type : Long Term Rate - $Open (Best Possible) Job Responsibilities – Coordinate builds and testing of releases. Coordinate the scheduling and roll out of releases. Provide communication and information, including relevant release documentation, as required. Ensure appropriate checkpoints are met and coordinate release sign off. Coordinate the implementation of the release. Complete post implementation reviews. Maintain quality checks on releases and record those that directly or indirectly cause support Incidents. Requirement – Strong attention to detail, coordination, and communication skills. Bachelor's degree preferred or equivalent work experience. Must have hands on experience with a TPF system. Must be well versed in Schedule Management. Capable to deliver a comprehensive assessment of current state of project's release statuses. Previous exposure to ITIL release, service management and/or project management. Ability to work to tight deadlines and handle work pressures to successfully deliver releases. Experience of working across different business areas, demonstrating customer focus and good corporate awareness. Service Now experience extremely desirable. Involvement in design and implementation of policy, process and procedure. Demonstrable ability of being able to communicate across departments at all levels and with senior management, including directors. Note: If interested please send your updated resume and include your rate/Salary requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us. We look forward to hearing from you at the earliest!
Washington, DC, USA
Negotiable Salary
Workable
Senior Quality Assurance Engineer
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: We are seeking experienced Senior Quality Assurance Engineers to join us in testing network devices! In our team, you can always stay at the forefront of technology, have access to and learn about the latest generation of networking technologies worldwide. Together with other outstanding engineers in the team, you will create reliable, stable, and high-speed network access products for users, provide user-friendly and convenient smart home solutions, and bring convenience to the lives of millions of users worldwide! Responsibilities: New security feature test design for Gateway Switches & Wireless Access Points. Design, build, and maintain testbed infrastructure, triage automated regression failures and provide failure analysis to certify software releases. Develop the test plans based on requirements & specifications and provide feedback from a testing perspective. Improve the test system and efficiency. Collaborate with the R&D team to troubleshoot and debug issues. Requirements Required Qualifications: Bachelor’s degree in computer science, electronic engineering, or a related field. Minimum 5 years of testing network products. Basic knowledge of Radius, VLAN technologies, 802.1x, Captive portal. Good understanding of networking architecture such as Routing/Switching (OSPF / BGP /IS-IS), IP, TCP/UDP, and application layers such as HTTP, SNMP, etc. Familiar with 802.11 wireless protocols. Strong ability to write quality code (automation test code) . Excellent communication skills and teamwork spirit, able to effectively collaborate with different teams. Additional Skills (Preferred): Experienced with Cloud performance testing is a plus. Experienced with L3 switch or Gateway test is a strong plus. Experience with a large-scale enterprise network deployment is a plus. Benefits Salary range: $150,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$150,000-200,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.