Job Descriptions:
1.Understand the functions, use scenarios, system logic, and capability boundaries of AI products, and translate product needs into executable user tasks and evaluation plans.
理解AI产品的功能、使用场景、系统逻辑和能力边界,将产品需求转化为可执行的用户任务和测评方案
2.Design and conduct interaction evaluations for AI glasses, voice assistants, multimodal terminals, AI-enabled wearables, intelligent applications, and other AI products, assessing task completion, response effectiveness, interaction efficiency, cognitive load, trust, sense of control, error recovery, and user experience.
面向AI眼镜、语音助手、多模态终端、AI赋能的智能穿戴、智能应用及其他AI产品设计并执行交互测评,评价任务完成、响应有效性、交互效率、认知负荷、信任、可控感、错误恢复和使用体验
3.Record model and system versions, prompt conditions, input methods, network conditions, and key configurations that may affect test results, so that different test conditions remain traceable and comparable.
记录可能影响测试结果的模型版本、系统版本、提示条件、输入方式、网络条件和关键配置,确保不同测试条件可追溯、可比较
4.Collect and align user behavior, task performance, system logs, product interface data, and relevant human factors data, and maintain the quality and integrity of test records.
采集并对齐用户行为、任务表现、系统日志、产品接口数据及相关人因数据,保证测试记录的质量和完整性
5.Use Python, R, MATLAB, or other suitable tools to clean, analyze, visualize, and interpret evaluation data.
使用Python、R、MATLAB或其他适用工具完成测评数据的清洗、分析、可视化和解释
6.Analyze AI outputs, user task performance, and failure pathways; identify recognition errors, irrelevant responses, missing information, response delays, incorrect actions, and unsuccessful recovery; and assess their impact on user tasks.
分析AI输出、用户任务表现和失效链路,识别识别错误、答非所问、信息遗漏、响应延迟、错误执行和恢复失败等问题,并评价其对用户任务的影响
7.Combine system data with user performance to distinguish among system performance, interaction design, test conditions, and individual differences, and explain the applicable conditions and limitations of the conclusions.
结合系统数据与用户表现,区分系统性能、交互设计、测试条件和用户个体差异等问题来源,并说明结论的适用条件和局限性
8.Prepare test plans, technical documentation, evaluation reports, and presentation materials in both Chinese and English, and communicate results and recommendations to clients and internal teams.
使用中英文撰写测试方案、技术文档、测评报告和汇报材料,并向客户及内部团队沟通结果和建议
9.During onboarding and the initial phase of business operations, collaborate with the Shanghai team on experimental methods, complex analysis, and technical issues, and progressively develop the ability to independently complete AI product evaluations from planning to delivery.
入职及业务开展初期,可与上海团队协作处理实验方法、复杂分析和专项技术问题,并逐步具备独立完成从方案到交付的AI产品测评能力
Job Requirements:
1.Bachelor's degree or above in Artificial Intelligence, Computer Science, Human-Computer Interaction, Cognitive Science, Psychology, Human Factors Engineering, Data Science, or a related field.
人工智能、计算机科学、人机交互、认知科学、心理学、人因工程、数据科学或相关专业本科及以上学历
2.Project, internship, research, or work experience involving AI products, intelligent applications, voice interaction, multimodal interaction, or intelligent terminals; outstanding recent graduates are welcome to apply.
具有AI产品、智能应用、语音交互、多模态交互或智能终端相关的项目、实习、科研或工作经验;优秀应届毕业生亦可
3.Understanding of the basic operating logic and capability boundaries of generative AI, voice interaction, multimodal interaction, or other intelligent products, including how output variability and system conditions may affect evaluation results.
理解生成式AI、语音交互、多模态交互或其他智能产品的基本工作逻辑和能力边界,包括输出波动和系统条件对测评结果的影响
4.Fundamental knowledge of experimental design, statistical analysis, and data quality control, with the ability to identify key variables, confounding factors, and limitations.
具备实验设计、统计分析和数据质量控制的基础知识,能够识别关键变量、混杂因素和结果局限
5.Proficiency in at least one data analysis or programming tool, such as Python, R, or MATLAB, with the ability to process, analyze, and interpret evaluation data.
熟练使用Python、R、MATLAB等至少一种数据分析或编程工具,能够处理、分析和解释测评数据
6.Hands-on experience in at least one of the following areas: product APIs, system logs, data interfaces, or multi-source data alignment.
在产品API、系统日志、数据接口或多源数据对齐中的至少一个方向具备实际经验
7.Ability to analyze test results by combining system outputs with user behavior and task performance, and to explain the applicable conditions and limitations of the conclusions.
能够结合系统输出、用户行为和任务表现分析测试结果,并对结论的适用条件和局限性作出合理说明
8.Strong Chinese and English communication, reading, and writing skills, with the ability to read AI and system documentation, prepare technical reports, and communicate with product, algorithm, engineering, and client teams in both languages.
具备较强的中英文沟通、阅读和写作能力,能够使用中英文阅读AI及系统技术资料、撰写技术报告,并与产品、算法、工程及客户团队沟通
Priority Conditions:
1.Experience in evaluating AI products, voice interaction, multimodal interaction, intelligent applications, or smart terminals.
具备AI产品、语音交互、多模态交互、智能应用或智能终端测评经验
2.Experience in AI product red teaming, evaluation dataset design, system log analysis, or failure case analysis.
具备AI产品红队测试、评测集设计、系统日志分析或失败案例分析经验
3.Experience with API calls, automated testing, data pipelines, or experiment platforms.
具备API调用、自动化测试、数据管线或实验平台经验
4.Experience with user research, human factors experiments, or usability testing.
具备用户研究、人因实验或可用性测试经验
5.Ability to demonstrate AI product evaluation capability through projects, internships, a thesis, research papers, competitions, or portfolio materials.
能够通过项目、实习、毕业论文、研究论文、竞赛或作品材料展示AI产品测评能力
In the Products division at TÜV Rheinland, we are looking for talented individuals who want to join us at the forefront of safety, quality, and innovation. Our goal is to ensure that products on international markets are safe and compliant with standards—from consumer goods to highly complex medical devices. In doing so, we help companies meet national and international standards.
Equal opportunities are particularly important to us at TÜV Rheinland. We are committed to breaking down barriers and creating an inclusive working environment characterised by respect, diversity and genuine participation. We therefore particularly welcome applications from people with severe disabilities.
Join a strong team! At TÜV Rheinland, you can apply and expand your expertise in an international setting. We offer a dynamic work environment that fosters innovation and is committed to diversity and continuous learning. Together, we are shaping a future where safety and quality go hand in hand.