Description

The Gmail & Google Calendar AI Assistant Evaluator will undertake essential tasks that enhance the performance of AI assistants. This role involves completing realistic digital tasks such as emailing, scheduling, and coordinating using AI tools under standardized conditions. You will provide AI assistants with clear instructions for real-world tasks, review their work for accuracy, and apply grading guidelines to evaluate and provide feedback. This position is remote and available to candidates based in the United States.

Company Culture and Environment

This role fosters a culture of innovation and collaboration, emphasizing attention to detail and quality. Evaluators are encouraged to provide constructive feedback to improve AI models, contributing to a shared goal of enhancing user experience.

Career Growth and Development Opportunities

As an AI Assistant Evaluator, you will have the opportunity to participate in ongoing quality reviews and refine evaluation processes, which can lead to professional development in AI evaluation and data analysis fields.

Detailed Benefits and Perks

• Flexible remote working conditions
• Opportunity to work on cutting-edge AI technology projects
• Involvement in a collaborative team environment that values feedback and improvement

Compensation and Benefits

• Competitive compensation based on experience
• Opportunity to work on innovative projects within the AI domain

Why you should apply for this position today

This role offers a unique opportunity to work at the forefront of AI technology while contributing to real-world applications. By applying, you will be part of a team that values your insights and feedback, directly impacting the development of AI assistants.

Skills

• Proficient in using Gmail and Google Calendar in daily life
• Strong coordination skills over email and text
• Experience with online booking and using AI tools
• Exceptional attention to detail
• Strong written communication skills
• Effective time management and self-organization abilities

Responsibilities

• Complete everyday digital tasks using AI assistant tools
• Review and verify AI assistant outputs for accuracy and completeness
• Apply grading guidelines to evaluate and provide feedback on assistant responses
• Test diverse scenarios involving email threads and calendar invites
• Use AI training tools to record findings and submit evaluations
• Collaborate with team members to refine guidelines and ensure consistency
• Participate in ongoing quality reviews to maintain evaluation standards

Qualifications

• Must be based in the US with access to an iPhone and social media accounts
• Hands-on experience with Gmail and Google Calendar
• Regular experience coordinating tasks over email or text
• Comfort booking tasks online independently
• Experience in giving clear instructions to AI tools and reviewing their work

Education Requirements

• High school diploma or equivalent

Education Requirements Credential Category

• General Education

Experience Requirements

• Experience in AI evaluation, data labeling, or user testing is preferred
• Familiarity with prompt writing and AI behaviors is a plus

Why work in New York, NY

New York City is a vibrant hub of innovation and technology, offering a dynamic work environment. The city provides easy access to a diverse range of professional opportunities, cultural experiences, and networking events, making it an ideal location for personal and career growth.