Search Satisfaction Grader

Other Jobs To Apply

<p>If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact <a href="mailto:servicedesk@welocalize.com" target="_blank" rel="noopener noreferrer"><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">servicedesk@welocalize.com</span></a> subject Workday Candidate Login</p><p></p><p>When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.</p><p></p><p>Thank you!</p><p style="text-align:left"><u>NOTICE:</u>  For EMEA Jobs, please review the Privacy Policy <a href="https://welocalize.sharepoint.com/:w:/s/WorkdayInformationDocumentation/hcm/EemIOjXVxEtMtVCjFmBUGTcBxw3SEB4lfTF0AerJCbeFWA" target="_blank" rel="noopener noreferrer">here</a></p><p style="text-align:left"><u><b>Job Responsibilities:</b></u></p><p style="text-align:inherit"></p>We are seeking a detail-oriented and dedicated Search Satisfaction Grader to join our Search Evaluation Project. The primary responsibility of this role is to evaluate search results returned by an AI Assistant, ensuring they meet user intent, relevance, and contextual appropriateness according to established guidelines.<br>The ideal candidate will possess strong analytical skills, excellent reading comprehension skills, a keen eye for detail, and the ability to provide insightful feedback to improve search functionalities.<div><div><b>Project Details:</b></div><div><b>Start Date:</b> Immediately after completing the qualification process</div><div><b>Duration:</b> Ongoing</div><div><b>Employment Type:</b> W2 Full time Employee, eligible for benefits</div><div><b>Language:</b> English (US)</div><div><b>Pay Rate:</b> $15/hour</div><div><span> </span></div><div><b>Schedule Expectations</b><span> </span></div><div></div><div><b>Work Hours:</b><span><span> </span>This is a full-time remote position requiring 40 hours per week, Monday through Friday. </span></div><div></div><div><b>Training Phase:</b><span><span> </span>During the initial training phase, a set schedule will be required to ensure comprehensive onboarding and integration into the team. </span></div><div></div><div><b>Flexible Schedule:</b><span><span> </span>Upon successful completion of the training phase, a flexible schedule may be offered, allowing for adjustments to better fit personal and professional needs while still meeting project deadlines and team collaboration requirements. </span></div><div></div><div><b>Availability:</b><span><span> </span>Regular availability during standard business hours is essential to maintain communication and collaboration with team members and stakeholders. </span></div><div></div><div><b>Location</b><span>: Remote in the following States only: Arizona (AZ) Florida (FL) Georgia (GA) Illinois (IL) Maine (ME) Maryland (MD) Massachusetts (MA) Minnesota (MI) New Mexico (NM) Ohio (OH) Oregon (OR) Pennsylvania (PA) Texas (TX) Virginia (VA) Wisconsin (WI)</span></div><div></div><div>By applying, you'll become part of our team, contributing to a range of projects tailored to your skills and availability, particularly highlighting localization and linguistic expertise.</div><div></div><div></div></div><div><div><h3>Key Responsibilities:</h3><ul><li><ul><li><b>Understand the Query:<span> </span></b>Analyze user queries to determine intent and possible meanings. Use web search links and research tools to comprehend the context and variations of the query.</li><li><b>Review and Assess Search Results:<span> </span></b>Evaluate the relevance and accuracy of the Assistant’s responses. Identify and flag issues such as wrong language, content unavailability, or inappropriate content.</li><li><b>Validate Results:<span> </span></b>Confirm the accuracy and appropriateness of search results. Ensure results align with user location, query date, and other contextual information.</li><li><b>Rate the Results:<span> </span></b>Assign satisfaction ratings (Highly Satisfying to Not Satisfying) based on the established guidelines. Consider factors such as user effort, source quality, and degrees of separation from the query concept.</li><li><b>Provide Feedback:<span> </span></b>Offer detailed feedback and comments on flagged results to aid in search improvement. Highlight common grading mistakes and ensure adherence to guidelines.</li><li><b>Continuous Improvement:<span> </span></b>Participate in training and certification processes. Stay updated with guideline changes and incorporate QA feedback into evaluations.</li></ul></li></ul></div></div><div><div><h3>Requirements:</h3><ul><li><ul><li><b>Fully Proficient in English (US): Linguistic competency in target language equal to ILR Level 5 or CEF C2</b></li><li><b>Preferred Areas of Education and or Experience and Focus, including but not limited to:</b> Localization, Linguistics, Computer Science </li><li> A degree is not necessary but preferred. Students are welcome to apply. </li><li><b>Preferred previous experience:</b><span> </span>in Search Relevance tasks, with e-commerce searches/websites</li><li><b>Skills:</b></li><li>Excellent online research skills</li><li>Attention to detail</li><li>Ability to perform thorough research within allocated time</li><li>Ability to follow instructions in English and comply with project conventions and rules</li><li>Excellent Reading Comprehension Skills</li><li>Understanding of User Intent</li><li>Tech Savvy</li></ul></li></ul></div></div><p style="text-align:left">Additional Job Details:</p><div><div><h3>Additional Requirements: </h3><ul><li><ul><li>Must sign a Non-Disclosure Agreement to protect client <span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">confidentiality </span></li><li>Must pass training and a required quality test before starting work </li><li>Must have work authorization in the US</li><li>Reliable computer system and internet connection</li></ul></li></ul></div></div><div><div></div><div>$15 - $15 an hour</div><div></div><div><u><b>Benefits:</b></u></div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Accident, Critical Illness, Hospital Indemnity Insurance</div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Telemedicine Benefit</div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Paid Sick Time</div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Paid Holiday – 2 days</div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Employee Assistance Program</div><div></div><div><b>Following eligibility requirements:</b></div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>Medical Insurance, Dental Insurance, Vision Insurance,<span> HSA, Voluntary</span> Life Insurance</div><div>·<span><span style="overflow-wrap: break-word; display: inline; text-decoration: inherit; hyphens: auto;">         </span></span>401(k) Retirement Plan</div><div></div></div><div><div><b>What to Expect</b></div><div></div><div>- Collaborate on projects with leading tech companies in the AI industry.</div><div>- Learn and develop skills with an experienced team involved in various aspects of AI technology.</div><div>- Gain hands-on experience in the world of AI-driven search functionalities and localization.</div><div>- Develop quality assurance testing skills that are applicable across multiple industries.</div><div></div><div><b><i>Join our dynamic team and work with cutting-edge AI content, making a real impact in AI models, search evaluation, and localization. Gain valuable experience in the AI industry and contribute to the development and refinement of AI models.</i></b></div></div>

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...