Bill: $58.41
Pay: $41
Spread:353.6
Manager has results from test that are automatically funneled to her, we do not need to include the link.
Mgr / StaffUp is implementing a shared doc where we can add all our potential subs and Donna will fill out pass or fail so we do not waste a sub spot if they did not pass an assessment.
HM: Donna Tran
Manager Updates 3/21:
JD is accurate, annotating lg volumes of textual data and adhering to set guidelines. Metrics involved, need to do accurately but need to do so at a reasonable pace.
Reading and analyzing lg data and annotating.
Required? Bach degree, was originally looking for journalism, English etc but we haven't had a lot of success with this so I'm open to any bach degree and have had established skillset and competent enough to do the job and pass assessment. Attention to detail is really crucial.
Need to hire ASAP tomorrow.
Pot to extend or convert? Cannot say right now
Pref for them to come onsite 3 x a week to palo alto office bc this is where Donna is. 9:30-5:30PM PT
Interviews: Initial will be pre screening assessment, then round 1 w donna (45 mins) where she will do a summarization assessment, then move to interview with her director and engineer on the team. Total of 3 rounds.
Vendor ?s
- Want any AI or machine learning? A plus, not mandatory
- What BG looking for, data analysts, content review? Looking at it from variety would be good, don't want to restrict to just data annotation. Annotating lg parts of data and be good at it.
- Typing min req? 40 WPM, do not share resumes if they have less
- Why orig sourcing for English lit candidates? Ppl who have majored this are fam with reading a lot of textual data in English classes, assumption is if they are used to reading lg data they would be good in this role.
- What is the data requirement, what should we be requiring? The data we have is not super technical, ppl who have good reading comprehension should be able to read textual data and obtain accurate information. Specific exp, looking at content writing, technical writing. I am open though, this has been hit or miss.
- What is the day to day. Are they doing data annotation all day long? They would be labeling from start to end of shift. May be quality tasks involved where they review peers work and assess. For most part annotating, reading analyzing for the entire day.
- How much professional exp are you seeking or open to fresh grads? Either is fine.
- You mentioned you were not seeing the right resumes with the degrees in Journalism, English etc. What was it you were not seeing? In her interview she has a summarization exercise, ppl who had this BG could not pass the assessment even though I thought initially they would have experience to do so.
- What can we do to weed out? Passing initial prescreen you are sending out, not many are. It is a like a 30% rate so far she's already reviewed bc she gets the assessment immediately once completed.
- Example of a piece of data and how labeled? Call transcript, which is what will be on her assessment w them. Seller and agent. Based off directions they then have to read transcript, extract info and make sure it's accurate to what is being asked.
- Donna will train directly, for a few days, after this right into labeling and she will be here to help support which is why she wants them to be onsite.
- How measuring success? Still TBD, want to make sure expectations are realistic, right now it's just Donna and she doesn't know how to quantify just yet.
- Data annotation vs correct English grammar? Grammer is very important for this bc they are reading and comprehending. Initial assessment is gaining basic competencies.
- We are supporting all AI projects. Cannot share the exact work.
- Pref for enterprise industries? No particular. Source a variety, had exp with LLM, some fresh grads, someone who has a strong BG just need them to do the job and do it well.
- Open to candidate pursing bach? No, they need to have it.
BR w/ MSP fee removed: $58.41
Would you like supplier engagement?: Yes (Donna Tran, donna.tran@salesforce.com)
Aside from the job description, can you provide an overview of what a day for this contractor will look like? Various types of data labeling and review
Please rank your preferred top skill sets: (For Example: tools, previous experience, technologies)
Must have skills: Bachelor's degree in English, Literature, Creative Writing, Journalism, or a related field (or equivalent work experience). Strong reading comprehension and writing skills, with the ability to understand and interpret complex and diverse texts.
Teachable skills/Optional skills: prior data annotation experience
3. How quickly are you looking to interview/hire? ASAP.
4. I understand this is approximately a 04/15/2024 to 01/31/2025 contract. Any possibility of extension or going perm? There might be, but this is the budget that is currently approved right now for this duration.
5. This role is located in California - Palo Alto.
Can this position be fully remote? No, hybrid role
Does this worker need to by any hubs? (If so, provide onsite address and how many days per week) YES, Palo Alto
If the role requires the worker to be onsite? (If so, provide onsite address and how many days per week) 3x a week @ 181 Lytton Ave, Palo Alto, CA 94301
Any specific time zones this candidate will need to work to accommodate? PST
7. How many interview rounds and will there be any assessments? (Please Note: Please try to condense multiple round interviews to panels to ensure candidates are still available) Pre-Screening Assessment (15 mins), if pass moves onto Round 1 of interview with me Summarization Assessment, if pass moves onto Rounds 1 & 2 with Director and Researcher
8. Any other critical details to note for our suppliers? (Team size, candidates that have been in this role prior, different titles of the role, etc.) Data Annotation Specialist is another name for the role
---------------Responsibilities:---------------
* Accurately label machine learning data through various methods to refine AI models. This will primarily involve annotating large volumes of textual data according to predefined guidelines.
* Collaborate with team members to identify improvements to the labeling interface or labeling processes in order to drive efficiency and high-quality.
* Complete assignments by deadlines while meeting team expectations and goals.
---------------Required Skills/Experience:---------------
* Bachelor's degree in English, Literature, Creative Writing, Journalism, or a related field (or equivalent work experience)
* Proficiency in reading comprehension and possessive of strong writing skills, with the ability to understand and interpret complex and diverse texts.
* Ability to work independently, follow instructions, manage time effectively, and meet deadlines in a dynamic and fast-paced environment.
* Ability to manage ambiguity, uncertainty, and changing priorities with limited resources.
* Ability to accept and integrate continuous feedback while remaining professional.
* Excellent verbal and written communication skills and the ability to collaborate within a multi-disciplinary team.
* Quick learner and self-starter with strong problem-solving skills.