
In Progress
Posted
Paid on delivery
I am an independent researcher running a small reliability study. I am seeking two people to work independently, plus one reserve, to apply a written six-category codebook to 20 short written exchanges. Each exchange contains a claim, a challenge and a reply. You will read the reply and select exactly one category using the supplied instructions. The task needs careful reading and judgement under a written rule. Subject expertise, programming, a publication record and experience of AI evaluation are not required. Time and pay The main task is expected to take about 60–90 minutes in one sitting. Pay is A$50 per hour, calculated from time worked, with a maximum of A$75 for the main task per activated coder. Payment is for your work and does not depend on agreement with another coder or an expected answer. If you withdraw, your time worked is paid at the same rate within the agreed A$75 limit, and completed work is retained. These terms are identical for everyone and will be acknowledged privately before work starts. Stop at 90 minutes if unfinished and report that fact privately without discussing item content; do not undertake additional unpaid work. A reserve receives no work or packet, and incurs no commitment, unless activated to replace a primary coder. This posting collects applications. Screening begins with the questions below and a review of platform evidence. Any later paid screening task will be agreed separately before it starts. Do not submit sample labels or undertake unpaid trial work with your bid. A start date will be agreed privately after screening. Independence conditions 1. Complete the work personally and alone. Do not subcontract it or discuss the instructions, items or answers with anyone. 2. Do not use an LLM, chatbot, search engine, external reference or software assistant to interpret or label any item. Ordinary software used only to open and save the response file is permitted. 3. Use only your assigned packet. Do not look for another coder, their packet, an answer key or the researcher's intended results. 4. Questions about logistics or a file that will not open are welcome privately. Do not send item content or ask about its meaning, wording or category until the coordinator confirms that both independent returns have been frozen. 5. Keep all supplied materials private. If you discover relevant prior exposure or a possible connection to another coder, disclose it immediately. Disclosure will not reduce payment already earned under the agreed terms. Prior exposure You must not have encountered this research project's materials before this recruitment notice. Do not search for the project or the repositories mentioned below to prepare your answers. Answer from what you already know. An honest “not sure” requires clarification and is not an automatic rejection. Required application questions Please number your answers. Use Yes / No / Not sure plus one sentence for questions 1 and 2. 1. Have you ever read, commented on, reacted to, forked or submitted code to any public issue or pull request in lighteval, ragas, HELM, HuggingFace evaluate or deepeval about how those tools handle missing, unparseable or empty values? 2. Before seeing this recruitment notice, had you read anything written by or about this research project: a paper, preprint, funding page, forum post or code repository? If you cannot identify whether something you saw was this project, answer “Not sure”; do not investigate it. 3. How did you come across this posting? Name the route, such as Freelancer search or a referral. Do not publish someone else's private details. 4. Will you personally work alone, without subcontracting, discussion or assistance interpreting the items, and accept all five independence conditions above? 5. In two sentences, explain how you would follow written category rules when you personally disagree with them, and what you would do if a file would not open. Do not invent or label a sample exchange. 6. Can you complete the main task in one sitting, and what dates and time zone suit you? Confirm whether you are applying as a primary coder, reserve, or either, and whether the proposed rate and limit are acceptable. Deliverable One CSV with exactly the header coder_role,item_id,label and one row per item. Keep your assigned coder_role unchanged. Choose one of the six labels specified in your packet. Return no explanations, confidence ratings or extra columns in the main-task CSV. Return the file privately through Freelancer. Applications will be reviewed after the bidding period shown on Freelancer ends. Communicate about logistics through private Freelancer messages. Do not post personal details, research materials or item answers in public comments. Only screened and separately appointed coders will receive their own packet after acknowledging its receipt.
Project ID: 40699998
14 proposals
Remote project
Active 2 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

Hi, I’m interested in your independent categorization task. I understand the work involves reviewing 20 short exchanges and assigning exactly one of six categories based strictly on the written codebook and decision procedure. I’m detail-oriented and comfortable with structured, rule-based tasks where consistency and accuracy are essential. I will work independently, use only the provided packet, and submit the CSV with the required header and one row per item. Screening questions: 1. No. I have never read, commented on, reacted to, forked, or submitted code to any public issue or pull request in lighteval, ragas, HELM, HuggingFace evaluate, or deepeval concerning missing, unparseable, or empty values. 2. No. I had not read anything written by or about this research project before seeing this notice. 3. I found this posting through Freelancer.com. 4. Yes. I will work alone without subcontracting, discussing the task with others, or receiving assistance interpreting items, and I accept all five independence conditions. 5. I will follow the written rules and decision procedure even if I disagree with a rule. If a file cannot be opened, I will report it without describing or interpreting its contents. 6. Yes. I can complete the task in one sitting within 60–90 minutes and am available in WIB (UTC+7). I’m applying as primary coder or reserve, and A$75 fixed is acceptable. Thank you for considering my bid. Best regards, Eka Reezqiana
$75 AUD in 1 day
0.0
0.0
14 freelancers are bidding on average $119 AUD for this job

Hi there, I have carefully reviewed the project requirements for the Independent Categorization Task for Exchanges -- 2. I understand the need for two separate coders to apply a six-category codebook to 20 short written exchanges independently. Let's chat and discuss it further. To handle your project, I will start with reading each exchange, applying the provided codebook guidelines, and assigning one of the specified labels: CONCEDED, CORRECTED, REBUTTED, DENIED-UNSUPPORTED, DEFLECTED, or UNRESOLVED. I will ensure strict adherence to the independence conditions outlined in the project description to maintain the integrity of the study. The deliverables will include one CSV file with the header coder_role, item_id, and label, with one row per item containing the assigned label. No additional explanations or columns will be included. Before signing-off my bid, I would like to ask a question, i.e., "How will the reserve coder be notified if their activation is required for the project?" Warm Regards, Aneesa.
$100 AUD in 1 day
5.7
5.7

Hello Sir, Would you like to try categorizing exchanges for a reliability study without any prior expertise required? Our approach ensures pure, unbiased judgment under a defined code without the influence of external references or discussions. Let's connect to discuss how your participation can make an impact in this study. Best, Smith
$140 AUD in 7 days
5.5
5.5

Hi There, Ready right now I'm ready to read 20 short exchanges, assign one of six categories . I will show you sample for your satisfaction and project accuracy then we will go to start, so please contact me and share more details thanks. Check My Profile: https://www.freelancer.pk/u/WelcomeClient I would like to work on this project and can complete with 100% accuracy within the time frame. https://www.freelancer.pk/projects/excel/business-profit-loss-reporting-excel/reviews https://www.freelancer.pk/projects/data-entry/copy-listings-from-website-another/reviews Thanks, Umer
$75 AUD in 1 day
4.9
4.9

Hi, I’m interested in participating as an independent coder. I have substantial research experience and am comfortable applying predefined coding criteria consistently, working independently, and delivering structured CSV data exactly to specification. I can complete the task in one sitting and will comply fully with the independence requirements. Screening questions: No. I have not read, commented on, created, forked, or submitted code to any public issue or pull request in LightEval, Ragas, HELM, HuggingFace Evaluate, or DeepEval concerning missing, unparseable, or empty values. No. I have not previously read anything written by or about this research project. I found this posting directly while browsing Freelancer. I understand that all coding decisions must be made independently using only the supplied packet and that no external tools, AI systems, references, or discussion with others may be used to interpret the items. Best, Irfan
$140 AUD in 7 days
3.3
3.3

Hi, I got that you are looking for two independent coders to categorize 20 short exchanges into six different categories based on the provided codebook. This is what I can help you with, let's chat. My approach is to meticulously analyze each exchange, applying the predefined codebook with precision to ensure accurate categorization. By utilizing the decision procedure outlined in the codebook, I will assign each exchange a label of CONCEDED, CORRECTED, REBUTTED, DENIED-UNSUPPORTED, DEFLECTED, or UNRESOLVED. The final deliverable will be a CSV file with the assigned labels for each item, following the specified format. I will maintain strict independence throughout the process, adhering to all outlined conditions. As final deliverables, you will receive a comprehensive CSV file with the coder role, item ID, and assigned label for each exchange. Each label will correspond to one of the six predefined categories, ensuring clarity and consistency in the categorization process. One thing I'd like to confirm before we start: Are there any specific criteria for handling ambiguous exchanges that do not clearly fit into any of the defined categories? Looking forward to collaborating on this project. Let's discuss further. Regards, Imran
$100 AUD in 1 day
0.0
0.0

Hi, I’m interested in this research task. I can carefully follow the provided codebook and complete the 20 items independently within the given time. I will follow all the independence and confidentiality requirements and can provide the CSV in the required format. I’m available to start as per your schedule.
$100 AUD in 4 days
0.0
0.0

You can bid with this short, direct application: Message No — I have not read, commented on, reacted to, forked or submitted code to those projects regarding missing, unparseable or empty values. No — I have not encountered this research project or its materials before this posting. Freelancer search. Yes — I will personally work alone and follow all five independence conditions. I will follow the written category rules even when my personal view differs, applying the instructions consistently. If a file would not open, I would contact you privately and wait for instructions. Yes — I can complete the task in one sitting. I am applying as a primary coder; my timezone
$30 AUD in 7 days
0.0
0.0

Hi there, 1. No. I have not read, commented on, reacted to, forked, or contributed to public issues or pull requests in the listed tools regarding missing, unparseable, or empty values. 2. No. Before seeing this posting, I had not read anything written by or about this research project. 3. I found this posting through Freelancer search. 4. Yes. I will complete the work personally and independently, without subcontracting, discussing the materials, or using any assistance to interpret or label the items. 5. I will follow the supplied written category rules exactly, even if my personal interpretation differs. If a file does not open, I will report the technical issue privately and wait for instructions without reviewing or discussing any item content. 6. Yes. I can complete the main task in one sitting and am available in IST (UTC+5:30). I am applying as either a primary coder or reserve, and I accept the proposed rate and maximum payment limit. Thanks, Manisha
$140 AUD in 7 days
0.0
0.0

Hola, he leído tu propuesta de proyecto y me parece interesante; lo encontré en ofertas de proyecto de freelancer.com y quiero postularme como codificador principal. Estoy ubicado en Venezuela y puedo hacer el trabajo en horario de 7 a 8:30 pm hora local; soy Master en Ciencias del Suelo, jubilado de la administración pública como investigador agricola y tengo más de 10 años de experiencia en el manejo de tablas de datos en excel y en coordinación de equipos de trabajo. Espero contribuir de forma positiva a tu proyecto.
$140 AUD in 7 days
0.0
0.0

risdon vale, Australia
Payment method verified
Member since Sep 2, 2026
$250-750 USD
$250-750 USD
₹12500-37500 INR
$15-25 USD / hour
₹750-1250 INR / hour
₹100-400 INR / hour
₹750-1250 INR / hour
$30-250 USD
$100-250 USD
₹12500-37500 INR
min ₹2500 INR / hour
₹750-1250 INR / hour
₹1500-12500 INR
₹750-1250 INR / hour
₹600-1500 INR
₹1500-12500 INR
$25-50 USD / hour
₹12500-37500 INR
₹750-1250 INR / hour
$15-25 USD / hour