
Closed
Posted
Paid on delivery
Task: Replace Existing Onboard LLM with Local GPT-2B Hardware * Unitree R1 EDU * Onboard NVIDIA Jetson Orin NX / onboard GPU compute platform (~100 TOPS) * Existing robot software and motor-control system are already working. * The robot currently has a built-in Chinese AI chatbot / LLM. The exact model is not yet confirmed and is not Qwen. Main Objective Replace the robot’s existing onboard LLM/chatbot with a local GPT-2B-class language model running directly on the robot’s onboard GPU. The new local model must perform the same high-level conversational / command-understanding function as the existing chatbot, while the existing robot control and motor-control system must remain unchanged. In other words: Existing system: User Voice/Text → Existing Chinese LLM → Existing Robot Control Interface → Motors Target system: User Voice/Text → Local GPT-2B → Existing Robot Control Interface → Motors The GPT-2B model should effectively replace the existing LLM layer, not the robot’s control layer. What the freelancer needs to do 1. Identify the current AI/LLM architecture * Determine what model currently powers the onboard Chinese chatbot. * Identify how the current LLM communicates with the robot’s existing control system. * Identify the existing API, SDK, ROS interface, middleware, or function-calling mechanism used between the LLM and robot control. 2. Deploy a local GPT-2B model * Select an appropriate ~2B parameter model suitable for local inference. * Deploy it on the robot’s onboard NVIDIA GPU. * Use GPU-accelerated inference (TensorRT-LLM, [login to view URL] CUDA, vLLM, or another appropriate optimized runtime). * Optimize the model for low latency and reasonable memory/compute usage. 3. Connect GPT-2B to the existing robot interface * Do NOT rewrite the existing motor-control system. * Do NOT develop new low-level motor drivers. * Do NOT replace the existing Unitree SDK / motion-control implementation. * Instead, make the new LLM communicate with the existing high-level robot-control interface in the same way the current chatbot does. 4. Function / command calling The local GPT-2B should be able to interpret natural-language commands and generate structured commands/functions that are already supported by the robot. For example: "Stand up and walk forward" → GPT-2B interprets intent → calls existing robot functions such as: stand() walk_forward() The exact available functions/interfaces should be determined from the existing R1 EDU software. 5. Voice interface If the existing system already provides speech recognition, preserve it. If necessary, the architecture should support: Microphone → Local STT → GPT-2B → Existing Robot Functions The primary task is LLM replacement, not development of a new speech-recognition system. Important constraint The freelancer must reuse the existing robot-control stack. The project is NOT: * rewriting robot locomotion * rewriting motor control * developing a new Unitree SDK layer * developing a new walking controller * developing a new ROS control architecture The project IS: Replacing the existing onboard Chinese LLM with a locally running GPT-2B model and connecting the new model to the existing robot-control interface. Expected final architecture Microphone / Text Input ↓ Existing or Local STT ↓ Local GPT-2B running on onboard NVIDIA GPU ↓ Structured command / function call ↓ Existing R1 EDU Robot API / ROS / SDK ↓ Existing Motion & Motor Control ↓ Robot Deliverables 1. Local GPT-2B model running on R1 EDU onboard computer. 2. GPU-accelerated inference. 3. Integration with the existing robot-control interface. 4. Natural-language command → structured robot function execution. 5. Source code for the integration layer. 6. Installation/deployment instructions. 7. Ability to run the system autonomously on the robot without cloud LLM/API dependency. 8. Basic demonstration showing that the new GPT-2B successfully replaces the existing chatbot while the existing robot-control system continues to operate unchanged. Freelancer requirements Experience with: * NVIDIA Jetson Orin / embedded GPU * Local LLM deployment * 1–3B parameter models * TensorRT-LLM / [login to view URL] / CUDA optimization * ROS / ROS2 * Unitree robots or similar robotic platforms * LLM function calling / tool calling * Python and/or C++ Experience with embodied AI / LLM-to-robot integration is strongly preferred. Key point The freelancer should treat the existing chatbot as a replaceable AI module. We already have the robot’s motor-control and motion-control functionality. The goal is to replace only the LLM/AI reasoning layer with a local GPT-2B model running on the robot’s onboard GPU.
Project ID: 40717261
28 proposals
Remote project
Active 11 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
28 freelancers are bidding on average $486 USD for this job

Hello, I can see the challenge is, the existing LLM sits as a black‑box API that must be swapped without touching the motion stack. I will first reverse‑engineer the current LLM interface: capture the request/response schema, the function‑call payloads, and the ROS/SDK topic/service names. Then I’ll download a 2B‑parameter GPT‑2 variant, compile it with TensorRT‑LLM targeting the Orin NX, and cache the engine for <150 ms latency. A lightweight Python wrapper will sit in the same ROS node as the current chatbot, translate incoming text/STT to a prompt, parse the model output into function calls, and publish them to the existing motion‑control topics. Edge cases such as malformed outputs will be handled via a retry/validation loop. Deliverable: a ready‑to‑run ROS package containing the TensorRT‑optimized GPT‑2B engine, integration node, and deployment scripts that replace the chatbot binary while keeping all other robot software untouched. I have deployed 2B‑parameter models on Jetson Orin in prior projects. I can start immediately. Regards.
$250 USD in 7 days
0.0
0.0

Hello, client — ⭐ I can replace the R1 EDU’s existing onboard Chinese LLM with a local ~2B model while preserving the working robot-control stack exactly as requested, keeping inference fully local on the Jetson Orin NX. ⭐ My approach is to first identify the current chatbot → control interface, then deploy and optimize an appropriate 1–3B model using TensorRT-LLM/CUDA or the most suitable runtime, and build a thin integration layer for deterministic function/tool calling into the existing ROS/API/SDK interface. I will not rewrite locomotion, motor control, or the existing Unitree control layer; the goal is a clean, replaceable AI module with low latency and autonomous operation without cloud dependency. I’ll validate natural-language commands against the robot’s existing functions, benchmark GPU inference, configure autonomous startup, and deliver the integration source plus fresh-install deployment documentation and a working demonstration. The first thing I’d need is SSH/access to the Orin NX and the current chatbot/control interface so I can identify exactly how the existing LLM is connected. Best regards, Darial
$500 USD in 7 days
0.0
0.0

Hello! I see you're looking to replace the onboard LLM with a local GPT-2B for the Unitree R1 EDU. It's clear that your main goal is to enhance the robot's AI capabilities, ensuring better performance and responsiveness. I understand the technical requirements involving ROS and LLMs, and I'm keen to dive deeper into your current setup. Could you clarify how the existing LLM is integrated and what specific functionalities you want to improve with GPT-2B? It would also be helpful to know if there are any constraints regarding hardware or connectivity. To mitigate risk and ensure a smooth transition, I suggest a phased approach: first, setting up a development environment, then testing integration, and finally, full deployment. Some similar projects I've worked on include an internal CRM for a property agency, a regional booking platform for a tutoring company, and a React Native field-reporting app. Looking forward to your thoughts!
$500 USD in 6 days
0.0
0.0

Replacing the R1's onboard LLM with a local GPT-2B on Jetson Orin NX is a tight, well-scoped LLM-swap job — exactly the kind of edge-AI integration we ship in production through kamii.ai. I've deployed local LLMs (1B–8B class) and Telegram/Discord bots on constrained hardware, and built a 1000+ ASINs/day scraper pipeline that runs on similar embedded GPUs. Fast delivery, clean handoff. Plan: profile existing stack → quantise GPT-2B (GPTQ/AWQ) → wire via ROS2 / onboard IPC → swap dialog layer → smoke-test on device. One question: do you have SSH/serial access to the Orin NX, or is the swap expected to ship as a single signed image?
$250 USD in 5 days
0.0
0.0

I am a full-stack developer with 5+ years of experience building AI-powered applications, backend systems, and automation solutions. I can help integrate a local GPT-2B-class model into your Unitree R1 EDU while preserving the existing robot control architecture. I have experience with Python, LLM integration, API development, and deploying intelligent systems with optimized inference workflows. I can analyze the current chatbot pipeline, identify the communication layer with the robot SDK/ROS interface, deploy a GPU-accelerated local model, and build the integration layer for natural-language commands and function calling. I will focus on maintaining the existing motion-control system and replacing only the AI reasoning layer. I can deliver the implementation, source code, deployment instructions, and testing demonstration within 21 days, with a projected completion date of October 8, 2026.
$350 USD in 21 days
0.0
0.0

Dear Client, For this R1 EDU project, the biggest risk is not running a 2B model on Jetson—it is replacing only the existing AI layer while preserving every interface, timing dependency and safety boundary already used by the robot-control stack. I have 11+ years of embedded/electronics experience across 500+ assignments involving NVIDIA Jetson platforms, embedded Linux, robotics interfaces, edge systems and hardware/software integration. My development path: Existing AI Audit → Control Interface Mapping → Local Model Runtime → Structured Command Layer → ROS/SDK Integration → Latency Optimization → Autonomous Startup → Validation I would focus first on identifying exactly how the existing chatbot reaches the R1 high-level control functions. Only after that boundary is mapped would I replace the LLM layer, keeping locomotion, motor control and Unitree’s existing motion stack untouched. I can support Jetson/Linux integration, interface discovery, structured command architecture, deployment validation and system-level debugging. I would not claim Unitree R1 or TensorRT-LLM production history unless I can demonstrate it. Two important questions: 1. Is ROS2 already exposed on the R1 EDU onboard computer? 2. Can the current chatbot be launched/stopped independently from the motion stack? If you message me, I’ll tell you the first interface boundary I would identify before replacing the existing chatbot. Kind Regards, Avi Gupta Quality is never an accident
$500 USD in 7 days
0.0
0.0

As an experienced AI builder and robotics expert, my team and I are the ideal fit for your project. We have a deep understanding of Large Language Model (LLM) architectures like GPT-2B and can confidently identify the current AI/LLM architecture powering your robot's onboard Chinese chatbot. Additionally, we're skilled in working with API, SDK, ROS interfaces, and other function-calling mechanisms that are crucial to integrate the new LLM. Our expertise doesn't stop at AI. We also excel in integrating hardware components with software stacks. This aligns well with your requirement to preserve all existing aspects of the robot-control interface while making it interact seamlessly with the GPT-2B model deployed on your Unitree R1 EDU's NVIDIA GPU. Our extensive knowledge of GPU-accelerated inference techniques like TensorRT-LLM combined with our ROS and robotics proficiency assures you an optimized architecture for low latency.
$500 USD in 7 days
0.0
0.0

Okay, I got what you want exactly. I am a Full Stack Engineer with 15 years of experience, providing Embedded Robotics, Jetson, ROS2, Python/C++, CUDA, and local LLM integration. In my opinion, the key is to replace only the existing LLM layer while keeping the Unitree R1 EDU motion and motor-control stack completely unchanged. I would connect a local GPT-2B model to the existing robot functions through structured tool/function calling. This project is very similar to my previous works. I have developed ROS2/PX4 autonomous systems where AI decision logic connects to existing flight-control interfaces. I have also worked on robotic-arm systems, integrating high-level commands with established hardware-control APIs. The most important skill is reliable LLM-to-robot interface integration. I will identify the existing R1 API/ROS interface, deploy the model on Jetson Orin NX with GPU acceleration, and validate natural-language commands end-to-end. ✅ So, I will divide the project into three major steps. 1️⃣ Identify the current LLM and robot-control interface. 2️⃣ Deploy and optimize GPT-2B locally on Jetson. 3️⃣ Integrate function calling and test the complete pipeline without modifying motor control. Via private chatting or meeting, I will provide the creative idea and good tech solution for your project. Best regards. Kiniya
$500 USD in 7 days
0.0
0.0

Hi, I’m a Robotics Software Engineer with strong experience in ROS 2, C++ and Python, robot control integration, NVIDIA based robotics platforms, and connecting high level software layers to existing robot interfaces. For this project, I can first inspect the current R1 EDU chatbot architecture and determine exactly how the existing LLM communicates with the robot control stack. From there, I can replace only that AI layer with a locally running 2B class model while keeping the existing Unitree motion and motor control system unchanged. I can handle the complete integration, including local GPU inference, structured function calling, ROS or SDK interface integration, command execution, deployment, and documentation. I also have experience with embodied AI workflows where the AI layer generates high level robot actions while the existing control stack remains responsible for execution. The final system can run fully onboard without relying on a cloud LLM or API. Best regards, Milos
$750 USD in 14 days
0.0
0.0

How does the current Chinese chatbot hand output to the robot-control layer — a ROS topic, a Unitree SDK call, or an HTTP API? Your brief says identifying that interface comes first — the entire integration design hangs on the answer. Deep-learning deployment is one of my research areas; my approach here: select a model that fits the memory budget, apply quantization, and wire inference into the existing application layer without touching the rest of the stack. That maps onto your task: a ~2B model on the board's onboard GPU, GPU-accelerated inference, and a bridge to the existing R1 EDU control interface, with motor control left completely unchanged. One thing worth deciding early: the board shares 16 GB of memory with the existing robot stack, so I'd benchmark the shortlisted GPU inference runtimes on the actual board before committing — the winner decides the function-calling layer's headroom, and quantization may be required either way. Milestone 1 (days 1–7): identify the current chatbot architecture and control interface, select and deploy the 2B model with GPU-accelerated inference on the board. Milestone 2 (days 8–14): natural-language-to-structured-function bridge reusing existing Unitree interfaces, voice path preserved, plus a demo, source code, and deployment instructions showing the system runs with no cloud dependency. Can you confirm remote access to the robot, or should I develop against a matching Orin NX board? Chang
$450 USD in 14 days
0.0
0.0

Hi, My profile says QA because that is my main work: 10+ years testing real products. I also build software integrations, including LLM-based ones, and I would run your task the way I test: nothing is "done" until it is measured on the robot. Recent related work: a Unitree G1 model in MuJoCo, scripted pick-and-place, 100 recorded episodes exported in LeRobot v3 format. I can share the demo video in the chat. Plan for your R1 EDU: (1) map the current chatbot entry points and the SDK command layer, locomotion untouched; (2) run a 2-3B model in INT4 (Qwen2.5-3B or Llama 3.2 3B class) on the Orin NX and report tokens/s; (3) function-calling bridge to your existing commands (stand, walk_forward, etc.); (4) keep your current STT; (5) deliver code, README, a test log and a demo video, all offline. Access: SSH to the robot over your network (Tailscale or a VPN you already use), nothing needs to be shipped. Fixed $650 in three milestones (30/40/30) via escrow, all communication here on Freelancer. Novruz
$650 USD in 14 days
0.0
0.0

Baku, Azerbaijan
Member since Dec 11, 2017
$30-250 USD
$30-250 USD
$30-250 USD
€20-25 EUR / hour
$34-44 AUD / hour
$250-750 USD
$10-30 CAD
$2-8 CAD / hour
$250-750 USD
$10-30 CAD
$35-44 CAD / hour
$250-750 USD
$30-250 USD
₹1500-12500 INR
₹600-1500 INR
min $50 USD / hour
min $100000 USD
$2-8 AUD / hour
$25-50 USD / hour
₹100-400 INR / hour