iOS4 application library that shows a live updating image from the camera, OCRs on screen text, and replaces the text on screen from a local lookup database. Database contents will be provided.
Each image update, the application:
-OCR searches for text in the image.
-Blank the area (remove the text) the text shows up in with the surrounding image pattern.
-Lookup the OCR text in the database and find the replacement text.
-Render the lookup text on screen in the same location, size, and color as the original text.
Program image update speed and OCR accuracy is key. Program OCRs machine printed text only, it does NOT recognize hand writing. For iOS4 devices with cameras only.
Library call suggestions:
Camera control - start / stop / turn on/off camera flash if available
Text found - return text found in image
Lookup in DB - Search and replace / select DB
Replacement text - text to replace onscreen. Separated call so different lookup code/libraries could be used.
Save image - live / text free / replaced text image
Testing demo application (that calls this library project) screens:
1) Main screen with control overlays - camera / select DB / image save or email
2) Help Manual
3) Manual text lookup in DB
Library does NOT search for or OCR Asian characters/symbols.
Special consideration will be made if the library can be compilable into different versions for Android, iOS4, and Blackberry (with high resolution or macro cameras). We know the hardware calls and OS libraries are very different on each device. Plan the library calls carefully for this. Clearly state if your bid includes the additional Android and Blackberry support.
Bids that don't include Android and Blackberry are welcomed and will be considered.
Please ask any questions you have.
Added January 15, 2010:
This application is for signs, advertisements, and billboards. It is not to translate a book page of text.
This application is a simple a series of separate steps (each a separate library call that gets one thing done) that put together looks very impressive.
2)Text detection - define area
3)Character recognition in that area
4)Database lookup replacement text
5)Text 3D position and colour estimation
6)Blend background / erase old text
7)Render replacement text on top
Since it runs through the steps repeatedly, it does not need to score 100% OCR. The replacement words can jump in and out of the video and this is OK for the user.
Word jumping is shown in this review of a competitor's product on YouTube.
[url removed, login to view]
We do not expect the program to overcome bad user choices (like low lighting, bad focus) and achieve high OCR accuracy. The program can give indications to the user (more light needed icon, target boxes, etc.) to train the user to use the end application successfully.
The 3 required screens are demonstrated in the video.
In great lighting, the program runs like this (with close up screen shots):
<[url removed, login to view]>
The competitor discussed is focusing on language translation. Our text replacement databases are focused on other markets.
iOS4 Android Blackberry