Fine tune existing Solr search

We already have a Solr 8.2.0 (Lucene) in place which will substitute our production 6.2.0. The issue is fine tuning so we can return relevant searches for our music related website (production instance has better results than staging instance). We have about 2 million documents (lyrics, artists, albums, radio stations) being compiled in a Docker image through Gitlab CI.

What's the issue?

Implement a test step in the CI figuring out if the index and data have expected behavior. Some keywords must expect to be listed (e.g. "Imagine" should return Imagine Dragons (band) and Imagine (song from John Lennon) but not cover from other artists - we have popularity field). This script is half way completed. Therefore, fine tuning tokenization and filters should be needed. There's going to be a list of 50+ test keywords and expected behavior.

How's the system setup:

- A Gitlab CI process builds a docker image with the full index (weekly). This makes the deployment easier. Another project (update) will be added here later on.

- An Nginx perl module modifies search queries so it returns what's desired and protect Solr instance from outside exploit. This perl module shouldn't need fine tune.

We have a test folder with a couple of scripts that make it easier to test some strings and expected returns.

We need to:

- Move folder to src/test/

- Adjust script to run during the CI process (check .[login to view URL])

- Organize better $testMap with expected results (type song, artist, etc)

- Script should query localhost during the build process (check if it's possible do do via dgoss or a simpler process)

- Add [login to view URL] test for local ports (example)

- Script should test each query below and provide ANSI colors. An ANSI green color for good results and ANSI red color for bad results. If there's a bad result, go through all queries but fail in the final step, so the CI doesn't release the new Docker image (but we can debug all queries)

- Remove unnecessary files

- Remove PHP-Shared dependency - We have some functions being called by the build script. We need to copy these functions to a new local php lib, this way it makes it easier for building the project.

Things to consider:

- The script already returns human readable table-like format, it's good to keep this formatting so we can debug the pipeline

We (try to) focus on simple implementation, so look for better code readability

- You can test the CI process in your own branch by creating a merge request. Try to minimize the amount of time that it takes so you can debug faster and we don't run out of CI minutes (we might need to buy extra minutes)

- Make it easier to add new test queries, so we can have a better build/release process

- Compare results with production Solr (6.2.0) instance running in the URL [login to view URL]

If you have questions, please let me know.

Thank you

Habilidades: Apache Solr, PHP, Docker, JSON, GitLab

Veja mais: arabic translation fine tune proz, fine tune oracle plsql, solr search performance tuning, solr tutorial, solr cloud setup, solr and lucene, solr 8.2 documentation, solr website search, solr binaries, solr zookeeper, solr cloud, solr search easier, fine tune language, customizing solr search component, solr search part word, fine tune sales pitch, drawbacks existing system search engine, fine tune joomla, install solr search centos, solr search replace google

Acerca do Empregador:
( 1 comentário ) Santos, Brazil

ID do Projeto: #22166664

26 freelancers estão ofertando em média $203 para esse trabalho


Hi, it’s pretty simple for me, but i have few questions to ask, knock me for further discussion, Thank you

$300 USD in 10 dias
(119 Comentários)

Hi, Daniel L.! I read the description of your project thoroughly. I understand your requirements initially and I have experiences of the field. I am a specialist of: * React.js, Angular for Front-end, * .NET Core AP Mais

$140 USD in 2 dias
(66 Comentários)

Hello Sir/Mam, I have read your post requirement for the " already have a Solr 8.2.0 (Lucene) in place which will substitute our production 6.2.0. The issue is fine tuning so we can return relevant searches for our mu Mais

$140 USD in 7 dias
(83 Comentários)

Greetings, I understood your requirements and i have a team of experts for website [login to view URL] me in detailed about your requirements .My name is Riya, fortunately , i have a 7 years experienced , professional team -co Mais

$140 USD in 7 dias
(48 Comentários)

Hi I can handle it. Thanks

$250 USD in 7 dias
(145 Comentários)

Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the Mais

$140 USD in 7 dias
(46 Comentários)

Hello, I'm Ankit I'm interesting your project very well I'm good in Website Design, HTHML, CSS , JAVASCRIT, JQUERY, AJAX, PHP and mysql expert. I’m quite well experienced in these jobs. Let's go ahead with me I Mais

$140 USD in 7 dias
(40 Comentários)

⭐⭐⭐⭐⭐ Hi I checked your job description carefully. You can check my past reviews here. I have developed a lot of websites. I will do my best for your project until you are satisfied. If you hire me, I will finish your Mais

$140 USD in 7 dias
(28 Comentários)

Hello, How are you? My pleasure to bid your project. I've read carefully your project description. I have more than five years experience in development related with your project. Your satisfaction with the project is Mais

$140 USD in 7 dias
(13 Comentários)

Hi client. I've read your complete requirements. I want to discuss complete details with you to understand your requirements, I am available now you can drop me a message so I can share my thoughts on your project. Mais

$250 USD in 7 dias
(9 Comentários)

Hello, I know SOLR well, used 6 version many times. But do I have to do those moving and deleting job, too? Thanks.

$250 USD in 7 dias
(4 Comentários)

Hi, I have developed themes of the following websites in wordpress. [login to view URL] [login to view URL] [login to view URL] [login to view URL] http://habitushrso Mais

$140 USD in 7 dias
(7 Comentários)

Hi Dear. I am very interested in your project. I am an expert developer who guarantees hard work, quality and perfection. As for me, I am a full-stack developer with 5+ years experience in the web development. - PHP, Mais

$200 USD in 7 dias
(2 Comentários)

Hello I am senior developer with rich experience. I read your project description carefully. If you choose me, I'll provide satisfied result you want Thank you

$140 USD in 7 dias
(3 Comentários)

⭐Hi!⭐ I got your point. I will be more than happy to help you. I have rich experiences for your project. I can contract with you that I will deliver with you want in time. -> Good Services * Deliver Daily or Weekly re Mais

$140 USD in 7 dias
(1 Comentário)

I've 7+ years of experience in Web Development/Web design, Mobile App Development(IOS/Android), Graphic design, Logo Design Business Cards & Stationery, Flyers & Brochures, Packaging Design, Web & Mobile Design, Social Mais

$140 USD in 7 dias
(2 Comentários)

Hello. I am the Apache Solr expert, and I've solid experience in managing Solr Search Engine. I've 9+ years of experience in developing large secure Web Sites with large database with Sorl search engine. I'm interested Mais

$240 USD in 7 dias
(2 Comentários)

hi, We are Really interested to do work with you , We are Web & Software development company having more than 4 year experience in Software development. we totally committed to quality service, Transparency, Customer Mais

$140 USD in 7 dias
(1 Comentário)

Web site Development Expert here. [login to view URL] [login to view URL] these are the most successful portfolios in my history. I have more than 9 years of Web development experience and PHP, NodeJS, Python, ASP Mais

$140 USD in 7 dias
(1 Comentário)

Hi. I have 3+ years development experience in Apache Solr. Also 14 years experience in j2ee. 5 years in hybris development. CV in private message.

$250 USD in 7 dias
(2 Comentários)