Advanced Language Model Development Specialist

I am looking for an experienced individual specialized in developing large language models and implementing advanced techniques such as retrieval-augmented generation and reinforcement learning from human feedback. The main goal of this project is to create a sophisticated conversational AI and content generation tool. The scope of the work is to develop an LLM application using an open-LLM integrated with a Reinforcement Learning from Human Feedback (RLHF) mechanism to improve performance. The expected level of implementation is that one of a to Minimum Value Product. Since the LLM must be specialized on a specific industrial sector, it is necessary that it is trained on a set of additional documentation, for example using a RAG (Retrieval-Augmented Generation) mechanism. Consider that I have approximately 10,000 documents in pdf and word format for a total of approximately 1 TB. As part of the work, the freelance shall provide the specifications for a server (e.g.: RAM, Memory, GPU...) on which deploy the LLM and to carry out the LLM training. Once trained, the LLM shall be re-trained periodically (e.g. every 6 months) on updated set of data. In general, training could be repeated several times. The application shall implement a token consumption mechanism in order to implement a pay-per-use business model. When a user makes a request, he consumes a certain number of tokens proportional to the amount of computing resources consumed and the total amount of available tokens is updated. The LLM must be accessible through a web application (prototype) that communicates via API with the LLM engine that will be deployed in a remote server. The APIs of the LLM engine shall also be provided through standard Swagger interface. To complete the job, it is request to: - Provide detailed instructions (like a user manual) on how to train the model from scratch and how to update the training with a new set of documents - Provide a document that describe thefunctionalities and arcthiecture of the entire system - Provide server characteristics for deployment of the LLM engine and for the web application. These will be purchased by me and made available for development - Test the system with a subset of data that will be provided In the proposal, the freelance shall provide: 1. Plan for development including time, description of the activity, the approach 2. Brief description of Past similar projects encompassing engagement with LLM, RAG and RLHF 3. Budget Ideal Skills and Experience: - Proven track record in developing large language models, ideally in Python. - Experience in implementing retrieval-augmented generation and reinforcement learning from human feedback. - Strong understanding and practical experience in developing conversational AI systems and content generation tools.