Private retrieval-augmented generation over your own files

A model knows nothing about your team's rules or your notes. Retrieval fixes that: search your files for passages related to the question, paste the best few into the prompt and ask the model to answer from them. Run locally, the files never leave your disk.

In Daveth Pro (AI Engineering)

What this page answers

How do you use AI on confidential documents?

Run the model and the retrieval locally, so the files never leave your disk; it is the safest way to use AI on confidential material. Read it in “Your files, your machine”

How does a private RAG assistant work?

Search your own files for passages related to the question, paste the best few into the prompt and ask a local model to answer from them, all on your machine. Read it in “Your files, your machine”

Your files, your machine

The model knows nothing about your team's expense rules or your project notes; it was trained before they existed, on public text. Retrieval fixes that: search your files for passages related to the question, paste the best few into the prompt, and ask the model to answer from them. Run locally, the files never leave your disk, which makes this the safest way to use AI on confidential material (Track E, lesson E4).

To test it, I wrote a fictional team handbook of twelve short policies (expenses, office hours, leave, travel), facts no model could know, and asked the local 1.5B model twelve questions about it, once on its own and once with the two most relevant passages retrieved.

Predict first. Without the handbook, how many of the 12 questions does the model answer correctly?

  • none or one
  • two to four
  • five or more

Answer. 0 of 12. With the two best passages from the handbook in the prompt: 12 of 12.

With and without your notes, measured

QuestionModel aloneWith retrieved notes
Above what amount does an expense claim need a receipt?In most cases, expenses over $50 require a receipt to be submitted for reimbursement or tax purposes. However, the specific requirements can… ✗An expense claim needs a receipt if it is for amounts of **150 euros** or more. ✓
What time does the Lisbon office close on weekdays?I'm sorry, but I don't have any specific information about the closing times of an "Lisbon office" as it's not clear what type of organizati… ✗The Lisbon office closes at 20:00 on weekdays. ✓
Which room is the IT desk in?I'm sorry, but I don't have enough context to determine which specific room an IT desk might be located in. The location of an IT desk can v… ✗The IT desk is located in room 3.12 on the 3rd floor. ✓
How many days of annual leave does everyone get?As an AI developed by Alibaba Cloud, I don't have access to specific information about individual employees' annual leave entitlements. Annu… ✗Everyone gets 25 days of annual leave. ✓
When does the platform on-call rotation change?I'm sorry, but I can't answer this question because it's not clear what you're asking about. Could you please provide more context or clarif… ✗The platform team's on-call rotation changes on Tuesdays at 10:00. ✓
Who approves flights?The approval of flights is typically handled by the airline's operations department or flight dispatch center. These departments are respons… ✗The person who approves flights is Marta Okafor. ✓
How soon must a lost laptop be reported?As an AI developed by Alibaba Cloud, I don't have specific information about the regulations for reporting a lost laptop. However, in genera… ✗A lost laptop must be reported to security@ within 1 hour. ✓
When is the monthly all-hands meeting?I'm sorry, but I can't answer this question for you. This might be related to your company's internal operations and scheduling, which I don… ✗The monthly all-hands meeting is on the first Wednesday of each month at 16:00, in the Atrium and online. ✓
How big is the yearly learning budget?As an AI language model, I don't have access to specific information about individual companies or organizations' budgets for their employee… ✗The yearly learning budget for each person is 800 euros. ✓
How many weeks of parental leave does the primary carer get?In most countries and regions, parents have different amounts of time off for each parent to take care of their newborn child during the fir… ✗The primary carer gets 20 weeks of parental leave. ✓
How many days a year can someone work abroad?The number of working days in a year that someone can work abroad depends on the specific country or region they are traveling to and their … ✗Someone can work abroad for up to 30 days a year with HR approval. ✓
When do carried-over holiday days expire?Carried-over holiday days typically expire on the last day of the fiscal year or quarter in which they were originally recorded. This is bec… ✗Carried-over holiday days expire on 31 March. ✓